Usability testing - Challenges and Frequent Mistakes

11 important questions on Usability testing - Challenges and Frequent Mistakes

What are the most frequent and seriuous mistakes in usability evaluation, in particular usability testing?


  • The purpose of the usability evaluation is not clear
  • Scheduling too late
  • Critical results ignored
  • Incorrect focus
  • The moderator is too active
  • No post-session interview
  • No involvement of stakeholders
  • Unusable usability test report
  • No positive findings reported
  • Usability findings are not categorized

Give a description of the mistake: The purpose of the usability
evaluation is not clear.


The purpose should be described in the usability test plan and
approved by the stakeholders before the usability evaluation
starts.

Give a description of the mistake: Scheduling too late.


The usability evaluation happens so late in the development
process that there is no time to correct any usability problems
before the software product is implemented. Note that this mistake is less likely to occur if an agile software development lifecycle is used.
  • Higher grades + faster learning
  • Never study anything twice
  • 100% sure, 100% understanding
Discover Study Smart

Give a description of the mistake: Critical results ignored.

Critical usability evaluation results are overruled by management.

Give a description of the mistake: Incorrect focus.


The usability evaluation focuses on minor details like user
interface guideline violations and graphic design and does not
address serious problems with effectiveness and efficiency.

Give a description of the mistake: The moderator is too active.


The moderator’s main purpose is to passively observe what a test
participant can do on their own with the software product. The
moderator should not interview or entertain test participants, or
demonstrate the software product to them.

Give a description of the mistake: No post-session interview.


A short interview after a usability test session is important to
summarize the test participant’s impression from the usability test.

Give a description of the mistake: No involvement of stakeholders.


The stakeholders should be involved in various activities of the
usability test (e.g., planning, reviewing) so you can convince them of adressing the usability problems.

Give a description of the mistake: Unusable usability test report.


The usability test report is unusable, for example because it is too
long, contains too many findings or has no one-page executive
summary.

Give a description of the mistake: No positive findings reported.


The usability test report contains no positive usability findings.
Positive findings are important to get acceptance of the results.

Give a description of the mistake: Usability findings are not categorized.


The reader of the usability test report must be able to quickly
distinguish between critical and minor usability problems.

The question on the page originate from the summary of the following study material:

  • A unique study and practice tool
  • Never study anything twice again
  • Get the grades you hope for
  • 100% sure, 100% understanding
Remember faster, study better. Scientifically proven.
Trustpilot Logo