Evaluating methods

19 important questions on Evaluating methods

When planning your evaluation, what are the main considerations regarding the location of the evaluation?

- Lab setting
- Field setting
- Remote evaluation

What are some user-related factors to take into account during evaluation in user studies?

- User behavior
- User attitude

When conducting an evaluation in user studies, what aspects should be assessed?

- Usability
- Usefulness
- User experience
  • Higher grades + faster learning
  • Never study anything twice
  • 100% sure, 100% understanding
Discover Study Smart

What are the characteristics of summative evaluation?

- Focused on assessing design performance using specific metrics such as time-on-task and success rate.
- This evaluation is for high-fidelity prototypes and fully functional products.

What are the characteristics of a lab-based evaluation location?

- Provides consistent conditions
- Ensures a controlled environment

What are the benefits of conducting evaluations in the field?

- Offers a realistic context-of-use
- Increases ecological validity

What is a key advantage of remote evaluation locations?

- Beneficial when the target audience is challenging to reach

What are the key aspects to assess when considering usability in product design?

- The focus is on the product itself.
- It includes evaluating the ease of use.
- Requires identification of design issues that impede effectiveness and efficiency.

How is usefulness tested in the context of product design?

- Involves testing to what degree the design addresses the users' problems.
- Related to designing the right thing as per Buxton's principle.

What is emphasized when assessing user experience in product design?

- The assessment is centered on the individual using the product.
- It seeks to understand users' perceptions and reactions to the design.

What is the shift in focus and research areas from the 2nd wave to the 4th wave of HCI evolution?

- 2nd Wave:
- Focus on task performance and functionality
- Research in Mathematics & Computer science
- 3rd Wave:
- Focus on accuracy, ergonomics, ease of use
- Research in Human cognition, performance vs. machine capabilities
- 4th Wave:
- Focus on human behavior, activities in everyday life
- Research in Social sciences, Psychology, human-computer interaction

What topics are associated with the 4th wave of HCI evolution?

- Topics associated with 4th Wave:
- Design for the greater good
- Social responsibility
- Research in Ethics, technology-mediated interaction, ubiquitous computing

What are cognitive walkthroughs?

Cognitive walkthroughs are a method proposed by Polsen et al. in the 90s to evaluate how well the design supports users in learning a task. This evaluation is performed by Experts who walk through the design and identify potential problems from a theoretical and psychological perspective.

What is heuristic evaluation and who proposed it?

Heuristic evaluation is primarily used to debug design. It is proposed by Nielsen and Molich.

Who typically performs heuristic evaluation and why?

Heuristic evaluation is typically performed by Experts to assess the predictability, consistency, and feedback of a design or identify if certain heuristics are violated.

What is the importance of using cognitive models in predicting user performance and design options?

- Helps predict user performance and design options
- Supports or refutes design choices based on results
- Helps in making design decisions informed

What caution must be taken when using results from literature to support or refute design choices?

- Ensure results are transferable to new design
- Consider applicability of results to the specific design context
- Be wary of generalizing results to all design scenarios

What are some key aspects of usability tests?

- Task-driven
- Verbal and non-verbal insights
- Uncover usability issues
- Verbalization of thinking process

What is a diary study, and how does it differ from logging?

A diary study involves asking individuals to reflect on their experiences at set intervals to track their attitudes. On the other hand, logging automatically records specific interactions or events to monitor behaviors.

The question on the page originate from the summary of the following study material:

  • A unique study and practice tool
  • Never study anything twice again
  • Get the grades you hope for
  • 100% sure, 100% understanding
Remember faster, study better. Scientifically proven.
Trustpilot Logo