Evaluation with Users Quiz :Evaluating User Interfaces (User Interface Design Specialization) Answers 2026

Question 1

Voluntary, informed consent in user evaluation

• ❌ Once people volunteer, it’s OK to require them to finish

• ❌ Must tell exactly what you’re looking for

• ❌ Best to use employees/students

• ✅ It is important to make sure that users do not feel coerced to participate

Explanation:
Consent must be voluntary, and participants must feel free to withdraw at any time without pressure.

Question 2

Purpose and nature of massive A/B testing

• ❌ Inflate statistical significance artificially

• ❌ Users opt in and choose versions

• ❌ Two-answer surveys

• ✅ Randomly assigning users in live systems to test which designs best meet user and business goals

Explanation:
Modern A/B testing uses randomized experiments at scale to measure real behavior.

Question 3 (Select all that apply)

True of summative evaluations

• ✅ Typically include comparison with alternatives or baselines

• ❌ No specific tasks

• ❌ Answer “why” and lead to design implications

• ✅ Typically include quantitative metrics

Explanation:
Summative evaluation focuses on measurement and comparison, not deep “why” insights.

Question 4 (Select all that apply)

What should be included when describing study goals

• ✅ Risks and benefits of participating

• ❌ Explaining participant performance will be evaluated

• ✅ Clarifying that the prototype—not the user—is being tested

• ✅ Instructions about tasks (think aloud, speed, etc.)

Explanation:
Participants should feel safe, informed, and clear about expectations.

Question 5 (Select all that apply)

Reasons to create a written user test plan

• ✅ Knowing what you will measure

• ✅ Managing session time

• ✅ Piloting and refining the study

• ✅ Defining what “good” or “better” means

Explanation:
A test plan ensures clarity, consistency, and rigor.

Question 6 (Select all that apply)

What is missing from “General population” user description

• ✅ Inclusion and exclusion criteria

• ❌ Research roles

• ✅ Number of users needed

• ✅ Recruitment strategy

Explanation:
User descriptions must be specific and actionable.

Question 7 (Select all that apply)

Quantitative metrics in the ShareTable deployment

• ❌ Communication diaries

• ❌ Weekly interviews

• ✅ Pre- and post-deployment relationship quality questionnaires

• ❌ Automated sentiment analysis of video

Explanation:
Standardized questionnaires produce numeric, quantitative data.

Question 8 (Select all that apply)

Reasons to conduct field studies

• ✅ More realistic user experience

• ❌ Cheaper and easier than lab studies

• ✅ More authentic system use and comparison

• ✅ Addresses novelty effects

Explanation:
Field studies capture real-world behavior over time.

Question 9 (Select all that apply)

Reasons to use A/B testing

• ✅ Supports careful, incremental changes

• ✅ Quantifies design effectiveness scientifically

• ❌ Easy to conduct

• ❌ Reveals user intent

Explanation:
A/B testing measures what works, not why users behave as they do.

Question 10 (Select all that apply)

Correct statements about factorial design

• ✅ 2 × 2 × 3 = 12 conditions

• ❌ 2 × 2 = 8 conditions

• ❌ 2 × 2 × 2 = 4 conditions

• ✅ Definition of full factorial experiment

Explanation:
Number of conditions = product of factor levels.

Question 11 (Select all that apply)

Correct statements about log analysis

• ❌ Can tell people’s experience

• ✅ Limited to existing interactions

• ✅ Powerful for quantifying effectiveness and informing design

• ❌ Can tell people’s beliefs

Explanation:
Log analysis shows what users do, not what they think or feel.

🧾 Summary Table