The most effective way of understanding what works and what doesn’t work in any user interface is to watch people use it.
When to conduct a usability test
- Any time you design something new, make modifications to an existing systems or build a prototype.
- When questions and assumptions formed during the project need verification.
- When you need to watch people interact with a new UI component.
- When you want to connect with your end user community (students, faculty, colleagues), so you can gather their feedback on your project, in a most constructive and focused way. Invite people who will most likely use or be impacted by the application, website, or service you are offering.
Overall we encourage usability testing early in the project stage so there is time and resources to address the test findings. Usability tests help build confidence, project support, and design direction. Attributes that are vital to all successful projects!
Observing a Usability Test
"Hmm. What are they doing? Why are they having difficulty? This is easy for me!"
The Collaborative UXO Usability Testing Process
-
1. Initial Meeting with Project Stakeholders
-
Your team meets with the UXO to:
- Establish a joint understanding of your goals for the prototype and how can the usability test be designed to address those goals.
- Conduct a walk through of the prototype and note any design elements that may need attention before presenting the prototype to your users for testing.
-
2. Test Logistics
-
- While the test script is being finalized, potential participants for the study are contacted by the stakeholders.
- We only need 3 - 5 participants, depending on the target audience, in order to successfully reveal usage patterns that will emerge during the test sessions.
- The sessions are conducted with one participant at the time.
- Final dates and times are set between the participant and the test facilitator (UXO).
-
3. Run Through
-
Conduct a quick run through to confirm that the facilitator and participant can successfully access to the prototype and to review any recent modifications.
-
4. Facilitate Sessions
-
Greet each participant in person at the Usability LAB or via Zoom call. Introduce each other and review what the usability test is all about.
Observe participants as they perform pre-identified tasks.
Conduct post session survey to gather more end-user feed back.
On average each session takes 30 minutes.
-
5. Final Meeting
-
After all the test sessions are complete, there is a debrief meeting with the project team to review the synthesized results of the study.
Depending on the study, there may be an update provided mid-study as needed or if something very unique or concerning may arise.
The team receives a written copy of the debrief report - which we try to keep brief - and actionable!
- A focus group
- An interview
- A quality acceptance test (QA) -- It is recommended to conduct tests early in stages of development to observe how well user flow and user expectations are supported in the interface
- About debugging the product (though bugs are often revealed during the test sessions).
- An opinion survey. We establish a comfortable rapport with the participant that allows meaningful feedback beyond casual remark: "Looks good to me!"
- A confirmation of your idea. We don’t force an issue or agenda. It is not our goal to prove anyone right or wrong – but rather to demonstrate how well the interface supports the user throughout all their steps on their task journey.
- It starts with a hello and a thank you! You will be greeted by a test facilitator either in person at the LAB or through a Zoom session.
- Introductions. We get to know each other and gain familiarity with the session format.
- Perform familiar tasks. A few key tasks for engaging with the interface have been designed before the session. We observe how straightforward and easy it is for you to complete these tasks with the new interface. You are the expert here - and if the task proves difficult to complete - that is a poor reflection of the interface - NOT YOU!
- Post-test: Answer a few survey type questions about your experience with the prototype and offer any additional comments.
We really appreciate your time and frank input! It is very useful for the design and development process!