Situated Research's Blog

Posts Tagged ‘User Groups’

Accuracy vs. Insights in Quantitative Usability

November 30th, 2011

Summary: Better to accept a wider margin of error in usability metrics than to spend the entire budget learning too few things with extreme precision.

Last week, I made a slide for the new User Experience (UX) Basic Training course with the recommended number of test users for different types of studies. I like teaching foundational courses because they afford me just this kind of opportunity — to distill 25 years of usability process research into a single table. Patterns crystallize when complex topics are condensed to the essence. Read more »

Why You Only Need to Test with 5 Users

November 15th, 2010

Some people think that usability is very costly and complex and that user tests should be reserved for the rare web design project with a huge budget and a lavish time schedule. Not true. Elaborate usability tests are a waste of resources. The best results come from testing no more than 5 users and running as many small tests as you can afford.

In earlier research, Tom Landauer and I showed that the number of usability problems found in a usability test with n users is:

N(1-(1-L)n)

where N is the total number of usability problems in the design and L is the proportion of usability problems discovered while testing a single user. The typical value of L is 31%, averaged across a large number of projects we studied. Plotting the curve for L=31% gives the following result:

20000319 user testing diminshing returns curve Why You Only Need to Test with 5 Users

The most striking truth of the curve is that zero users give zero insights. Read more »

Ford Ergonomics Lab: Optimized by Gaming Technology

May 27th, 2010

Ford Ford Ergonomics Lab: Optimized by Gaming Technology

When Glenn Harrington donned a motion capture suit complete with more than 40 reflective spheres he wasn’t being turned into the latest video game character, but helping to design car manufacturing jobs that are less physically stressful on workers. Read more »

What’s Wrong With the RITE Method?

April 30th, 2010

A critique of a common method used in video game usability research

Many video game usability practitioners employ a method to test usability within video games, called the ‘RITE’ method, short for Rapid Iterative Testing and Evaluation (RITE). Pioneered at Microsoft Games Studios and Microsoft Research, the RITE method has been adopted by many usability research organizations besides the teams at Microsoft.

While the RITE method has some advantages, such as the ‘rapid iterative’ ability to suggest changes to designers and test them in successive passes, it may fall short when looking for usability issues that lie beneath the surface. Read more »

Using Serious Games to Boost Quality & Productivity at Microsoft

January 12th, 2010

From: Score One for Quality! Using Games to Improve Product Quality
by Joshua Williams and Ross Smith

Abstract:

In this paper we describe how using a game can improve both the quality of a product, but the quality of life of the employees as well. We call this kind of game a “Productivity Game.” Read more »

Why You Should Outsource Usability Testing

November 23rd, 2009

Small companies should consider outsourcing the facilitation of their usability testing projects. On the surface, it makes sense to have a designer/developer who has a deep understanding of the project be in charge of usability testing, but in fact this can cause serious problems. Read more »

7/23 Webinar: Interaction Design: Designing Interactive Products to Support People in their Everyday Lives

July 24th, 2009

Thank you for attending today’s webinar. Usually I would post questions here but we didn’t have any today. So instead I will be posting our contact information as I could not show this slide in today’s webinar. If you would like to watch a recording of the webinar, please visit: http://www.situatedresearch.com/webinars/recordings.php Read more »

Get Our Newsletter
Stay updated on free webinars, news, and special offers (view past newsletters)