Usability Testing Might Just Save Your Bacon – and Your Brand

Well, it happened again – the same thing that happens every time any digital product is put through usability testing. We found out that the people designing the thing (people who know exactly what it’s supposed to do and how it’s supposed to work) are not the same as the people actually using the thing. And the people who are supposed to use the thing don’t get it. And because they don’t get it, they have three options for how they might respond.

Read More

Windows 8 — Disappointing Usability for Both Novice and Power Users

Summary: Hidden features, reduced discoverability, cognitive overhead from dual environments, and reduced power from a single-window UI and low information density. Too bad.

With the recent launch of Windows 8 and the Surface tablets, Microsoft has reversed its user interface strategy. From a traditional Gates-driven GUI style that emphasized powerful commands to the point of featuritis, Microsoft has gone soft and now smothers usability with big colorful tiles while hiding needed features.

Read More

Finding Out What They Think: A Rough Primer To User Research, Part 1

[In this first article in a new series, college professor and user research Ben Lewis-Evans takes a look at different methods of game user research, offering up a handy guide to different ways you can collect useful information about your game.]

This article, and its forthcoming followup, is intended to give a rough idea to developers of several different methods that can be used in games user research.

However, many, many books have been written on research methodology and I cannot cover everything. Therefore these two articles cannot be taken as completely comprehensive.

In the first of the articles I will be covering a few general points about Games User Research and then discussing three methods, focus groups, heuristic evaluation and questionnaires in some detail.

Read More

Are Your Users S.T.U.P.I.D?

How good design can make users effective

dunce-200It is an honest question: how smart are your users? The answer may surprise you: it doesn’t matter. They can be geniuses or morons, but if you don’t engage their intelligence, you can’t depend on their brain power.

Far more important than their IQ (which is a questionable measure in any case) is their Effective Intelligence: the fraction of their intelligence they can (or are motivated to) apply to a task.

Take, for example, a good driver. They are a worse driver when texting or when drunk. (We don’t want to think about the drunk driver who is texting.) An extreme example you say? Perhaps, but only by degree. A person who wins a game of Scrabble one evening may be late for work because they forgot to set their alarm clock. How could the same person make such a dumb mistake? Call it concentration, or focus, we use more of our brain when engaged and need support when we are distracted.

Read More

Kinect Gestural UI: First Impressions

Read the manual before using the interface. (Kinect Adventures)
(Yes, it’s a *cute* manual, but these are still instructions to memorize.)

Summary: Inconsistent gestures, invisible commands, overlooked warnings, awkward dialog confirmations. But fun to play.

Kinect is a new video game system that is fully controlled by bodily movements. It’s vaguely similar to the Wii, but doesn’t use a controller (and doesn’t have the associated risk of banging up your living room if you lose your grip on the Wii wand during an aggressive tennis swing).

Read More

Why You Only Need to Test with 5 Users

Some people think that usability is very costly and complex and that user tests should be reserved for the rare web design project with a huge budget and a lavish time schedule. Not true. Elaborate usability tests are a waste of resources. The best results come from testing no more than 5 users and running as many small tests as you can afford.

In earlier research, Tom Landauer and I showed that the number of usability problems found in a usability test with n users is:

N(1-(1-L)n)

where N is the total number of usability problems in the design and L is the proportion of usability problems discovered while testing a single user. The typical value of L is 31%, averaged across a large number of projects we studied. Plotting the curve for L=31% gives the following result:

The most striking truth of the curve is that zero users give zero insights.

Read More

Castlevania: Good Usability, Poor User Experience

Konami recently sent us a copy of their new title, Castlevania: Lords of Shadow. After testing the game, it was clear that the game could be a case study to highlight the difference between usability and user-experience (UX).

Read More

What’s Wrong With the RITE Method?

A critique of a common method used in video game usability research

Many video game usability practitioners employ a method to test usability within video games, called the ‘RITE’ method, short for Rapid Iterative Testing and Evaluation (RITE). Pioneered at Microsoft Games Studios and Microsoft Research, the RITE method has been adopted by many usability research organizations besides the teams at Microsoft.

While the RITE method has some advantages, such as the ‘rapid iterative’ ability to suggest changes to designers and test them in successive passes, it may fall short when looking for usability issues that lie beneath the surface.

Read More
Back To Top
Search