The research needed to create a flawless user experience is of greater importance than ever, but there remains a lot of confusion surrounding the process of usability testing.
If you haven’t already incorporated usability into your product design process, you might wonder why it is necessary. After all, it’s certainly possible to release a working, bug-free product without performing any usability work at all. But incorporating user-centered design principles can lead to a much-improved product in several areas.
Summary: UX teams are responsible for creating desirable experiences for users. Yet many organizations fail to include users in the development process. Without customer input, organizations risk creating interfaces that fail.
A website’s (or product’s) success depends on how users perceive it. Users assess the usefulness and ease of use of websites as they interact with them, forming their conclusions in seconds—sometimes milliseconds.
Augmented reality is exactly what the name implies — a medium through which the known world fuses with current technology to create a uniquely blended interactive experience. While still more or less a nascent entity in the frequently Luddite education industry, more and more teachers, researchers, and developers contribute their ideas and inventions towards the cause of more interactive learning environments. Many of these result in some of the most creative, engaging experiences imaginable, and as adherence grows, so too will students of all ages.
Much like a questionnaire — a topic covered in the last installment — an interview is for collecting subjective data. However, the face-to-face nature of an interview means that you can be more interactive in your data collection, which if done correctly, can lead to very rich data. However, it is also obviously quite time-consuming, and it is harder to analyze and quantify the data you get at the end.
The quality of what you get out of an interview will also depend greatly on your own skill as an interviewer, so here are some tips.
This article, and its forthcoming followup, is intended to give a rough idea to developers of several different methods that can be used in games user research.
However, many, many books have been written on research methodology and I cannot cover everything. Therefore these two articles cannot be taken as completely comprehensive.
In the first of the articles I will be covering a few general points about Games User Research and then discussing three methods, focus groups, heuristic evaluation and questionnaires in some detail.
Some people think that usability is very costly and complex and that user tests should be reserved for the rare web design project with a huge budget and a lavish time schedule. Not true. Elaborate usability tests are a waste of resources. The best results come from testing no more than 5 users and running as many small tests as you can afford.
In earlier research, Tom Landauer and I showed that the number of usability problems found in a usability test with n users is:
where N is the total number of usability problems in the design and L is the proportion of usability problems discovered while testing a single user. The typical value of L is 31%, averaged across a large number of projects we studied. Plotting the curve for L=31% gives the following result:
The most striking truth of the curve is that zero users give zero insights.
When Glenn Harrington donned a motion capture suit complete with more than 40 reflective spheres he wasn’t being turned into the latest video game character, but helping to design car manufacturing jobs that are less physically stressful on workers.
A critique of a common method used in video game usability research
Many video game usability practitioners employ a method to test usability within video games, called the ‘RITE’ method, short for Rapid Iterative Testing and Evaluation (RITE). Pioneered at Microsoft Games Studios and Microsoft Research, the RITE method has been adopted by many usability research organizations besides the teams at Microsoft.
While the RITE method has some advantages, such as the ‘rapid iterative’ ability to suggest changes to designers and test them in successive passes, it may fall short when looking for usability issues that lie beneath the surface.
From: Score One for Quality! Using Games to Improve Product Quality by Joshua Williams and Ross Smith Abstract:
In this paper we describe how using a game can improve both the quality of a product, but the quality of life of the employees as well. We call this kind of game a “Productivity Game.”