Sponsored By

Biometrics, Game Evaluation and UX: Approach with caution

Using biometrics for psychophysiological evaluation is becoming a popular approach in game user research. While results of this work can look stunning, experimental control is important if you want to interpret your data in a way that is robust.

Lennart Nacke, Blogger

June 24, 2011

2 Min Read
Game Developer logo in a gray background | Game Developer

My colleague Steve Fairclough recently posted an article on PhysiologicalComputing.net in which he discusses the potential pitfalls of biometric research and how it is currently being sold to the game industry. I will present some of his ideas here.

Steve outlines that "psychophysiological methods are combined with computer games in two types of context: applied psychology research and game evaluation in a commercial context.  With respect to the former, a researcher may use a computer game as a platform to study a psychological concept, such as effects of game play on aggression or how playing against a friend or a stranger influences the experience of the player."

Similar to Mike Ambinder's presentation of user research and game design at Valve (PDF), he makes the point that games in this context are analysed using principles of experimental psychology.

They are used as tasks or virtual worlds within which a research can study the behavior of players (you might recall John Hopson's Gamasutra article on behavioral game design).

He characterises the experimental psychology approach by 4 features:

  1. Comparing controlled conditions

  2. Importance of statistical power (large N)

  3. Controlled participant sample

  4. Counterbalanced design (removing order effects)

He makes a point about the sensitivity of physiological data as being volatile, variable and difficult to interpret without a high level of experimental control. He warns that the use of think aloud protocol might influence the physiological data being recorded because it influences heart rate and respiration considerably.

He also warns about the oversimplification regarding the interpretation of physiological data (something I have seen way too often), regarding its one-to-many relationship to psychological impact.

For example, galvanic skin response is used too often to infer emotional qualities although it is a highly ambiguous measure regarding emotional labels.

Steve closes with a discussion of the question of how to make physiological data and experimentation valuable to the game industry. Meaning, what questions can we answer with this type of data that the game industry does not already know?

(Please read Steve's original post here, too)

Read more about:

Featured Blogs
Daily news, dev blogs, and stories from Game Developer straight to your inbox

You May Also Like