[IxDA Discuss] Testing usability of mobile applications

[Barbara Ballard]

On 12/4/06, Anu Leponiemi <anu at lepo.net> wrote:
> I'm planning on usability-testing a S40 application, and would like
> to hear about the ways you tend to test usability of mobile
> applications. Paper prototype is always an option, however, is that
> all you do, or do you test with real devices? If so, do you capture
> the input some ways, possibly with a software or a camera, or do you
> just watch the user use his mobile?
>

I recommend avoiding simulators and emulators, and restricting
yourself  to paper prototypes and on-device code.  Of course, each of
these reveals different issues.

Right now, there is no reliable way (across multiple devices, S40 may
be a single-platform exception) to capture user input on the device.
When such a method becomes available, test it carefully to ensure that
it does not adversely affect device performance.

A couple years ago, I posted an overview of mobile usability testing
on my site:
http://www.littlespringsdesign.com/analysis/utest/

The information is still valid, but we will be updating it soon.

We built a sled to hold the device and a camera focusing on the
device, then used a mounted camera to capture the user's facial and
body expressions.  This left our video tech/photographer in the room,
who could now capture telling still shots as well.  This has been
working quite well.


-- 
Barbara Ballard
barbara at littlespringsdesign.com 1-785-838-3003