[IxDA Discuss] Remote usability testing and participant feedback

[Barbara Ballard]

On 2/27/07, Jeff Axup <axup at userdesign.com> wrote:
> It's been a while since I heard anything about the remote-usability testing
> movement...
>
> Also, I'd also be interested in knowing more about how site usage analysis
> is being done and how designers of applications (as opposed to web-sites)
> are getting and using remote quantitative usage data.

We've developed a methodology that we're going to convert into a
product; it is outlined on pages 175-6 of my new book, Designing the
Mobile User Experience.  Basically, if your application has any server
component at all, you be sure to have a rich log of events on the
server.  When an event of interest happens, you send a SMS to the
phone number of the (registered) user. You can take a quick SMS
survey, or use a callback number to take the survey via VoiceXML.

Obviously this methodology works for beta testing scenarios, and is
not for traditional usability testing.  On the other hand, it enables
an incredible array of real-use information, including usage patterns
over time and subsequent perceived usability.

There are tricks to the method, most especially restricting the
frequency with which you bother the user.


-- 
Barbara Ballard
barbara at littlespringsdesign.com 1-785-838-3003