my slides for the recent User Assistance conference in Edinburgh

1. practical user research
how to do it.
what to do with it.
leisa reichelt | disambiguity.com
ua conference europe 2008
http://www.flickr.com/photos/ms_abitibi/1462557669/

2. practical user research
how to do it.
what to do with it.
leisa reichelt | disambiguity.com
ua conference europe 2008
http://www.flickr.com/photos/ms_abitibi/1462557669/

3. http://www.yarr.org.uk/

4. How to talk like a pirate: Startin' Rules
• Double up on all your adjectives and you'll be bountifully
bombastic with your phrasing. Pirates never speak of quot;a
big shipquot;, they call it a quot;great, grand ship!quot; They never
say never, they say quot;No nay ne'er!quot;
• Drop all your quot;gquot;'s when you speak and you'll get words
like quot;rowin'quot;, quot;sailin'quot; and quot;fightin'quot;. Dropping all of your
quot;vquot;'s will get you words like quot;ne'erquot;, quot;e'erquot; and quot;o'erquot;.
• Instead of saying quot;I amquot;, sailors say, quot;I bequot;. Instead of
saying quot;You arequot;, sailors say, quot;You bequot;. Instead of saying,
quot;They arequot;, sailors say, quot;They bequot;. Ne'er speak in anythin'
but the present tense!
http://www.yarr.org.uk/

5. Hints & Tips
• If it be helpin', start yer sentence wi' a quot;Arr, me
hearty,quot; in a deep, throaty voice — ye'll find that
the rest be comin' much easier.
http://www.yarr.org.uk/

6. Pirate Vocabulary
•
Ahoy: Hey! , Avast: Stop! Aye: Yes
Aye, Aye!: I’ll get right on that
•
Grog: A pirate's favorite drink.
•
Lily-livered: faint o' heart
•
Loaded to the Gunwales (pron. gunnels): drunk
•
Matey: A shipmate or a friend.
•
Me hearty: a friend or shipmate.
•
Scallywag: A bad person. A scoundrel.
•
Scurvy dog!: a fine insult!
•
Shiver me timbers!: an exclamation of surprise, to be shouted
most loud.
•
Squiffy: a buffoon
•
Swashbucklin': fightin' and carousin' on the high seas!
•
Thar: The opposite of quot;here.quot;
•
Walk the plank: this one be bloody obvious.
•
Yo-ho-ho: Pirate laughter http://www.yarr.org.uk/

7. yo-ho-ho!
shiver me timbers

8. i love this hotel :)

9. i love this hotel :)
- six pillows!
- an ironing board
- a kettle for making tea ...

10. i love this hotel :)
- the door card <insert picture!>

12. good user experience doesn’t
have to be flashy

14. motorola razr

15. let them have user research!

17. http://www.flickr.com/photos/padday/1513526079

19. UA & UX
UX = User Experience

20. why do user research?

21. supposing is good. finding out is better.
- mark twain

22. 100x
After Launch
Cost of making changes
6x
1x During
During Development
Design
r.s pressman, ‘software engineering, a practitioners approach’ mcgraw-hill

23. we tend to project our own rationalisations and
beliefs onto the actions and beliefs of others
- don norman, the design of everyday things

24. to design an easy-to-use interface, pay attention to
what users do, not what they say.
self reported claims are unreliable, as are user
speculations about future behaviour
- jakob nielsen

25. http://www.flickr.com/photos/mugur/153914184/

26. user research helps you uncover, understand and
design for real user requirements

27. do I really need to do it?

28. do I really need to do it?
if:
a) your end users are just like you and/or
b) you’ve designed for these users before and know
them well

29. do I really need to do it?
if:
you find yourself resorting to stereotypes and
cliches (esp. involving your mother or
grandmother), you need to research.

30. when in a project to do
user research?

31. generative research
prototype
evaluative research

32. ways to do it

33. quantitative vs qualitative

34. quantitative vs qualitative
Quantitative research is the systematic scientific investigation of
quantitative properties and phenomena and their relationships.
The objective of quantitative research is to develop and employ
mathematical models, theories and/or hypotheses pertaining to
natural phenomena. The process of measurement is central to
quantitative research because it provides the fundamental
connection between empirical observation and mathematical
expression of quantitative relationships.
http://en.wikipedia.org/wiki/Quantitative_research

35. quantitative vs qualitative
Qualitative research ...aim(s) to gather an in-depth understanding
of human behavior and the reasons that govern human behavior.
Qualitative research relies on reasons behind various aspects of
behavior. Simply put, it investigates the why and how of decision
making, not just what, where, and when.
http://en.wikipedia.org/wiki/Qualitative_research

36. quantitative vs qualitative
mathematics and natural sciences
statistically sound, scientific
large random samples
questionnaires, surveys, tests

37. quantitative vs qualitative
social sciences
insight gathering, exploratory
small sample sizes
participatory, observational, interviews, analysis of documents
and materials.

38. quantitative & qualitative

39. qualitative for insight

40. speaking of ‘scientific’

41. speaking of ‘scientific’
don’t defend qualitative research ‘scientifically’
avoid using statistical terms or approaches
actually...
just stay away from numbers altogether!

42. In earlier research, Tom Landauer and I [Jakob Nielsen]
showed that the number of usability problems found in a
usability test with n users is:
N(1-(1-L)n)
where N is the total number of usability problems in the
design and L is the proportion of usability problems
discovered while testing a single user. The typical value of
L is 31%, averaged across a large number of projects we
studied. Plotting the curve for L=31% gives the following
result:

43. The most striking truth of the curve
is that zero users give zero insights.
http://www.useit.com/alertbox/20000319.html

44. ‘formal’ qual

45. lab based research

46. focus groups - care!

47. field research
(ethnography)

48. ‘guerrilla’ qual

49. silverbackapp.com

50. new research tools

51. search.twitter.com

52. flickr.com (groups)

53. drupal.org project
opensource research & design

59. recruitment
- aim for six participants per key user groups
- BUT remember that one is better than none!
- you can outsource this to qualitative research recruitment companies
- or use your networks (I use Facebook, LinkedIn and Twitter a lot!)

61. test materials / prototypes

63. interview technique

64. interview technique
> introduce the session
(esp. inform and ask permission re: recording)
> good rapport = good research
(take time to make it clear you care about their opinion)
> don’t tell them you’re the designer
(they’ll not want to hurt your feelings, they want to please)
> it’s not a test
(if anything is being tested,
it’s the design - NOT the participant)
> only *their* opinion counts
(we don’t care about what other people might think or do)
> define your research questions
> plan & practice the ‘script’

65. interview technique
> start as wide as possible, narrow slowly
> keep it contextual, not speculative
> show, don’t tell (observation = good)
(show me how you do that?)
> uncover mental models
(if you clicked there, what do you think would happen?)
> ask OPEN questions
(ask questions to get them talking NOT yes/no answers)
> take care not to lead
(you can have leading questions AND leading structures)
> never leave them hanging
(if they’re struggling, save them)

66. analysing research

67. research analysis (affinity sort)

68. solo analysis vs group analysis

69. presenting research

70. reports
research reports
http://www.flickr.com/photos/iheartcanada/497799011/

71. workshop findings

72. personas
personas
http://www.flickr.com/photos/anikarenina/550438755/

73. Appearance
- what it looks like and how it is arranged
Usability
Interaction
- how the user interacts with the product components
Information
- the information required by the user at different stages
User Structure
Experience - the right elements in the right order
Concept
- the model for how the value is delivered
Proposition
- the value to the customer

74. just because nobody complains
doesn’t mean all the parachutes are perfect
- benny hill
Library of Congress, Prints and Photographs Division,Washington, D.C. 20540 USA

75. thank you :)
leisa reichelt | disambiguity.com
leisa@disambiguity.com
http://www.flickr.com/photos/ms_abitibi/1462557669/