Easy and affordable user testing

A presentation at Confab Central 2018 in May 2018 in Minneapolis, MN, USA by Ida Aalen

Slide 1

Slide 1

Easy & affordable 
 user-te st ing Ida Aalen / @idaaa CPO, Confrere ida@confrere.com

Confab Central, May 2018

Slide 2

Slide 2

confrere.com/usertest

Slide 3

Slide 3

Task 1 Read the title and the intro. Write down 1-5 questions you expect will be answered on this page.

Slide 4

Slide 4

Task 2 Read the text. • Were your questions answered?
• Is there content that cut be cut or should be expanded?

Slide 5

Slide 5

#1 Micro-tes t ing content. • Time: 30 min+ • Price: Mostly free

Slide 6

Slide 6

Slide 7

Slide 7

Feedback on needs, not grammar and typos

Slide 8

Slide 8

Slide 9

Slide 9

Slide 10

Slide 10

• What equipment is supported?
• Can this service be used on mobile devices? • How can I know that it is safe? • What is the flow like, step by step, when setting up a call? • How much does it cost? • How do you embed/link this on your own site?

Slide 11

Slide 11

User te st ing can be 
 easy & affordable.

Slide 12

Slide 12

Slide 13

Slide 13

Slide 14

Slide 14

Slide 15

Slide 15

Slide 16

Slide 16

Do you recognise this icon? 
 
 Survey with 4273 respondents, 2014 Mobile: 53% 
 said no Desktop: 73% 
 said no

Slide 17

Slide 17

Colleagues 
 are not your users.

Slide 18

Slide 18

Designers 
 are not your users.

Slide 19

Slide 19

Content st rategi st s are not your users.

Slide 20

Slide 20

1 in 3 
 problems found 
 by experts are 
 false alarms 1 in 2 
 user problems 
 are overlooked 
 by experts

Slide 21

Slide 21

5

Slide 22

Slide 22

N (1-(1-L)n)

Slide 23

Slide 23

0% 25% 50% 75% 100% Number of test subjects 0 3 6 9 12 15 Share observed problems Small and frequent tests are better than bigger and infrequent tests

Slide 24

Slide 24

Slide 25

Slide 25

Slide 26

Slide 26

User te st ing is 
 real users solving real tasks.

Slide 27

Slide 27

Have you done 
 user te st ing?

Slide 28

Slide 28

What we want to find out: Is it clear to physicians that they can use Confrere for video appointments?

Slide 29

Slide 29

Our que st ion ≠ 
 User task

Slide 30

Slide 30

Open & explorative What would you do to find a video calling service that’s suitable for physicians? Specific & measurable Could you find the page which explains how Confrere is HIPAA compliant? Partially open Go to confrere.com.
What would you do to figure out whether this is suitable for physicians?

Slide 31

Slide 31

Open & explorative • If you want to find more problems • It’s ok to give different tasks to different people • More realistic, but also more time- consuming Specific & measurable • When you know there’s a problem, but you want to figure out why • Easier to measure and compare • Can be leading Partially open

Slide 32

Slide 32

5 techniques

Slide 33

Slide 33

#1 Microte st ing content. • Time: 30 min+ • Price: Free

Slide 34

Slide 34

#2 Information archite $ ure • Time: 30 min+ • Price: Free / $99-199 per month

Slide 35

Slide 35

Slide 36

Slide 36

Slide 37

Slide 37

Slide 38

Slide 38

Slide 39

Slide 39

Slide 40

Slide 40

#3 Get out. • Time: 1-4 hours • Price: Snacks

Slide 41

Slide 41

It’s this easy:

Slide 42

Slide 42

Slide 43

Slide 43

Slide 44

Slide 44

(Translated by Google)

Slide 45

Slide 45

#4 Lab te st on a budget. • Time: 1 day for planning and recruiting, 1 day for the actual test • Price: Rewarding users

Slide 46

Slide 46

(Translated by Google)

Slide 47

Slide 47

Slide 48

Slide 48

Slide 49

Slide 49

Slide 50

Slide 50

Slide 51

Slide 51

«Hugging»

Slide 52

Slide 52

Slide 53

Slide 53

If you need observers: Test machine Observation + Tool for 
 screen sharing +

Slide 54

Slide 54

Help the person think out loud

Slide 55

Slide 55

What are you thinking about?

Slide 56

Slide 56

I’m looking for the menu… Help the user think out loud and ask open questions

Slide 57

Slide 57

What happens if I click here? What do you think might happen if you click there? Make sure you’re not helping the user

Slide 58

Slide 58

How do you lead a tes t , without leading the user?

Slide 59

Slide 59

I’ve made the design for the new website and I’d love to hear what you think! The team who has designed the site need help figuring out if it’s really working.

Slide 60

Slide 60

You’re really good at this! You’re solving all the tasks! Thank you! Let’s move on 
 to the next task.

Slide 61

Slide 61

It would have gone so much faster if you had just clicked the menu-button. There’s really a big room for improvement here. Thank you for helping us identify this!

Slide 62

Slide 62

Sigh…

Slide 63

Slide 63

The user 
 is there to help you

Slide 64

Slide 64

Don’t li st en. Observe.

Slide 65

Slide 65

Rationalization 
 Michael S. Gazzaniga:
“The Interpreter” http://youtu.be/mJKloz2vwlc

Slide 66

Slide 66

Differentiate between… Observation What the person did and said during the task Interpretation Why you believe the person did what they did Improvements What you believe could be a solution to the problem

Slide 67

Slide 67

Example Observation • The user did not click the “Buy”-button Interpretations • The button should be placed elsewhere • The button has the wrong color or shape • The microcopy “buy” sounds too committing • The user didn’t think they really were supposed to “buy” since it’s just a test

Slide 68

Slide 68

#5 Was this helpful? • Time: 15 min+ • Price: Often free

Slide 69

Slide 69

Slide 70

Slide 70

Slide 71

Slide 71

Slide 72

Slide 72

Slide 73

Slide 73

Slide 74

Slide 74

Slide 75

Slide 75

5 methods: 1. Microtesting of content 2. Information architecture 3. Get out 4. Lab test on a budget 5. Was this helpful? confrere.com/ usertest

Slide 76

Slide 76

5 methods: 1. Microtesting of content 2. Information architecture 3. Get out 4. Lab test on a budget 5. Was this helpful? confrere.com/ usertest

Slide 77

Slide 77

You learn so much more meeting people face to face!

Slide 78

Slide 78

Thank you! Ida Aalen / @idaaa Chief Product Officer ida@confrere.com confrere.com/usertest