Usability testing

A presentation at Sevenoaks Web Scene in September 2019 in Sevenoaks, UK by Calum Ryan

Slide 1

Slide 1

#usabilitytesting @calum_ryan Usability testing Effective user research to make the web more usable for more people Sevenoaks Web Scene / September 3rd 2019

Slide 2

Slide 2

#usabilitytesting @calum_ryan ? Why usability testing? Sevenoaks Web Scene / September 3rd 2019

Slide 3

Slide 3

#usabilitytesting @calum_ryan We make assumptions Sevenoaks Web Scene / September 3rd 2019

Slide 4

Slide 4

#usabilitytesting @calum_ryan ‣ Our users have the latest devices/software ‣ Our users don’t have any disabilities ‣ Our users should already know how to do that Making too many assumptions ‣ Our product isn’t that widely used to matter ‣ Previous products/approach worked fine Sevenoaks Web Scene / September 3rd 2019

Slide 5

Slide 5

#usabilitytesting @calum_ryan ‣ We build features people don’t need or hardly ever use Outcomes of not doing usability testing ‣ We may fail to consider different use cases, challenges/constraints ‣ Potentially break the law, get sued, bad press and reputation ‣ We turn people away to alternatives/the competition Sevenoaks Web Scene / September 3rd 2019

Slide 6

Slide 6

#usabilitytesting @calum_ryan Usability testing / research Sevenoaks Web Scene / September 3rd 2019

Slide 7

Slide 7

#usabilitytesting @calum_ryan We’re testing the website/product. Not the user Sevenoaks Web Scene / September 3rd 2019

Slide 8

Slide 8

#usabilitytesting @calum_ryan “The goal is to determine to what extent the product or service as designed is usable” Erika Hall Just Enough Research | A Book Apart Sevenoaks Web Scene / September 3rd 2019

Slide 9

Slide 9

#usabilitytesting @calum_ryan Measuring usability Sevenoaks Web Scene / September 3rd 2019

Slide 10

Slide 10

#usabilitytesting @calum_ryan ‣ Learnability 5 components of usability ‣ Efficiency Nielsen Norman Group ‣ Memorability nngroup.com/articles/usability-101-introduction-to-usability ‣ Errors ‣ Satisfaction Sevenoaks Web Scene / September 3rd 2019

Slide 11

Slide 11

#usabilitytesting @calum_ryan Learnability Do I need to consult documentation to use your website? Sevenoaks Web Scene / September 3rd 2019

Slide 12

Slide 12

#usabilitytesting @calum_ryan Efficiency I have a 100-odd other tasks to do today. Will this take long? Sevenoaks Web Scene / September 3rd 2019

Slide 13

Slide 13

#usabilitytesting @calum_ryan Memorability This website isn’t how I remember it. How do I do that again? Sevenoaks Web Scene / September 3rd 2019

Slide 14

Slide 14

#usabilitytesting @calum_ryan Errors Users struggle to find X resource. How can we make X easier to locate? Sevenoaks Web Scene / September 3rd 2019

Slide 15

Slide 15

#usabilitytesting @calum_ryan Satisfaction Is the website accessible and somewhere you’d happily visit again? Sevenoaks Web Scene / September 3rd 2019

Slide 16

Slide 16

#usabilitytesting @calum_ryan ‣ Explorative ‣ Comparative Methods of user testing ‣ Thinking aloud Consider one or more different approaches to user testing ‣ Remote ‣ Hallway ‣ Assessment ‣ Review-based Sevenoaks Web Scene / September 3rd 2019

Slide 17

Slide 17

#usabilitytesting @calum_ryan Explorative ‣ Ideally performed by experienced testers ‣ Evaluate new or initial design ideas ‣ Iterative tests, defines future tests ‣ Test sessions are defined by goals

Slide 18

Slide 18

#usabilitytesting @calum_ryan Comparative ‣ Two or more design variations ‣ Rate positives/negatives in user experience ‣ Typically A/B testing ‣ Combine best features

Slide 19

Slide 19

#usabilitytesting @calum_ryan Thinking aloud ‣ Typically a series of pre-defined tasks ‣ Participant describes what they’re doing ‣ Gather feedback as they progress (or struggle) to complete the task

Slide 20

Slide 20

#usabilitytesting @calum_ryan Remote ‣ Synchronous testing Real-time user testing via video link or remote sharing tools ‣ Asynchronous testing Automated/prescribed tests the user may choose to do in their own time and in their own environment

Slide 21

Slide 21

usertesting.com Sevenoaks Web Scene / September 3rd 2019

Slide 22

Slide 22

#usabilitytesting @calum_ryan Hallway ‣ Testing done in high footfall public places ‣ Voluntary participation random individuals ‣ Quick, low-cost way to get feedback

Slide 23

Slide 23

#usabilitytesting @calum_ryan Assessment ‣ Testing of a prototype ahead of production ‣ Real-time monitoring often from another room ‣ Progress and reactions to series of tests

Slide 24

Slide 24

#usabilitytesting @calum_ryan Review-based ‣ Typically tested by experienced testers ‣ Pre-defined tests, often using automated tools ‣ Deep interrogation tests pre-production

Slide 25

Slide 25

#usabilitytesting @calum_ryan Rating the problems Rate each problem users encountered during the tests with a common scoring system Fails to complete task Completes with difficulty Minor problem High Severity Moderate Low 30% of participants Frequency 11-29% 10%

Slide 26

Slide 26

#usabilitytesting @calum_ryan Participants Sevenoaks Web Scene / September 3rd 2019

Slide 27

Slide 27

#usabilitytesting @calum_ryan Find the right participants and treat them well Sevenoaks Web Scene / September 3rd 2019

Slide 28

Slide 28

#usabilitytesting @calum_ryan Aim for 5-10 participants and usability tests Sevenoaks Web Scene / September 3rd 2019

Slide 29

Slide 29

#usabilitytesting @calum_ryan Avoid using your own team as participants Sevenoaks Web Scene / September 3rd 2019

Slide 30

Slide 30

#usabilitytesting @calum_ryan Testing for accessibility ‣ Get representative users ‣ Choose participants with a range of different disabilities and combinations of disabilities ‣ Allow users to test with their own aids such as screen readers, devices or other assistive tech ‣ If required to attend in-person, check the venue and transport to there is accessible

Slide 31

Slide 31

#usabilitytesting @calum_ryan ‣ Go to where the people are Testing environment ‣ Have separate rooms for the participants and observers with good quality mics and network connections ‣ Choose a comfortable space: a relaxed, home-like environment away from distractions and lab-like conditions ‣ Encourage honest feedback

Slide 32

Slide 32

#usabilitytesting @calum_ryan ‣ Get to know your participants and build a rapport What to ask ? ‣ Profile them and their web usage habits ‣ Have scenarios to work through ‣ How would you do…? ‣ What do you make of this? ‣ What would you do here?

Slide 33

Slide 33

Usability Demo https://youtu.be/QckIzHC99Xc

Slide 34

Slide 34

#usabilitytesting @calum_ryan Handling feedback ‣ Choose a good facilitator ‣ Friendly but neutral ‣ Encourage honest feedback ‣ Acknowledge problems/failures positively ‣ Be confidential and protect user data

Slide 35

Slide 35

#usabilitytesting @calum_ryan Guerrilla usability testing Sevenoaks Web Scene / September 3rd 2019

Slide 36

Slide 36

#usabilitytesting @calum_ryan “help the participant visualise the future product clearly enough to give useful feedback on whether they can achieve their goals” Jamie Levy Chapter 8 | UX Strategy | O’Reilly Sevenoaks Web Scene / September 3rd 2019

Slide 37

Slide 37

#usabilitytesting @calum_ryan ‣ Validated research conducted in a short space of time on a small budget ‣ Small, structured experiments with a prototype and 5-10 participants ‣ Typically done at a coffee shop with good WiFi, power sockets, not too busy and acceptable to stay for the day ‣ 1 participant, 1 interviewer, 1 note taker

Slide 38

Slide 38

#usabilitytesting @calum_ryan The Art of Guerrilla Usability Testing David Peter Simon https://uxbooth.com/articles/the-art-of-guerrilla-usability-testing Sevenoaks Web Scene / September 3rd 2019

Slide 39

Slide 39

#usabilitytesting @calum_ryan Final thoughts Sevenoaks Web Scene / September 3rd 2019

Slide 40

Slide 40

#usabilitytesting @calum_ryan ‣ Provide a breakthrough design ‣ Guarantee a successful product in the marketplace What usability testing isn’t going to do ‣ Prepare you for every single scenario or use case ‣ Substitute for QA testing (but can help define QA tests)

Slide 41

Slide 41

#usabilitytesting @calum_ryan Be open about your usability testing. Share your findings Sevenoaks Web Scene / September 3rd 2019

Slide 42

Slide 42

#usabilitytesting @calum_ryan ‣ Difficult to use and overwhelming forms ‣ Links and resources aren’t highlighted Some typical feedback from usability testing ‣ Challenging/hidden navigation menus ‣ Content isn’t presented or tailored for different audiences Sevenoaks Web Scene / September 3rd 2019

Slide 43

Slide 43

#usabilitytesting @calum_ryan “approach usability testing with the right expectations and conduct it early and often” Erika Hall Just Enough Research | A Book Apart Sevenoaks Web Scene / September 3rd 2019

Slide 44

Slide 44

@calum_ryan calumryan.com thank you noti.st/calumryan Sevenoaks Web Scene / September 3rd 2019