A presentation at Front End Kent in in Royal Tunbridge Wells, Tunbridge Wells, UK by Calum Ryan
#usabilitytesting @calum_ryan Usability testing Effective user research to make the web more usable for more people Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan ? Why usability testing? Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan We make assumptions Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan ‣ Our users have the latest devices/software ‣ Our users don’t have any disabilities ‣ Our users should already know how to do that Making too many assumptions ‣ Our product isn’t that widely used to matter ‣ Previous products/approach worked fine Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan ‣ We build features people don’t need or hardly ever use Outcomes of not doing usability testing ‣ We may fail to consider different use cases, challenges/constraints ‣ Potentially break the law, get sued, bad press and reputation ‣ We turn people away to alternatives/the competition Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan Usability testing / research Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan We’re testing the website/product. Not the user Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan “The goal is to determine to what extent the product or service as designed is usable” Erika Hall Just Enough Research | A Book Apart Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan Measuring usability Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan ‣ Learnability 5 components of usability ‣ Efficiency Nielsen Norman Group ‣ Memorability nngroup.com/articles/usability-101-introduction-to-usability ‣ Errors ‣ Satisfaction Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan Learnability Do I need to consult documentation to use your website? Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan Efficiency I have a 100-odd other tasks to do today. Will this take long? Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan Memorability This website isn’t how I remember it. How do I do that again? Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan Errors Users struggle to find X resource. How can we make X easier to locate? Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan Satisfaction Is the website accessible and somewhere you’d happily visit again? Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan ‣ Explorative ‣ Comparative Methods of user testing ‣ Thinking aloud Consider one or more different approaches to user testing ‣ Remote ‣ Hallway ‣ Assessment ‣ Review-based Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan Explorative ‣ Ideally performed by experienced testers ‣ Evaluate new or initial design ideas ‣ Iterative tests, defines future tests ‣ Test sessions are defined by goals
#usabilitytesting @calum_ryan Comparative ‣ Two or more design variations ‣ Rate positives/negatives in user experience ‣ Typically A/B testing ‣ Combine best features
#usabilitytesting @calum_ryan Thinking aloud ‣ Typically a series of pre-defined tasks ‣ Participant describes what they’re doing ‣ Gather feedback as they progress (or struggle) to complete the task
#usabilitytesting @calum_ryan Remote ‣ Synchronous testing Real-time user testing via video link or remote sharing tools ‣ Asynchronous testing Automated/prescribed tests the user may choose to do in their own time and in their own environment
usertesting.com Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan Hallway ‣ Testing done in high footfall public places ‣ Voluntary participation random individuals ‣ Quick, low-cost way to get feedback
#usabilitytesting @calum_ryan Assessment ‣ Testing of a prototype ahead of production ‣ Real-time monitoring often from another room ‣ Progress and reactions to series of tests
#usabilitytesting @calum_ryan Review-based ‣ Typically tested by experienced testers ‣ Pre-defined tests, often using automated tools ‣ Deep interrogation tests pre-production
#usabilitytesting @calum_ryan Rating the problems Rate each problem users encountered during the tests with a common scoring system Fails to complete task Completes with difficulty Minor problem High Severity Moderate Low 30% of participants Frequency 11-29% 10%
#usabilitytesting @calum_ryan Participants Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan Find the right participants and treat them well Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan Aim for 5-10 participants and usability tests Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan Avoid using your own team as participants Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan Testing for accessibility ‣ Get representative users ‣ Choose participants with a range of different disabilities and combinations of disabilities ‣ Allow users to test with their own aids such as screen readers, devices or other assistive tech ‣ If required to attend in-person, check the venue and transport to there is accessible
#usabilitytesting @calum_ryan ‣ Go to where the people are Testing environment ‣ Have separate rooms for the participants and observers with good quality mics and network connections ‣ Choose a comfortable space: a relaxed, home-like environment away from distractions and lab-like conditions ‣ Encourage honest feedback
#usabilitytesting @calum_ryan ‣ Get to know your participants and build a rapport What to ask ? ‣ Profile them and their web usage habits ‣ Have scenarios to work through ‣ How would you do…? ‣ What do you make of this? ‣ What would you do here?
Usability Demo https://youtu.be/QckIzHC99Xc
#usabilitytesting @calum_ryan Handling feedback ‣ Choose a good facilitator ‣ Friendly but neutral ‣ Encourage honest feedback ‣ Acknowledge problems/failures positively ‣ Be confidential and protect user data
#usabilitytesting @calum_ryan Guerrilla usability testing Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan “help the participant visualise the future product clearly enough to give useful feedback on whether they can achieve their goals” Jamie Levy Chapter 8 | UX Strategy | O’Reilly Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan ‣ Validated research conducted in a short space of time on a small budget ‣ Small, structured experiments with a prototype and 5-10 participants ‣ Typically done at a coffee shop with good WiFi, power sockets, not too busy and acceptable to stay for the day ‣ 1 participant, 1 interviewer, 1 note taker
#usabilitytesting @calum_ryan The Art of Guerrilla Usability Testing David Peter Simon https://uxbooth.com/articles/the-art-of-guerrilla-usability-testing Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan Final thoughts Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan ‣ Provide a breakthrough design ‣ Guarantee a successful product in the marketplace What usability testing isn’t going to do ‣ Prepare you for every single scenario or use case ‣ Substitute for QA testing (but can help define QA tests)
#usabilitytesting @calum_ryan Be open about your usability testing. Share your findings Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan ‣ Difficult to use and overwhelming forms ‣ Links and resources aren’t highlighted Some typical feedback from usability testing ‣ Challenging/hidden navigation menus ‣ Content isn’t presented or tailored for different audiences Front End Kent / June 11th 2019
#usabilitytesting @calum_ryan “approach usability testing with the right expectations and conduct it early and often” Erika Hall Just Enough Research | A Book Apart Front End Kent / June 11th 2019
@calum_ryan calumryan.com thank you noti.st/calumryan Front End Kent / June 11th 2019
Testing usability of a digital product takes on a wide variety of test types and feedback processes that I will elaborate on in this talk. Designers, developers, product owners and anyone with a vested interested should all partake in this process, from defining the tests to measuring the success and failures of different usability testing.
The following resources were mentioned during the presentation or are useful additional information.
Inspiration by this talk helped plan my own presention on this subject. Alice Bartlett takes a look at specific challenges faced when developing and testing interface for many different users.
Here’s what was said about this presentation on social media.
for free. You
can too.