User research with older populations

A presentation at Research Huddle with Babylon Health in January 2022 in by Rik Williams

Slide 1

Slide 1

User research with older populations a a f a a a a Rik Willi ms, UX Architect, Moor ields Eye Hospit l rikwilli ms.net/t lks/user-rese rch-older-popul tions/

Slide 2

Slide 2

ff How ageing a ects us, why it’s important and actionable tips for running inclusive user research with older people.

Slide 3

Slide 3

rikwilliams.net/articles/older-people-tips-guidelines/

Slide 4

Slide 4

Structure Wh t we’ll cover in this session… Who’s talking? Why it’s important? When do people become ‘old’? How does ageing affect people? Practical tips for user research with older populations a Discussion

Slide 5

Slide 5

Hi, I’m Rik

Slide 6

Slide 6

Content context …or where these insights re weighted Moderated research In-person research “Older people” sometimes living with age-related disease(s) I’ve excluded insights speci c to research people with dementia(s) a • • fi • • •

Slide 7

Slide 7

Why research with older people is important

Slide 8

Slide 8

“It’s easy for our teams to be tribal and for the customer to be [or to become] a stranger” Gerry McGovern

Slide 9

Slide 9

74% of UXPA members re between 26 nd 45 a a Source: Salary Survey, User Experience Professionals’ Association International, 2018

Slide 10

Slide 10

Don Norman, 86 Source: Salary Survey, User Experience Professionals’ Association International, 2018

Slide 11

Slide 11

“When you include the extremes of everybody, that’s to say di erently abled people of all sorts, then you produce things that are better for all of us.” ff a Miche l Wolff

Slide 12

Slide 12

When do people become ‘old’?

Slide 13

Slide 13

Slide 14

Slide 14

“At what age is a person ‘old’?” 🤔

Slide 15

Slide 15

“Ageing is a lifelong process, starting when we are born” Jeff Johnson

Slide 16

Slide 16

“Old is at least 10 years older than I am now!” a Ad ge, Anon.

Slide 17

Slide 17

Responders Age When they think ‘old age’ starts 40s 63 50s 68 60s 73 70s 75 Source: You’re old, I’m not: how Americans really feel about ageing. AARP, 2014

Slide 18

Slide 18

50+ a f a A good st rting point for de ining ‘older-hood’ for user rese rch purposes

Slide 19

Slide 19

Slide 20

Slide 20

70+ a a Where user rese rch with older people gets re lly interesting

Slide 21

Slide 21

fi Source: Quanti cation of biological ageing in young adults, PNAS, 2015

Slide 22

Slide 22

ff How does ageing a ect people?

Slide 23

Slide 23

Beliefs and Behaviours fi Beyond an older person’s perception of their age, there are two general things which can be more common in digital user research: fear and con dence.

Slide 24

Slide 24

A person in their mid/late 70s, recruited directly from a production digital service, in an interaction lab

Slide 25

Slide 25

Beliefs and Behaviours T kew ys Fear of making errors, appearing naïve or breaking something Concerns about privacy and data use Low con dence and task abandonment rate (x2 younger people) Longer sessions (time needed, re-checking, taking less e cient routes) ffi fi Modifying facilitation style (capabilities vs research objectives) a a • • • • •

Slide 26

Slide 26

Motor control fi As we age, our ability to manipulate things with our arms, hands, and ngers tends to decline. Then add in disease(s), or the impact of drugs.

Slide 27

Slide 27

A participant in their mid 70s with mild arthritis working a complex touch interface during contextual research.

Slide 28

Slide 28

Hearing ft Loss of hearing also accelerates as people enter their 50s (and is the second most common agerelated impairment a er arthritis).

Slide 29

Slide 29

A participant in their early 70s living with front0-temporal dementia AND with hearing loss.

Slide 30

Slide 30

Paired participants in their mid-50s / late-70s evaluating aspects of a content strategy elsewhere in the room.

Slide 31

Slide 31

Hearing T kew ys Plan for hearing impairments during aural screening and research Factor for and avoid noisy research environments (cafes, group-based research) a a • •

Slide 32

Slide 32

33% a a a a a a of people ged 60-65 will h ve problems with norm l ur l communic tion…

Slide 33

Slide 33

…rising to… 89% a …by ge 80

Slide 34

Slide 34

Vision Eyesight tends to get worse as people age, even without the impact of injury or disease. Expect to encounter issues with seeing ne detail, focussing on nearby objects and the impact of glare*. fi *very much not an exhaustive list!

Slide 35

Slide 35

A participant in their early 60s with corrected vision (glasses) encountering issues with glare, acuity and presbyopia.

Slide 36

Slide 36

Mean visual acuity as a function of age Owsley et al. 1983

Slide 37

Slide 37

Cognition Most cognitive abilities decline with age, starting as early as our 30s. However, people vary enormously as to which abilities, when the decline starts and a what rate.

Slide 38

Slide 38

A person in their late-70s in an interaction lab who experienced issues with mixed/mild age-related cognitive decline.

Slide 39

Slide 39

Practical tips for user research with older people

Slide 40

Slide 40

Structure Wh t we’ll cover in this section… Screening older people Scheduling with older people During research time a Closing the user research

Slide 41

Slide 41

fi These guidelines seek to balance aspects of best practice for any inclusive user research with areas more speci c and frequent in older people

Slide 42

Slide 42

ft This advice is more likely to apply more o en than with younger participants (but not always)

Slide 43

Slide 43

In-person only Remote only

Slide 44

Slide 44

Screening older people

Slide 45

Slide 45

Avoid cold calling fi If you’re recruiting from a database of participants then consider initiating contact for your study by message, rst.

Slide 46

Slide 46

Immediate credibility, legitimacy Older people can be especially sensitive about contact by strangers. Be meticulous in your content/design.

Slide 47

Slide 47

Immediate credibility, legitimacy Pr ctic l tips Ensure a clear, well formed/optimised, lede or subject line Truly personalise content to the participant Use o cial account(s) for contact Include logo, physical address, registrations (beyond corporate style guidelines) Provide clear opt-outs (action, process) If proposing days/times for screening proper — stick to them a ffi a • • • • • •

Slide 48

Slide 48

Be more lexible in your methods of contact f Remember that older people are more likely to live with a disability than the general population.

Slide 49

Slide 49

80% of dis bility is cquired AND t n ver ge ge of 53 a a a a a a a Business Disability Forum at a11yLDN monthly meet-up, 2018

Slide 50

Slide 50

Factor for digital literacy Evaluate participant digital literacy, but expect false perceptions about their suitability.

Slide 51

Slide 51

Comp red to extensive users of digit l, limited users re… 8x …more likely to be >65 ye rs a a a a Source: Digital Nation UK 2021, Good Things Foundation

Slide 52

Slide 52

Slide 53

Slide 53

Slide 54

Slide 54

Slide 55

Slide 55

Factor for digital literacy Pr ctic l tips Preempt any false perceptions of suitability based digital con dence Be clear that you’re looking for ‘normal people’ (unless you aren’t!) Assess digital literacy at second-stage screening (without being ‘techy’) fi fi Note any likely con dence issues and bridge to research time facilitation a a • • • •

Slide 56

Slide 56

Check and assess functional diversity ff ft Older people are not a homogenous group. They are o en living with age-related health conditions which may be pertinent to your research (or which may a ect your study design).

Slide 57

Slide 57

Check and assess functional diversity Pr ctic l tips Screen for: • • • wider accessibility needs (think: diseases like arthritis, low vision, dementias) social needs (think: impact of caring responsibilities) digital adaptations (think: actual or needed) Ask participants to bring their: personal devices artefacts like ‘computer glasses’, magnifying glasses, hearing aids etc. a a • •

Slide 58

Slide 58

Scheduling with older people

Slide 59

Slide 59

Be lexible f Wherever possible, work in sympathy with the participants schedule, location and logistics

Slide 60

Slide 60

Be lexible Pr ctic l tips Travelling to real-world research: avoid peak times consider a research space near transport hubs o er taxi transfers and/or shepherding consider remote, or contextual, alternatives (where ideal is in-person research) a f a ff • • • •

Slide 61

Slide 61

Expect longer lead times Don’t assume that older people, including those who are retired, are time-rich. Similarly, that they are always online.

Slide 62

Slide 62

Over recruit ft It’s o en a good idea to recruit at least one extra participant for any study. This is even more true for older adults.

Slide 63

Slide 63

For l rger studies consider over recruiting by… 15% a a a a a a a … nd f lling b ck on remote moder ted rese rch nd/or rescheduling (depending)

Slide 64

Slide 64

Prevent predictable technology problems Consider scheduling time to set-up and/or familiarise the participant with the so ware* used to enable remote research so that the session itself is protected. ft *Lookback, Zoom etc

Slide 65

Slide 65

Landing the participant Older people can bene t from a more rigorous and/or hands-on approach* to structuring their journey into research-time than with younger people. fi *depends on the individual, but can similar to other more extreme audience groups.

Slide 66

Slide 66

Landing the participant Pr ctic l tips Send a clear, speci c summary of the research Go beyond essentials, like start/end time and date Include transport suggestions, printable maps, photos of the entrance Include speci c reminders about things to bring (like ‘computer glasses’) fi fi Follow-up across mediums as research time approaches a a • • • • •

Slide 67

Slide 67

During user research time

Slide 68

Slide 68

Expected the unexpected People are messy. It’s the basis for our profession, but can disrupt research time. Older people are more likely to have needs beyond younger participants.

Slide 69

Slide 69

Last-minute cancellations Older people can need to react to unforeseen circumstances. Have options in place continue to include them.

Slide 70

Slide 70

Very early arrivals Older people can arrive >20minutes before a session. Sometimes up-to 1-hour. Have resources in place to accommodate them.

Slide 71

Slide 71

Ad hoc shepherding ff Assume that at least 1 participant will be overwhelmed and lost inside the ‘last mile’ to the research space. Even if they’ve turned down o ers of support during screening.

Slide 72

Slide 72

Create a familiar environment Make a space which is representative and adaptable to the needs of the participants ff Try to limit novel, unfamiliar or fatiguing variables with might a ect data quality and ethics

Slide 73

Slide 73

Create a familiar environment Pr ctic l tips fi a • remove any distractions like: • • lighting (especially which cause glare) temperature (especially cold) con gure any technology to the participant (if needed) a •

Slide 74

Slide 74

Companions ff Allow people to bring companions, whether they ask (or simply bring them!) Have plans in place so that they don’t adversely a ect the session.

Slide 75

Slide 75

Set expectations early Remind the participant of the purpose of the study, its parameters. Reassure them why their insight is needed.

Slide 76

Slide 76

Warm-up and practise Spend time demonstrating any methods with an exercise so that the participant comprehends the study’s mechanics.

Slide 77

Slide 77

Research instructions ff Ensure that participants understand any instructions. Ask the participant to playback in their own words. Be prepared to repeat them (if necessary with di erent words) throughout the session.

Slide 78

Slide 78

Slide 79

Slide 79

Make it really real fl Older people can have trouble imagining “reallife” situations that don’t actually re ect their real lives. Ideally, make scenarios truly bespoke.

Slide 80

Slide 80

Think about Think-aloud Consider whether to use retrospective or concurrent verbal playback during a research method.

Slide 81

Slide 81

Stay on topic, stay on target Be mindful of a tendency to chat, reminisce, or stray from a topic during your session. Especially in participatory/group research

Slide 82

Slide 82

Allow extra time (but run to time) Older people may take longer to do things and can need extra facilitation (especially in group-based research) to stay focussed.

Slide 83

Slide 83

Visu l processing speed declines by… 50% a a a …between 70 nd 80 ye rs

Slide 84

Slide 84

Add n extr … 15-minutes a a a …for every 1-hour of rese rch time with older people

Slide 85

Slide 85

Avoid trying to cover too much Expect to cover fewer tasks, or interview questions, in a session than your might with younger people

Slide 86

Slide 86

Avoid trying to cover too much Pr ctic l tips Consider: • • chunked, shorter, sessions with built in breaks a single session, but with more limited objectives Look out for: participant fatigue (more likely, more quickly) loss of focus needing more time (than younger people) a a • • •

Slide 87

Slide 87

Positive predispositions ff Expect positive responses to prototypes, production or brand. A tenancy to praise rather than o end (vs. provide objective views).

Slide 88

Slide 88

Self-blaming Expect a general tendency to blame self when encountering issues (not the designer or developer).

Slide 89

Slide 89

Anxiety, fragile con idence f ft fi fi You’ll o en (but not always) see fragility in con dence in discussing or using technology. Speci cally anxiety about doing (or saying) something ‘wrong’, or breaking things.

Slide 90

Slide 90

User diaries ff Beware that factors like inexperience can a ect the data. Regularly check the data. Be ready to quickly with 121 support/discussion

Slide 91

Slide 91

Closing the research

Slide 92

Slide 92

Like any user research, close your study with any summative exercises, remaining administration or answers for participant questions. However, be prepared to go further for older people…

Slide 93

Slide 93

Provide immediate support You might have observed that the participant struggled with something related to their needs, the product, their system set-up or their abilities.

Slide 94

Slide 94

Provide follow-up support Your product, service or organisation may meet real health or social needs for your participant.

Slide 95

Slide 95

Discussion

Slide 96

Slide 96

🤔 Discussion ide s… • • • • • Did any of this chime with your research practice? What changes have you seen with remote research with older people since 2020? Is there anything you want to hear more about? Do you disagree with anything I’ve covered? How do you nd older people for your research? a fi …