Mixed Reality Frameworks

A presentation at CanUX in November 2019 in Ottawa, ON, Canada by Alastair Somerville

Slide 1

Slide 1

CanUX 2019 CanUX @acuity_design Mixed Reality Frameworks

Slide 2

Slide 2

CanUX @acuity_design Alastair @acuity_design

Slide 3

Slide 3

Relax CanUX @acuity_design Post-Brunch

Slide 4

Slide 4

CanUX @acuity_design 7 topics 2 problems 1 solution

Slide 5

Slide 5

CanUX @acuity_design Senses Mixed Reality Design Cognitive Accessibility Autonoetic consciousness Perception Tools Diversity of people, diversity of places

Slide 6

Slide 6

CanUX @acuity_design 7 topics 2 problems 1 solution

Slide 7

Slide 7

(including why you are extraordinary) CanUX @acuity_design 7 topics 2 problems 1 solution

Slide 8

Slide 8

CanUX @acuity_design What do I do?

Slide 9

Slide 9

CanUX @acuity_design Senses Mixed Reality Design Cognitive Accessibility Autonoetic consciousness Perception Tools Diversity of people, diversity of places

Slide 10

Slide 10

CanUX @acuity_design How to help people perceive information in places?

Slide 11

Slide 11

CanUX @acuity_design

Slide 12

Slide 12

CanUX @acuity_design Maps thru touch

Slide 13

Slide 13

Augmented Reality thru sound CanUX @acuity_design Maps thru touch

Slide 14

Slide 14

Augmented Reality thru sound Data visualisation & manipulation thru N Dimensional data folding in Virtual Reality CanUX @acuity_design Maps thru touch

Slide 15

Slide 15

Augmented Reality thru sound Cognitive accessibility of information and places Data visualisation & manipulation thru N Dimensional data folding in Virtual Reality CanUX @acuity_design Maps thru touch

Slide 16

Slide 16

CanUX @acuity_design Senses Mixed Reality Design Cognitive Accessibility Autonoetic consciousness Perception Tools Diversity of people, diversity of places

Slide 17

Slide 17

CanUX @acuity_design Design of public spaces & services for people with dementia and autistic people

Slide 18

Slide 18

CanUX @acuity_design Senses Mixed Reality Design Cognitive Accessibility Autonoetic consciousness Perception Tools Diversity of people, diversity of places

Slide 19

Slide 19

CanUX @acuity_design Centre for Accessible Environments

Slide 20

Slide 20

CanUX @acuity_design Entrance halls for autistic people

Slide 21

Slide 21

CanUX @acuity_design

Slide 22

Slide 22

CanUX @acuity_design Cognitive Accessibility of museums

Slide 23

Slide 23

CanUX @acuity_design Mapping and sorting

Slide 24

Slide 24

CanUX @acuity_design

Slide 25

Slide 25

CanUX @acuity_design Looking at lots of Post It Notes on walls

Slide 26

Slide 26

CanUX @acuity_design Small problem

Slide 27

Slide 27

CanUX @acuity_design Human centered design needs human perspective

Slide 28

Slide 28

CanUX @acuity_design Senses Mixed Reality Design Cognitive Accessibility Autonoetic consciousness Perception Tools Diversity of people, diversity of places

Slide 29

Slide 29

CanUX @acuity_design Senses Mixed Reality Design Cognitive Accessibility Autonoetic consciousness Perception Tools Toys Diversity of people, diversity of places

Slide 30

Slide 30

CanUX @acuity_design

Slide 31

Slide 31

CanUX @acuity_design Jenga

Slide 32

Slide 32

CanUX @acuity_design

Slide 33

Slide 33

CanUX @acuity_design Human perspective on content

Slide 34

Slide 34

CanUX @acuity_design Senses Mixed Reality Design Cognitive Accessibility Autonoetic consciousness Perception Tools Diversity of people, diversity of places

Slide 35

Slide 35

Content splitting then Meaning CanUX @acuity_design Perception

Slide 36

Slide 36

CanUX @acuity_design

Slide 37

Slide 37

CanUX @acuity_design Perceivable

Slide 38

Slide 38

CanUX @acuity_design

Slide 39

Slide 39

CanUX @acuity_design From human perspective, content may not be perceivable

Slide 40

Slide 40

CanUX @acuity_design Sensory Cognitive Cultural Economic

Slide 41

Slide 41

CanUX @acuity_design

Slide 42

Slide 42

CanUX @acuity_design Meaning

Slide 43

Slide 43

CanUX @acuity_design

Slide 44

Slide 44

CanUX @acuity_design Meaning is held by user

Slide 45

Slide 45

CanUX @acuity_design Perspective switching

Slide 46

Slide 46

CanUX @acuity_design

Slide 47

Slide 47

CanUX @acuity_design Human perspective

Slide 48

Slide 48

CanUX @acuity_design

Slide 49

Slide 49

CanUX @acuity_design System perspective

Slide 50

Slide 50

CanUX @acuity_design

Slide 51

Slide 51

CanUX @acuity_design More questions More user journeys

Slide 52

Slide 52

CanUX @acuity_design

Slide 53

Slide 53

CanUX @acuity_design A small detour…

Slide 54

Slide 54

CanUX @acuity_design Senses Mixed Reality Design Cognitive Accessibility Autonoetic consciousness Perception Tools Diversity of people, diversity of places Transcendent User Experience

Slide 55

Slide 55

CanUX @acuity_design Make your own tools

Slide 56

Slide 56

CanUX @acuity_design Crown Nail

Slide 57

Slide 57

CanUX @acuity_design Blued Cut Tacks

Slide 58

Slide 58

CanUX @acuity_design

Slide 59

Slide 59

CanUX @acuity_design Corollary of mass production is custom tools

Slide 60

Slide 60

Tool Makers CanUX @acuity_design Tool Room

Slide 61

Slide 61

Making Innovation CanUX @acuity_design Maintaining Infrastructure

Slide 62

Slide 62

CanUX @acuity_design

Slide 63

Slide 63

But do make your own tools CanUX @acuity_design Do not imitate manufacturing

Slide 64

Slide 64

CanUX @acuity_design And back…

Slide 65

Slide 65

CanUX @acuity_design

Slide 66

Slide 66

CanUX @acuity_design Service Design and sorting into lanes

Slide 67

Slide 67

CanUX @acuity_design

Slide 68

Slide 68

CanUX @acuity_design Adding realities

Slide 69

Slide 69

CanUX @acuity_design

Slide 70

Slide 70

CanUX @acuity_design Virtual realities

Slide 71

Slide 71

CanUX @acuity_design

Slide 72

Slide 72

CanUX @acuity_design Mixed realities

Slide 73

Slide 73

CanUX @acuity_design

Slide 74

Slide 74

CanUX @acuity_design Mixed realities are everywhere…

Slide 75

Slide 75

CanUX @acuity_design …and always have been

Slide 76

Slide 76

CanUX @acuity_design Books Theatres Cinema Daydreams

Slide 77

Slide 77

CanUX @acuity_design Senses Mixed Reality Design Cognitive Accessibility Autonoetic consciousness Perception Tools Diversity of people, diversity of places

Slide 78

Slide 78

CanUX @acuity_design Big problem

Slide 79

Slide 79

CanUX @acuity_design Framing Mixed Realities

Slide 80

Slide 80

CanUX @acuity_design

Slide 81

Slide 81

CanUX @acuity_design Building a model

Slide 82

Slide 82

CanUX @acuity_design

Slide 83

Slide 83

CanUX @acuity_design Thresholds

Slide 84

Slide 84

CanUX @acuity_design Information Thresholds

Slide 85

Slide 85

CanUX @acuity_design People move thru mixed realities all the time

Slide 86

Slide 86

CanUX @acuity_design Thresholds enable choice of which reality to enter to meet intent

Slide 87

Slide 87

CanUX @acuity_design Threshold spotting

Slide 88

Slide 88

CanUX @acuity_design

Slide 89

Slide 89

CanUX @acuity_design Threshold spotting tool

Slide 90

Slide 90

CanUX @acuity_design Thresholds are rectangular*

Slide 91

Slide 91

CanUX @acuity_design *unless they are human (with a rectangular badge)

Slide 92

Slide 92

CanUX @acuity_design Boundaries

Slide 93

Slide 93

CanUX @acuity_design Boundaries enable choices

Slide 94

Slide 94

CanUX @acuity_design

Slide 95

Slide 95

CanUX @acuity_design

Slide 96

Slide 96

CanUX @acuity_design Human perspective: thinking, dreaming, imagining

Slide 97

Slide 97

CanUX @acuity_design

Slide 98

Slide 98

CanUX @acuity_design Choosing realities to enter

Slide 99

Slide 99

CanUX @acuity_design Another detour…

Slide 100

Slide 100

CanUX @acuity_design Senses Mixed Reality Design Cognitive Accessibility Autonoetic consciousness Perception Tools Diversity of people, diversity of places

Slide 101

Slide 101

CanUX @acuity_design Autonoetic consciousness

Slide 102

Slide 102

“an awareness of you, the experiencing person, as part of the experience” Joseph LeDoux CanUX @acuity_design Autonoesis

Slide 103

Slide 103

CanUX @acuity_design We all journey back & forward thru time and place

Slide 104

Slide 104

CanUX @acuity_design Autonoesis is unique to humans*

Slide 105

Slide 105

  • We cannot prove your pets can do this because we do not have shared language CanUX @acuity_design Autonoesis is unique to humans*

Slide 106

Slide 106

CanUX @acuity_design You, and everyone you meet, are extraordinary

Slide 107

Slide 107

CanUX @acuity_design Senses Mixed Reality Design Cognitive Accessibility Autonoetic consciousness Perception Tools Diversity of people, diversity of places

Slide 108

Slide 108

CanUX @acuity_design Designing for diversity of people in a diversity of places?

Slide 109

Slide 109

CanUX @acuity_design Postal Museum, London, UK

Slide 110

Slide 110

CanUX @acuity_design Photo: http://alondoninheritance.com

Slide 111

Slide 111

CanUX @acuity_design Listen to many people!

Slide 112

Slide 112

CanUX @acuity_design Less like this

Slide 113

Slide 113

CanUX @acuity_design Isolated in technology

Slide 114

Slide 114

CanUX @acuity_design More like this

Slide 115

Slide 115

CanUX @acuity_design Threshold: held by human storyteller

Slide 116

Slide 116

CanUX @acuity_design Boundary: centered in humanity, immersed in stories

Slide 117

Slide 117

CanUX @acuity_design

Slide 118

Slide 118

CanUX @acuity_design Problematising people

Slide 119

Slide 119

CanUX @acuity_design Accessibility framed as problem with impairments

Slide 120

Slide 120

CanUX @acuity_design Accessibility framed as opportunity for capacities

Slide 121

Slide 121

CanUX @acuity_design Social Model of Disability: broken design not broken people

Slide 122

Slide 122

CanUX @acuity_design Design framed as problem with humanity

Slide 123

Slide 123

CanUX @acuity_design Design framed as solution thru humanity

Slide 124

Slide 124

CanUX @acuity_design Human centred: bad design not bad people

Slide 125

Slide 125

CanUX @acuity_design People are amazing

Slide 126

Slide 126

CanUX @acuity_design The uniqueness of human consciousness

Slide 127

Slide 127

CanUX @acuity_design We all move back and forward thru many realities

Slide 128

Slide 128

CanUX @acuity_design

Slide 129

Slide 129

CanUX @acuity_design Work with the huge diversity of people

Slide 130

Slide 130

CanUX @acuity_design Anchor to human perspective and perception

Slide 131

Slide 131

CanUX @acuity_design Being human is the solution

Slide 132

Slide 132

CanUX @acuity_design Being you is the solution

Slide 133

Slide 133

CanUX @acuity_design Because you are extraordinary

Slide 134

Slide 134

CanUX @acuity_design