Your Reality Here Extended Reality and the Web
Your Reality Here Extended Reality and the Web
I’m Peter Gasston @stopsatgreen Creative Tech at rehab
What I’m going to
talk about The post-mobile
platform The reasons What’s missing The role of the Web
The post-mobile platform
Extended reality (XR)
XR will be the next platform.
Gartner hype cycle 2017
Benedict Evans / a16z
Why XR is the next platform Because we’re
told so Because of
human nature Because we have
Because we’re told so
One day, we believe this kind of immersive, augmented reality will become part of daily life for billions of people.” —Mark Zuckerberg “
I regard [AR] as a big idea, like the smartphone.” —Tim Cook “
Some of Apple’s
moves in XR 2013: Buy
PrimeSense 2015: Buy Metaio 2016: Buy Flyby 2017: Buy VRVana 2017: Launch ARKit
Because of human nature
XR meets two persistent human desires: to know, and to be tricked.
The desire to know
Knowledge is power. Scientia potestas est.
developed so that we
could pass on
knowledge; and written
language so that we
could record it.
What would augment reality?
If I could see anything, what should I see? Look at the world and tell me about it Who is this person? Is this cheaper on Amazon? Where did I leave that?
The desire to be tricked
Perspectival representation aimed to give viewers the illusion that they had been transported into geometrically coherent and psychologically convincing other worlds.” — Margaret Wertheim “
If I could see anything, what should I see? Look at the world and tell me about it Who is this person? Is this cheaper on Amazon? Where did I leave that? Add something to the world Make every wall a screen Put Minecraft on the table Show me the recipe
Because we have the foundation
Mixed reality is a display problem, a sensor problem and a decision problem.” — Benedict Evans “
Top three most-photographed subjects Source: Creative Strategies, Inc Smartphone Photography Survey. n=965. Audience: Mainstream.
We’re going from computers with cameras, that take photos, to computers with eyes, that can see.” — Benedict Evans “
Information I’d never have had unless I’d asked whoever I was with to describe it to me. Having the ability to do that independently is really quite remarkable.” — Léonie Watson “
Computer vision has become commoditised in a very short time.
Simultaneous Location And Mapping (SLAM)
Video see-through (VST) Optical see-through (OST)
Phone-based AR is a social impediment and can be uncomfortable for more than short bursts.
Having your hands free to manipulate, hold, touch or help while you’re taking a snap… greatly increases the sense of ‘place’ that you get out of it.” — Matthew Panzarino “
Digital things in physical spaces, and remixing digital input
Digital things sharing space with physical things
In MR, what you don’t see could be as important as what you see.
Google’s Knowledge Graph
aims to give you an answer,
not a page of links.
“ … An intent represents a
mapping between what a
user says and what action
should be taken by your
A platform that’s closely integrated with the real world should reflect real world values—not just those of Silicon Valley.
In the Renaissance, new concepts
of scientific thinking, such as
perspective and space, were
brought into the public sphere by
artists and philosophers.
A shared space
AR has the ability to re-enable scarcity. Many AR experiences will be tied to the location in which you experience it.” — Matt Miesniks “
“ … The future of Nike and of
sneaker culture is to be able
to seamlessly blend
real-world charm with
digital world convenience.”
The biggest thing that’s been missing for the entire last decade was our physical embodied space.” — Anjney Midha “
The AR Cloud is a shared [digital] memory of the physical world. It’s the single most important software infrastructure in computing.” — Ori Inbar “
Google Maps for gaming + virtual positioning system (VPS)
How do we stop massive platforms dominating the AR Cloud in the same way they dominate the Web?
The role of the Web
The Web has transformed the world, but stands aloof from it.” — Mark Pesce “
53.796852, -1.543991 63.0 false //alldayhey.com/ Mixed Reality Service (MRS)
adds a missing metadata
layer to the real world,
adding links in space.
Hololens App Model
WebXR is aimed at letting
you create VR/AR
experiences that are
embedded in the web.
Article (Google prototype)
Facebook 3D post
We have an opportunity to more fundamentally reconsider what we want the Web to be.
We expect Stories are on track to overtake posts in Feed as the most common way that people share across all social apps.” — Mark Zuckerberg “
The rise of Stories
Our current idea of what qualifies as a site, and the value (or lack thereof) that this implies, may be holding the web back.” — Stephanie Rieger “
A richer, more shareable Web
There’s a disconnect between the Web we have — which is largely text — and the Web we need, which is richly visualised. “
Our world is not text, and the Web, as it becomes more a part of this world, must become more like the world.” — Mark Pesce “
“ … We use ‘X’ not as part of an acronym but as an
algebraic variable to indicate
‘Your Reality Here’.”
Let’s make the Web be the X in XR.
How to experiment with XR on the Web now WebXR AR.js, three.ar.js