A presentation at Web Directions Summit in in Sydney NSW, Australia by Mandy Michael
Mandy Michael @mandymichael @mandy_kerr
Jello the little fluffy fellow @adognamedjello
“ The Web Speech API enables you to incorporate voice data into web apps. ” @mandy_kerr
new SpeechRecognition(); //constructor for SpeechRecognition object instance
recognition.start(); // method to start speech recognition service recognition.stop(); !// stops the speech recognition service from listening to audio returns a result
recognition.onresult = function(event) {} // event handler when a word or phrase has been recognised
recognition.onspeechend = function(event) {} // will run when the speech recognition service has stopped being detected
@mandy_kerr
Andre Natal Speech & AI engineer Mozilla @andrenatalbr wiki.mozilla.org/Web_Speech_API_-_Speech_Recognition @mandy_kerr
“ Audio & speech allow for more interactive and more accessible experiences. ” @mandy_kerr
“ The accelerometer detects a change to the orientation of the device. ” @mandy_kerr
@mandy_kerr
“ We can move on from static, predetermined interactions and allow the user to shape the experience. ” @mandy_kerr
“ A photodetector that is used to sense the amount of ambient light present. ” @mandy_kerr
Rijubrata Bhaumik Tech lead, Intel web platform @rijubrata @mandy_kerr
A second attempt at the ambient light sensor.
Addressing the security concerns of light sensors in the browser
Font: BloomGX by Typearture (Arthur Reinders Folmer)
“ Don’t be limited by what we can already do, the web is still young and there is so much for us to create. ” @mandy_kerr
@mandy_kerr @mandymichael developer.mozilla.org/docs/Web/API developer.mozilla.org/docs/Web/API/Sensor_APIs developer.mozilla.org/docs/Web/API/SpeechRecognition developer.mozilla.org/docs/Web/API/AmbientLightSensor developer.mozilla.org/docs/Web/API/DeviceOrientationEvent @mandy_kerr
Developments in Sensor & Browser Apis have opened up many opportunities for your website to react and respond based on the users device, environment or input. As of right now there are many great Sensor & Browser APIs that you can take advantage of including Light Sensors, Orientation and Speech Recognition. Because these APIs are available in more devices than you would think they are more accessible than ever.
Whether it’s a practical implementation of the Light Sensor API or abducting a cat with a combination of sensors - we’ll look at some simple code demos, explore the possibilities, tools and resources needed to get started creating engaging and creative effects, visualisations and experiences.
The following resources were mentioned during the presentation or are useful additional information.
for free. You
can too.