Real-Time Transcription and Sentiment Analysis of Audio Streams

A presentation at Vonage Campus in October 2019 in San Francisco, CA, USA by Aaron Bassett

Slide 1

Slide 1

WELCOME TO YOUR CAMPUS 2019 WORKSHOP Real-Time Transcription and Sentiment Analysis of Audio Streams By Dave Nugent & Aaron Bassett

Slide 2

Slide 2

Dave Nugent • Developer Advocate at IBM • @drnugent • linkedin.com/in/drnugent

Slide 3

Slide 3

Aaron Bassett • Developer Advocate at Nexmo • @aaronbassett • linkedin.com/in/aaronbassett

Slide 4

Slide 4

Get the Source noti.st/aaronbassett • git.io/Jeudk •

Slide 5

Slide 5

What are we going to build?

Slide 6

Slide 6

Slide 7

Slide 7

Slide 8

Slide 8

Slide 9

Slide 9

CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN

Slide 10

Slide 10

CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN

Slide 11

Slide 11

CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN

Slide 12

Slide 12

CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN

Slide 13

Slide 13

CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN

Slide 14

Slide 14

CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN AUDIO GET NCCO NCCO AUDIO AUDIO TRANSCRIPT TRANSCRIPT TONES TONES CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN

Slide 15

Slide 15

Prerequisites

Slide 16

Slide 16

WebSockets

Slide 17

Slide 17

EVENT Socket.onopen This event occurs when socket connection is established

Slide 18

Slide 18

EVENT Socket.onmessage This event occurs when client receives data from server

Slide 19

Slide 19

EVENT Socket.onerror This event occurs when there is any error in communication

Slide 20

Slide 20

METHOD Socket.send The send data method transmits data using the connection

Slide 21

Slide 21

METHOD Socket.close The close method would be used to terminate any existing connection

Slide 22

Slide 22

ngrok

Slide 23

Slide 23

Getting Started Configuring our application

Slide 24

Slide 24

CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN AUDIO GET NCCO CALLER VONAGE VAPI

Slide 25

Slide 25

Code time!

Slide 26

Slide 26

CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN WEBSOCKET SERVER IBM STT IBM TONES ADMIN AUDIO GET NCCO NCCO CALLER VONAGE VAPI NCCO SERVER

Slide 27

Slide 27

(731) 540 1111

Slide 28

Slide 28

CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN WEBSOCKET SERVER IBM STT IBM TONES ADMIN AUDIO GET NCCO NCCO AUDIO CALLER VONAGE VAPI NCCO SERVER

Slide 29

Slide 29

(731) 540 1111

Slide 30

Slide 30

CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN AUDIO GET NCCO NCCO AUDIO AUDIO TRANSCRIPT TRANSCRIPT TONES CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN

Slide 31

Slide 31

(731) 540 1111

Slide 32

Slide 32

CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN AUDIO GET NCCO NCCO AUDIO AUDIO TRANSCRIPT TRANSCRIPT TONES TONES CALLER VONAGE VAPI NCCO SERVER WEBSOCKET SERVER IBM STT IBM TONES ADMIN

Slide 33

Slide 33

viw.ngrok.io/ dashboard

Slide 34

Slide 34

Links • twitter.com/aaronbassett twitter.com/drnugent • • noti.st/aaronbassett git.io/Jeudk •

Slide 35

Slide 35

Questions?