Summarize Text from Images using AI and Twilio

A presentation at PennApps 2022 in September 2022 in Philadelphia, PA, USA by offline

Anthony Dellavecchia Developer Evangelist 2022 TWILIO INC. ALL RIGHTS RESERVED

@anthonyjdella Anthony Dellavecchia Developer Evangelist 2022 TWILIO INC. ALL RIGHTS RESERVED

Who has heard of Twilio? anthonyjdella 2022 TWILIO INC. ALL RIGHTS RESERVED

Communications anthonyjdella 2022 TWILIO INC. ALL RIGHTS RESERVED

anthonyjdella 2022 TWILIO INC. ALL RIGHTS RESERVED

On September 29th, Anthony went to Spiceworld, a conference in Austin. During the event, he gave a dope presentation which got lots of ooo’s and ahhh’s… After the presentation, he won the lottery and retired in Maui. Sent 2 mins ago anthonyjdella 2022 TWILIO INC. ALL RIGHTS RESERVED

F5 !!!!! On September 29th, Anthony went to Spiceworld, a conference in Austin. During the event, he gave a dope presentation which got lots of ooo’s and ahhh’s… After the presentation, he won the lottery and retired in Maui. Sent 2 mins ago anthonyjdella 2022 TWILIO INC. ALL RIGHTS RESERVED

Blog Post https://www.twilio.com/blog/summarize-text-from-images-using-ai-and-twilio anthonyjdella 2022 TWILIO INC. ALL RIGHTS RESERVED

Google Cloud Vision API OpenAI anthonyjdella 2022 TWILIO INC. ALL RIGHTS RESERVED

4
_ app.py 1 save an >_ image locally anthonyjdella 2 >_ detect text from 3 >_ generate summary image 2022 TWILIO INC. ALL RIGHTS RESERVED

Live Coding anthonyjdella 2022 TWILIO INC. ALL RIGHTS RESERVED

Text (940) 394-8137 anthonyjdella 2022 TWILIO INC. ALL RIGHTS RESERVED

Communications On September 29th, Anthony went to Spiceworld, a conference in Austin. During the event, he gave a dope presentation which got lots of ooo’s and ahhh’s… After the presentation, he won the lottery and retired in Maui. Sent 2 mins ago Summary Anthony gave a workshop at Spiceworld Sent 1 min ago anthonyjdella 2022 TWILIO INC. ALL RIGHTS RESERVED

Use Cases SMS Customers anthonyjdella 2022 TWILIO INC. ALL RIGHTS RESERVED

Thank you anthonyjdella 2022 TWILIO INC. ALL RIGHTS RESERVED

offline
@anthonyjdella

1 / 24

I taught students at an Ivy League school how to write a program that allows you to take a picture of some text (book, article, etc) then get back a summary of what it says!

Resources

The following resources were mentioned during the presentation or are useful additional information.

Blog Post for this Presentation

Check out the blog post to follow along!

Buzz and feedback

Here’s what was said about this presentation on social media.

About to give a workshop @Penn @PennApps

Teaching people how to use @twilio @GoogleCloudTech @OpenAI to summarize text from photos! pic.twitter.com/tZSHjMHJfE
— anthony = 🥑+🗣️ (@anthonyjdella) September 3, 2022
Watching professor @anthonyjdella teach hackers @PennApps how to use APIs in a college classroom! pic.twitter.com/GIPKvFOVjs
— Sam Agnew (@SagnewShreds) September 3, 2022
Back 2 school w/ @twiliodevs professor @anthonyjdella #pennapps pic.twitter.com/9RqNVdHk90
— Lizzie Siegle (YES on j, NO on i) (@lizziepika) September 3, 2022
Are you tired of reading so much content? Don’t you wish you could pull out your phone, take a picture of some article/book, and get a summary of what it says?

I built a Python🐍 app that uses @OpenAI, @GoogleCloudTech, and @twilio to do this!

Blog post:https://t.co/MzsMbDgpLJ pic.twitter.com/nv2Kbz7lGz
— anthony = 🥑+🗣️ (@anthonyjdella) September 6, 2022

Summarize Text from Images using AI and Twilio

Link for this presentation:

HTML code for embedding:

Share on social media:

Resources

Blog Post for this Presentation

Buzz and feedback