Talk to Your App
summary
Shows how to turn microphone audio into actionable app commands using Google Cloud Speech API plus browser SpeechRecognition fallbacks, with timestamps, ~110 language codes, and confidence scores. Demonstrates storing audio in Firebase Cloud Storage, invoking Firebase Cloud Functions to call speech and ML APIs, saving transcripts to the DB, and parsing intents via API.AI/Dialogflow or Google Natural Language for sentiment and entities. Includes speech synthesis and practical notes on noisy audio, browser support, and streaming results.
AI-written summary · about
chapters (29)
- 0:00Intro
- 0:42About Shmuela
- 1:18Back in time
- 1:40Keyboard
- 2:40Voice
- 4:29Less ComputerOriented
- 5:11Cat
- 7:23We have the power
- 7:51Various options
- 8:24Two steps
- 8:49Giving an Angular Connect
- 9:36Voice to Text
- 13:00Speech Synthesis API
- 13:33Support more languages
- 14:03Google Cloud Speech API
- 14:48Demo
- 16:21More features
- 17:57Firebase Cloud Functions
- 18:38Firebase Store
- 19:49Analyzing Text
- 20:48Analyzing JSON
- 22:37Natural Language Processing
- 25:32DialA
- 26:02APIAI
- 27:02Beyond Verbal
- 27:49Mood Analyzer Phone
- 28:17Voiceit
- 29:35Google Developer Days
- 30:00Thank you
related talks
31mTalk to Your App
42mProgramming Amazing Voice Interactions
19mVoice User Interfaces with Angular
33mBuilding Conversational Experiences with Actions on Google
20mBuilding Voice Apps for the Google Assistant
41mVoice and Visual: How to Build Actions for Smart Displays and More
09mWeb apps that talk
19m"Bringing Voice First Experiences to the Web"