Extending the Google Assistant with (Actions on Google and) API.ai

on YouTube ↗45m

" summary

Actions on Google plus API.ai let developers turn natural speech into intents and entities, map them to an action name, and route JSON to a webhook; demo integrates a Netatmo weather sensor via cloud functions + Node.js webhook and returns temperature/humidity successfully. API.ai exposes a confidence score and automated training for synonyms, supports SSML and pre‑recorded MP3s, offers suggestion chips and a simulator, and the Assistant reaches several hundred million users once an action passes review.

AI-written summary · about

" chapters (8)

1. 0:00Introduction and icebreaker
2. 2:07Overview of Actions on Google
3. 5:56Understanding the architecture
4. 11:19Building and testing agents
5. 18:00Debugging and deployment
6. 22:32Best practices for UX
7. 27:51Discovery and distribution
8. 33:32Q&A session

" related talks

• 53mBuilding Conversational Experiences with Actions on GooglePeter Friese · GDG DevFest Hamburg 2017
• 20mBuilding Voice Apps for the Google AssistantYuksel Tolun · DevFest Gorky 2019
• 41mGet Talking with Actions on GoogleAbraham Williams, Pearl Latteier · Mobile Era 2017
• 10mAPI.AI Tutorial - An Introduction to API.AIAaron Shaw · NationJS 2017
• 13mWhat's new in Google AssistantRebecca Nathenson · Google I/O 2021
• 20mHow Google Assistant's architecture powers voice features in your appsRebecca Nathenson, Alec Truitt, Luyan Chi, Georges Nabaa · Google I/O 2022
• 19mMultiple Ways to Build for Google AssistantJessica Dene Earley-Cha · VOICE Global 2021
• 25mAIY with Google: Would you like to be my assistant ?Pierre-Yves Baloche · DevFest Nantes 2017