Almond: Crowdsourcing an Open, Programmable Virtual Assistant
summary
Almond is an open, federated virtual assistant built on Thingpedia and the neural parser Genie and programmed with the event-driven language ThingTalk. The project crowdsources 104 devices and 249 functions, synthesizes 1.3 million template sentences then crowdsources 24,000 paraphrases to reach 3.6M training examples, reports 62% accuracy on realistic user data (80% on a focused Spotify skill), and runs as web, Android, GNOME/Flatpak and CLI prototypes.
AI-written summary · about
chapters (25)
- 0:00Intro
- 0:14The Linguistic Web Opportunity
- 0:46The Linguistic Web Reality
- 1:23Our Vision: A Better Virtual Assistant
- 2:01Autonomy with Cross-Domain Interoperability
- 3:18Key Concepts
- 4:34Thingpedia: An Encyclopedia of Things
- 5:18The Thing Talk Programming language
- 5:59Natural Language Programming
- 6:37Real Natural Language Input
- 7:06How to Translate All Tasks from NL?
- 8:13Training Without Real Data
- 10:43Primitive Templates
- 11:51Combining Primitives into Constructs
- 12:56The Genie Pipeline
- 15:04Case Studies
- 15:39Crowdsourcing Thingpedia
- 16:20Building The Super-Skill Repository
- 19:26Sharing Through Virtual Assistants
- 20:22ThingTalk Policies
- 22:59People Need Fine-grain Control
- 24:26An Expressive, Understandable Abstraction
- 26:15Our Current Status
- 28:37Where You Can Help
- 30:11How You Can Help
related talks
49mSolving the Next Billion-People Privacy Problem
26mOpen AI Assistants
10mA Day in the Life: An Immersive Data Experience
23mPersonal OS: Build Your Army of 100 AI Interns
52mDesigning digital assistants for those who need it most
45mKeynote: Conversations with Machines
20mKeynote: Open-Sourced Inspiration - The Present and Future of Tech - AI
01h 00mCalling AI Tools from Java