Daniel Shank, Data Scientist, Talla
summary
Goal is to detect repeated help questions and auto-serve past answers by matching new queries to historical chat lines. Uses active learning starting from about 100 seed labels and selects examples by uncertainty sampling (predictions near 0.5) to reach a usable classifier quickly while warning that label distribution skews. Builds representations with time-windowed word embeddings / matrix factorization tailored to problem contexts, notes topic models like LDA alpha sensitivity and that answer extraction remains a separate unsolved piece.
AI-written summary · about
chapters (7)
- 0:00Start
- 0:11Daniel Shank
- 0:38Smart Knowledge Management
- 2:09Finding Issues and Matching Them to Incoming Questions
- 6:58Active Learning
- 11:42Dimensionality Reductions and Representations
- 15:16Final Thoughts
related talks
28mByron Galbraith, Chief Data Scientist, Talla at MLconf Seattle 2017
25mXavier Amatriain, VP of Engineering, Quora @ MLconf SEA
31mWhen humans teach machines
22mDavid Talby, SVP Engineering, Atigeo
38mFrom text to knowledge via ML algorithms - the Quora answer
31mKeynote Q&A – Barbara Plank
37mActive Teaching, Human Learning
28mFrom Tables to Answers: building QA System for In-Document Searches
