~/talk

Text mining online data with scikit-learn

Talkat PyCon Australia 2014 · 2014-08-01..08-05· [machine-learning]
links:none on file
slides:none on file

Uses Python 3 and scikit-learn to turn online text into features and shows what actually moves metrics: a count vectorizer bag‑of‑words baseline plus a support vector machine yields an F1 ≈ 0.527 on one classification task, while a Twitter spam set (100 spam / 398 not) produces 78.6% accuracy but F1 = 0 until a pipeline with grid search CV and n‑gram features raises precision to ~80% and recall to ~59%. Character n‑grams pick authors; LIWC‑style features estimate political stance.

AI-written summary · about

  1. 0:00Introduction
  2. 3:17Count Vectorizer
  3. 6:53Batman Word Cloud
  4. 7:52Spam
  5. 11:24Parameterization
  6. 17:26Authorship
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.