Exploring Science on Twitter with IPython Notebook and Python Pandas

on YouTube ↗27m

" summary

Collected about 13.5 million tweets in 2011 via the Twitter streaming API then filtered to ~12 million, stored in CouchDB, and reduced to a single tweets‑per‑day series. Analysis uses IPython Notebook with Python virtualenvs and pandas to mask an April disk outage as NaN, resample daily to monthly, and compute weekday patterns showing midweek peaks and weekend dips. Notebooks export to LaTeX, are shareable via NBviewer, and the workflow proves reproducible and runnable.

AI-written summary · about

" chapters (13)

1. 0:00Start
2. 1:05Research Environment
3. 1:38Python Virtual Environments
4. 2:40Copy Virtual Environment
5. 3:46Ipython Notebook
6. 4:01Start Up Ipython Notebook
7. 6:07Slide Presentations in a Notebook
8. 6:25Page Layout
9. 8:23Magic Functions
10. 11:04Get the Tweets per Day Data into Pandas
11. 17:01Resampling for Different Time Periods
12. 17:39Analysis Options
13. 18:49Adding Columns to a Data Frame

" related talks

• 46mFrictionless Data Science w/PythonCatherine Devlin · PostgresOpen 2014
• 01h 02mLightning TalksPyData NYC 2022
• 41mMassively Parallel Processing with Procedural PythonRonert Obst · PyData Berlin 2014
• 34mPython as a Framework for Analytics and Growth HackingIgnacio Elola · PyData Berlin 2015
• 40mPython and pandas as back end to real-time data driven applicationsGiovanni Lanzani · PyData Berlin 2014
• 01h 52mIntroduction to data analytics with pandasQuentin Caudron · PyData Seattle 2017
• 01h 38mBasic Python Packages for ScienceAlejandro Saez Mollejo, Siro Moreno · PyData Madrid 2016
• 01h 31mPandas, Data Wrangling & Data ScienceKrishna Sankar · PyData San Francisco 2016