Analyzing 33 million bike trips with BigQuery

on YouTube ↗33m

" summary

Analyzes 33 million Citi Bike trips loaded into BigQuery (4.5 GB, 33M rows) and visualizes results with Data Studio, Carto and Exploratory. Queries show fleet growth from ~6,000 bikes in 2013 to >10,000 in 2016, subscribers account for ~88% of trips with average trip ~14 minutes vs 35 minutes for casual users, and a single bike ID logs 5,594 trips. Also queries 2.2 TB of GitHub code (≈19 million C# files) and runs NLP on 27k Reddit comments via Cloud Natural Language and JS UDFs (parses in ~16s).

AI-written summary · about

" chapters (7)

1. 0:00Introduction
2. 7:15Data Analysis
3. 10:22Data Visualization
4. 18:30Querying BigQuery
5. 19:39Github Data
6. 23:18Australian Data
7. 27:04Natural Language Processing

" related talks

• 30mAnalyzing 33 million bike trips with BigQuerySara Robinson · NDC Oslo 2017
• 42m2017 DevFestMN Sara RobinsonSara Robinson · DevFest MN 2017
• 31mExploring open data with BigQueryJen Tong · Devoxx Belgium 2017
• 35mPowering Interactive Data Analysis with Google BigQueryMarton Kodok · GDG DevFest Ukraine 2017
• 41mAnalyzing Terabytes of Data with Google BigQueryChandramouli Mahadevan · The Fifth Elephant 2013
• 34mCityBikes: bike sharing networks around the worldLluís Esquerda · EuroPython 2015
• 27mNotorious B.I.G. Data: Wins and fails when building a big data platform in the cloudAndreas Heim · NDC Oslo 2018
• 24mGive meaning to 100 billion analytics events a day, analytics at TeadsPar Alban Perillat-Merceroz · DataXDay 2019