Getting started with R when analysing Github events
summary
Uses R to parse GitHub Archive hourly JSON with readLines + jsonlite, converts each line to an event, then filters for only pull_request contains language. Analyzes one hour (about 11k events → ~500 pull_requests), finds language present in ~5% as empty/missing for several entries, deduplicates by repository id before counting, and produces a sorted frequency table and barplot. Notes sapply versus lapply type pitfalls and that the first working pipeline took about six hours to assemble.
AI-written summary · about
chapters (9)
- 0:00Introduction and setup
- 1:58About the R ecosystem
- 5:16Basic R syntax and types
- 16:07Data structures in R
- 21:53Reading and processing GitHub data
- 26:54Handling missing values and nested data
- 30:47Filtering and deduplicating data
- 33:51Counting language distribution
- 36:39Summary and Q&A
related talks
20mUnderstanding the state of R in South Africa
46mElegant R: Tips from a Software Developer
20m15 Years of R in Quantitative Finance
22mR & Space : GI Science with R
23mGrowth Hacking - Product Analytics at Scale using R and RStudio
29mGiant Pile of Data
48mHuman data interactions: experiments in how humans analyze data
34mBuilding Data Driven Products with Ruby