Data Cleansing With SQL And R

on YouTube ↗01h 02m

" summary

Shows concrete methods using SQL Server and R tidyverse: normalize a messy CSV into a new incident table with primary/foreign keys, use TRY_PARSE for dates and a CLR geography function for lat/long, and use CROSS APPLY and chained REPLACE to convert descriptions into 316 incident types then DENSE_RANK those into an incident_type table. Cleans ~413k rows, drops incomplete cases, produces boxplots and QQ plots, and surfaces real outliers (mental‑health‑facility cluster) for follow up.

AI-written summary · about

" chapters (8)

1. 0:00Introduction to data cleansing
2. 3:08High-level concepts
3. 8:02SQL server techniques
4. 12:51SQL server implementation
5. 29:50Tidy data in R
6. 41:11Handling EAV structures
7. 44:50Data manipulation with Dplyr
8. 53:38Practical analysis and closing

" related talks

• 19mDatabases using R The latestEdgar Ruiz · rstudio::conf 2019
• 18mCross-Industry Anomaly Detection Solutions with R and ShinyTanya Cashorali · rstudio::conf 2019
• 20mBridging the Gap between SQL and RIan Cook · rstudio::conf 2019
• 01h 01m.NET to The Power of R(1)TJ Gokcen · NDC Sydney 2016
• 17mdm: Analyze, build and deploy relational data modelsKirill Müller · rstudio::conf 2019
• 18mCross-Industry Anomaly Detection Solutions with R and ShinyTanya Cashorali · rstudio::conf(2022)
• 33mGet your Data prod ready, Fast, with Ruby Polars!Paul Reece · RubyConf 2023
• 52mSurvival Analysis of Customer Retention using Postgres, SQL and RGleb Arshinov · PostgresOpen 2014