Chopping up HTML

on YouTube ↗05m

" summary

Uses ruby and nokogiri to parse HTML/XML and automate extraction rather than hand-copying. Scripts turn a wiki table of 400 help ids into a CSV for import, and scrape Acrolynx report pages to pull per‑topic metrics. The workflow gets built and runs end to end, feeding statistical analysis that reveals no correlation between those content scores and user behavior. Examples include the actual selectors and CSV output used.

AI-written summary · about

" chapters (7)

1. 0:00Start
2. 0:46WHAT IS RUBY?
3. 1:38WHAT IS NOKOGIRI?
4. 2:20EXAMPLE I: SCRAPING WIKI TABLES
5. 2:36EXAMPLE I: CODE SNIPPETS
6. 3:23EXAMPLE 2: SCRAPING A WEB REPORT
7. 4:40EXAMPLE 2: CODE SNIPPET

" related talks

• 45mThe Art of Web Scraping. Trees, Algorithms and JS MagicDmytro Tarasenko · React+ fwdays’25
• 24mimprov BOF How to Scrape Data from any WebsitePyData San Francisco 2016
• 35mUnderstanding the News around the World with Web Scraping and NLP at ScaleJon Wiggins · PyData NYC 2022
• 01h 01mWebcrawlerFlorian Liß · FrOSCon 2015
• 26mScraping or UI Automation? From monkey level to pro!Nicola Landro · PyCon Italia 2023
• 22mRousillon: Scraping Distributed Hierarchical Web DataRastislav Bodík, Sarah E. Chasins, Maria Mueller · UIST 2018
• 46mMastering Web Scraping: Unleash Your Data Extraction Wizardry!Fabien Vauchelles · DevDays Europe 2024
• 01h 01mLevelling Up Your Web Scraping GameIan Littman · PHP UK Conference 2022