Live-Coding: Mastering Anti-Ban & Web Scraping with Scrapoxy

on YouTube ↗16m

" summary

Live coding shows Scrapoxy in action: a runnable Scrapoxy proxy waterfall that spawns cloud and residential proxies, integrates with Scrapy and demonstrates Playwright browser farms, header fixes and proxy rotation. Live run yields 50 items on a simple site, then triggers rate limits and displays concrete countermeasures — USER‑AGENT tuning, ISP vs datacenter vs residential proxies, multi-provider pool, and retry strategies — ending with a working pipeline that actually retrieves reviews.

AI-written summary · about

" chapters (9)

1. 0:00Web scraping with Scrapoxy
2. 3:18Travel planning project
3. 6:07Scrapy framework intro
4. 8:38Anti-bot challenges
5. 10:45Bypassing with user agents
6. 11:25Rate limiting with proxies
7. 13:10Data center vs residential proxies
8. 14:58Peer-to-peer proxy networks
9. 15:41Multi-provider proxy strategies

" related talks

• 43mLive-Coding: Mastering Anti-Ban & Web Scraping with ScrapoxyFabien Vauchelles · DevDays Europe 2025
• 43mLive-Coding: Become a Web Scraping Ninja with Scrapoxy!Fabien Vauchelles · DevFest Toulouse 2024
• 46mMastering Web Scraping: Unleash Your Data Extraction Wizardry!Fabien Vauchelles · DevDays Europe 2024
• 01h 30mMaster Advanced Anti-Ban & Web Scraping TechniquesFabien Vauchelles · Ubuntu Summit 2024
• 50mArchitecture of an Anti-Bot ProtectionFabien Vauchelles · Voxxed Days Luxembourg 2024
• 34mArchitecture of an Anti-Bot ProtectionFabien Vauchelles · Devoxx France 2024
• 27mReverse Engineering a Private APIJoyce Lin · CascadiaJS 2022
• 42mCracking the Code: Decoding Anti-Bot Systems!Fabien Vauchelles · Voxxed Days Trieste 2024