~/talk

Robert Coup - /me wants it. Scraping sites to get data.

Talkat Kiwi PyCon 2009 · on Saturday, 2009-11-07· [python, web-platform]

speaker

name:Robert Coup
links:none on file

resources

video:https://archive.org/details/pyvideo_130___robert-coup-me-wants-it-scraping-sites-to-get-data
slides:none on file

summary

Covers building web scrapers in Python: making HTTP requests, parsing HTML, following links, and extracting data from Excel and PDF files. Describes handling messy real-world sites (login flows, bad HTML, CMS quirks), tips for robustness and simplicity, examples of scrapers for New Zealand data, and a project that exposes scrapers via a RESTful API.

AI-written summary · about

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.