~/talk

Scraping Techniques to Extract Advertisements from Web Pages

on YouTube 34m
Talkat EuroPython 2011 · 2011-06-20..06-26· [web-performance, web-platform]

speakers

name:Mirko Urru
links:none on file
name:Stefano Cotta Ramusino
speakerdeck:whitone

resources

video:https://youtu.be/IL4o0HSGOsU
slides:none on file

summary

Prototype Python system extracts static banner ads by crawling from a start URL, fetching page source with urllib, parsing HTML to find inbound links, and scraping ad elements to propose matches either randomly or by a simple relevance policy. Implementation uses BeautifulSoup and mechanize for HTML parsing and form interaction, with options like lxml or Chrome remote shell suggested for dynamic pages. Handles only static banners now; dynamic ads and per-user targeting remain future work.

AI-written summary · about

chapters (4)

  1. 0:00Start
  2. 3:05What's the scraping?
  3. 4:29The most famous scraping techniques
  4. 9:38Beautiful Soup

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.