~/talk

From Navicrawler to HyBro: a brief history of webcrawlers for social sciences

Talkat FOSDEM 2021 · on Saturday, 2021-02-06· at 11:15· D.research· [web-platform, data-science]

speaker

name:Benjamin Ooghe-Tabanou

links:none on file

resources

video:https://video.fosdem.org/2021/D.research/open_research_webcrawlers_social_sciences.mp4

slides:https://fosdem.org/2021/schedule/event/open_research_webcrawlers_social_sciences/attachments/slides/4390/export/events/attachments/open_research_webcrawlers_social_sciences/slides/4390/210206_FOSDEM21_HyBro_Webcrawlers_for_SHS.pdf

summary

A historical overview of free/open-source web crawling tools used by social science labs and data journalists over the past 15 years, including Navicrawler and IssueCrawler, explaining their use for studying networks and teaching about the web beyond commercial interfaces. Then a short demonstration of médialab’s HyBro (Hyphe‑Browser), showing automated crawling combined with in‑situ browsing and categorization via a user‑friendly interface aimed at non‑experts such as students, scholars, and activists.

AI-written summary · about

related talks