Building a search engine: my introduction to functional programming

on YouTube ↗05m

" summary

A four-person team learns Elixir at a boot camp then builds a working search engine: a URL scraper that seeds a crawler, scraped pages stored in a database, and a query engine that ranks results with a very crude algorithm and renders a Google-like page. Elixir’s concurrency and tooling actually make the spider feasible, fizzbuzz surfaces functional shifts, community help accelerates progress, and running the crawler gets the team banned from some coffee shops while confirming the prototype works.

AI-written summary · about

" chapters (8)

1. 0:00Introduction
2. 0:27Preamble
3. 1:21Team
4. 1:40URL Scraper
5. 2:22Query Engine
6. 3:02WTF moments
7. 3:41Community
8. 4:25Junior jobs

" related talks

• 29mWeb scraping in Elixir with CrawlyOleg Tarasenko · ElixirConf EU Virtual 2020 (June)
• 32mElixir for the rubyistH. Fulton · RubyDay 2015
• 42mIntroduction to Elixir for RubyistsJosh Adams · Ancient City Ruby 2014
• 06mJosé Valim and friends answer most searched Elixir questionsJosé Valim · Code Elixir LDN 2018
• 50ma Guided Introduction to Elixir - Part 1 of 6Aldric Giacomoni · LambdaConf 2017
• 32mBuild your very own web framework in ElixirGerman Velasco · ElixirDaze 2018
• 47mGood behaviour: Cultivating Healthy Elixir Teams & CodebasesMeryl Dakin · Code BEAM America 2022
• 48mBitcoin & Elixir: Living the Cutting EdgeYurii Rashkovskii · Erlang Factory SF Bay Area 2014