Stupid Ideas For Many Computers
summary
Ruby scripts replay a Rails log with mechanize playback across 30–50 processes on VMs to do naive load testing, uses Bash to spawn infinite loops, and admits it can’t detect partial failures. A Twitter-gem pipeline scraps ~1,000 tweets, scores emoji into numeric sentiment, runs mappers/analyzers via tuple space via Rinda/DRb, and reports a total sentiment of ~202. Latin-square generation blasts ~22 billion candidates for n=5, filters them with distributed checkers, and runs on eight containers across five VMs.
AI-written summary · about
chapters (5)
- 0:00Start
- 2:26Unless otherwise stated: all code is copyright Google and licensed Apache V2
- 2:59Really Stupid ™ Load Testing
- 7:59Deployment Hackery
- 15:30Analyzer (mapper)
related talks
28mKeynote: Stupid Ideas for Many Computers
34mBuilding Data Driven Products with Ruby
48mOn the Edge of Rails Performance
44mSimulating the World with Ruby
33mEnsuring High Performance for Your Ruby App
01h 03mRuby at Scale
43mPolyglot Paralellism: A Case Study in Using Erlang and Ruby at Rackspace
01h 09mFlash Talks