Bending Time with Crystal: 6 hours to 15 minutes

on YouTube ↗30m

" summary

A Rails sitemap job that takes 6 hours for 18 million links becomes a 15 minute process after porting the generator to Crystal using site_mapper and Jennifer, with only about 185 lines of new code and a working prototype in two days. The team finds and fixes a memory issue by changing the shard to stream and write sitemap files as it goes, submits a PR that gets merged, and shows the approach is practical and dramatically faster with minimal porting effort 6 hours to 15 minutes

AI-written summary · about

" chapters (12)

1. 0:00Start
2. 1:03What is The RealReal?
3. 2:10Introduction to Crystal
4. 2:50Sample Crystal
5. 4:01Crystal Ecosystem
6. 6:02Sitemap generation for TheRealReal
7. 6:29What makes it so difficult?
8. 13:52Ruby Sitemap Generation
9. 15:26First Step-Database Modeling
10. 17:52Next step - Generation code
11. 18:34Crystal Sitemap Generation
12. 24:05Recapping the creative process

" related talks

• 31mHow to Make a Gem of a GemJustin Searls · RubyConf 2021
• 01h 33mLightning TalksGodfrey Chan, Saron Yitbarek, Stephanie Nemeth, Nadia Odunayo, John Sawers, Adam Cuppy, Michael Hartl, Reid Morrison, Thomas Witt, Mike Virata-Ston, Matthew Nielsen, Jose Castro, Benjamin Fleischer, Stephanie Marx · RailsConf 2016
• 44mWriting fast RubyErik Michaels-Ober · Barcelona Ruby Conference 2014
• 39m"300x faster ruby"Dana Sherson · RubyConf Au 2020
• 29mHow to Load 1m Lines of Ruby in 5sAndrew Metcalf · GORUCO 2017
• 01h 09mFlash Talks(no speaker listed) · RubyConf India 2024
• 42m3x Rails: Tuning the Framework InternalsAkira Matsuda · RailsConf 2016
• 11mIntroducing the Crystal Programming LanguageWill Leinweber · GORUCO 2016