Fast Metaprogramming with Truffle

on YouTube ↗30m

" summary

Claims that JRuby+Truffle removes most metaprogramming overhead by using localized caching and dispatch chains to turn send, instance_variable_get/set and method_missing into direct calls. Microbenchmarks show ~4x faster method calls, ~5x faster ivar ops and ~10x faster method_missing versus MRI; a larger benchmark (pdf processing) runs ~33x faster. Implementation pulls JRuby and Rubinius code, hits ~90% core lib, ~92% language spec and ~99% ActiveSupport tests, and the technique deoptimizes and falls back when call sites go megamorphic.

AI-written summary · about

" chapters (15)

1. 0:00Introduction and disclaimer
2. 0:47What is Truffle framework
3. 3:59Metaprogramming in Ruby
4. 5:49Performance and elegance in Ruby
5. 6:52Metaprogramming microbenchmarks
6. 8:17Truffle eliminates metaprogramming overhead
7. 9:21Frequency of metaprogramming calls
8. 13:15JRuby+Truffle performance gains
9. 14:21Ruby method lookup basics
10. 18:52Inline caching in Ruby
11. 21:00Dispatch chains for metaprogramming
12. 24:18Method sharing and caching
13. 25:46Making metaprogramming fast
14. 27:13Research and implementation
15. 27:58Q&A on dispatch chains

" related talks

• 47mHigh Performance RubyCharles Oliver Nutter · GoGaRuCo 2012
• 43mParallel and Thread-Safe Ruby at High-Speed with TruffleRubyBenoit Daloze · Ruby on Ice 2019
• 41mHigh Performance RubyCharles Oliver Nutter · RubyConf AU 2013
• 24mJust-in-Time Compiling Ruby Regexps on TruffleRubyBenoit Daloze, Josef Haider · RubyConf 2021
• 42mImproving TruffleRuby’s Startup Time with the SubstrateVMKevin Menard · RubyKaigi 2017
• 20mEvaluating YJIT’s Performance in a Production Context: A Pragmatic ApproachAaron Patterson, Jemma Issroff, Maxime Chevalier Boisvert, Takashi Kokubun, Noah Gibbs, Si Xing (Alan) Wu · MPLR 2023
• 44mImproving TruffleRuby’s Startup Time with the SubstrateVMKevin Menard · RubyConf 2017
• 38m"Parallel and Thread-Safe Ruby at High-Speed with TruffleRuby"Benoit Daloze · RubyC 2019