Obscure Go Optimisations

on YouTube ↗51m

" summary

Shows how a hidden conversion silently allocates when Go casts a slice to an interface, causing Prometheus startup to do a million allocations and lose ~25% (profile showed a mystery confTslice allocating, then fix hoists a pointer out of the loop and removes GBs of allocation). Demonstrates profiler + flamegraph to find it, switching from interface calls to a function or type-parameterized compare, using PDQ sort and golang.org/x/slices for big wins, and replacing heat-ballast with GOMEMLIMIT + GOGC=off to drop GC frequency (example: GC rate 150→30 Hz and latency ~55ms→<40ms).

AI-written summary · about

" chapters (8)

1. 0:00Introduction and Background
2. 5:43Identifying Performance Issues
3. 13:26Optimizing Memory Allocation
4. 19:06Sorting and Interface Overhead
5. 25:48Generic Functions for Speed
6. 32:26Understanding Garbage Collection
7. 40:01Heap Management Techniques
8. 45:02Conclusion and Key Takeaways

" related talks

• 14mOptimizing Go code without a blindfoldDaniel Martí · dotGo 2019
• 40mTwo Go programs, three different profiling techniques, all in 40 minutesDave Cheney · Codemotion Berlin 2019
• 40mGolang memory footprintLiviu Esanu · code.talks 2019
• 44mGo Profiling and Observability from ScratchFelix Geisendörfer · GopherCon 2021
• 48mGolang's GarbageAndrey Sibiryov · SREcon17 Asia/Australia
• 29mOptimizing Go Code Without a BlindfoldDaniel Martí · GopherCon UK 2019
• 30mMemory Management in Go: The good, the bad and the uglyLiam Hampton · GopherCon UK 2023
• 26mPractical Memory ProfilingBill Kennedy · GopherCon Europe 2022