Custom data structures in managed Postgres using WASM
summary
Claim: compile the Roaring bitmap C library to WASM and run it inside PLV8 to get native-extension–like custom types on managed Postgres (AWS RDS GCP Cloud SQL Azure Database) and avoid moving data to another DB. Concrete tools: Emscripten/mscripten → WASM, pv8/PLV8, bytea storage. Result: handled ~100x data growth for Workday Peakon Employee Voice in production; bitmap queries run hundreds of times faster than GIN (WASM ~3× slower than C but still fast enough).
AI-written summary · about
chapters (9)
- 0:00Introduction
- 1:50Managed Postgres extensions
- 5:22Running untrusted code safely
- 8:18Embedding V8 in Postgres
- 12:54Custom data types in Postgres
- 19:15Replicating with pv8 and WASM
- 26:06Performance benefits of WASM
- 33:58Maintenance and consistency
- 35:44Summary
related talks
26mCompiling Postgres to WASM with PGlite
33mExtending your database server's abilities
20mLeveraging PLV8 in Javascript heavy Web Applications
13mLightning Talk: Revolutionizing Application Architecture with Wasm Powered Database Ex...
45mWebAssembly's Post-MVP Futurer
39mUnleashing the Power of WASM: Revolutionizing Database Scalability and Application Architectures
28mDistributed Computation with WASM and WASI
29mBuild Database Driven Applications in Wasm