FoundationDB Summit 2018
who it's for
FoundationDB operators, backend engineers, data platform engineers, site reliability engineers, database engineers, open source maintainers
topics
multi-region replication architecture; synchronous cross-cluster replication; versioned B+ tree storage engine; instant cluster backups and restores; hotspot detection and mitigation; TPC-C based performance testing; conflict avoidance with versionstamps; FoundationDB document layer; JanusGraph FoundationDB adapter; versioned metadata store (Entity Store); Snowflake metadata in FoundationDB
| title | author | length |
|---|---|---|
| Lightning Talk: Entity Store: A FoundationDB Layer for Versioned... | Stephen Pimentel | 05m |
A FoundationDB-backed Python library called Entity Store provides versioned ML metadata with automatic versioning (immutable-field changes create new… | ||
| Lightning Talk: Towards supporting backward compatibility | Andrew Noyes | 07m |
Implemented a flatbuffers drop-in replacement for FoundationDB’s serialization that preserves existing serialization idioms and enables rolling upgrades so… | ||
| Lightning Talk: Performance Testing of FoundationDB using TPC-C | Trevor Clinkenbeard | 06m |
Snowflake uses a TPC-C workload and periodic Jenkins runs to surface regressions and measure feature changes against a 5-node AWS cluster with triple… | ||
| Lightning Talk: Hotspot detection and handling in FoundationDB | Ashish Motivala | 06m |
Hotspots are detected by correlating FDB metrics and app context: SnowflakeDB maps transactions to FDB partitions, buffers per-transaction stats in memory (or… | ||
| Lightning Talk: Instant Backups and Restores | Senthil Kumar Ramamoorthy | 10m |
Claim: create a cluster-wide consistent backup by taking application-level disk snapshots of coordinators TLogs and storage and restore by attaching those disk… | ||
| Lightning Talk: Highlights of the Snowflake Elastic Data Warehouse | Torsten Grabs | 13m |
Snowflake claims a multi-cluster shared-data design that separates compute from storage and keeps metadata in FoundationDB. Data are stored in automatic micro… | ||
| Growing A Successful and Sustainable Project | Nithya A. Ruff | 23m |
Argues that sustainable open source needs explicit choices: pick a license and CLA policy, decide hosting (Apache, Linux Foundation, Conservancy) and use… | ||
| Cross-Region Replication Options with FoundationDB | Evan Tschannen | 19m |
FoundationDB 6.0 adds multi‑region support that keeps commits local while protecting against region failure by doing synchronous logs across availability zones… | ||
| Future of FoundationDB Storage Engines | Steve Atherton | 26m |
Redwood implements a versioned B+ tree atop a new versioned pager to persist multiple committed versions on disk so read-only transactions can extend past the… | ||
| Snowcannon: Synchronous Data Replication in FDB | Markus Pilman, David Youngworth | 19m |
Snowcannon is a synchronous replication layer built inside FoundationDB: the producer cluster writes transactions to all TLog replicas and a majority of… | ||
| Avoiding Conflicts in Highly-Concurrent Applications | Alec Grieser | 18m |
Describes three concrete techniques—atomic ops, snapshot reads, versionstamps—and applies them to a sync queue that must append and let multiple readers pop… | ||
| The JanusGraph FoundationDB Storage Adapter | Ted Wilmes | 17m |
JanusGraph gets a working FoundationDB storage adapter that maps adjacency-list vertex/edge rows into FoundationDB using the directory layer and tuple… | ||
| FoundationDB Document Layer | Bhaskar Muppana | 25m |
Document Layer is a stateless microserver that implements a MongoDB-style document model on top of FoundationDB, exposing wire-compatible with MongoDB API… | ||
| Autonomous Testing and the Future of Software Development | Will Wilson | 32m |
Claims that testing eats half of engineering time and trillions in lost productivity, cites industry estimate of ~30% and argues real cost is higher, then… | ||
| Running FDB at scale at Wavefront | Matthew Zeier, Mike McMahon | 26m |
Wavefront runs 500 FoundationDB instances across 35 clusters and reports memory-engine write rates near 800 KHz and SSD writes around 70 KHz. Operation uses a… | ||
| Solving Everyday Data Problems with FoundationDB | Ryan Worl | 22m |
Prototype replicates Aurora binlog into FoundationDB, stores compressed chunked bitmaps (2^18 chunks) keyed by rule, and uses the Roaring bitmap library plus… | ||
| How FoundationDB powers SnowflakeDB's metadata! | Ashish Motivala | 22m |
FoundationDB serves Snowflake as the central metadata store for 4+ years, holding ~200 entities (databases, tables, users, stats) and enabling features like… | ||
| Technical Overview of FoundationDB | Evan Tschannen | 37m |
FoundationDB provides strict serializability across a global keyspace by assigning committed transactions monotonic versions from a single master, serving… | ||
| State of the FoundationDB Community | Ben Collins | 17m |
Project is eight months into open source with 56 contributors active on the core key‑value layer. A new document layer (12,000 LOC) exposes the MongoDB API and… | ||
| nothing matches | ||