Systems @Scale Summer 2022
2022-06-08..2022-06-29
-- online --
[Systems @Scale Spring 2021, Systems @Scale Summer 2021, Systems @Scale Fall 2021, Systems @Scale Winter 2021, Systems @Scale Summer 2022, Systems @Scale Winter 2022, Systems @Scale Summer 2023, Systems @Scale 2024]
as the organisers put it
Systems @Scale Summer 2022 is a technical conference for engineers that manage large-scale information systems serving millions of people. The operation of large-scale systems often introduces complex, unprecedented engineering challenges. The @Scale community focuses on bringing people together to discuss these challenges and collaborate on the development of new solutions. The Systems @Scale Summer 2022 […]
who it's for
site reliability engineers, platform engineers, infrastructure engineers, cloud service engineers, database engineers, developer experience engineers
topics
cache consistency tracing and invalidation; Kafka Streams and infinite storage to S3; Zelos ZooKeeper semantics on Delos; RocksDB-backed coordination services; managed PostgreSQL/MariaDB/MySQL services; block-level container image system (DADI); gradual config rollout and diff-time testing; WebAssembly in Envoy for policy; low-latency SQL on schemaless JSON; global capacity management and autoscaling
| title | author | length |
|---|---|---|
| Cache Made Consistent – Cache Invalidation Might No Longer Be a Hard Thing in Computer Science | Lu Pan | 23m |
Meta runs Memcache and TAO serving over one quadrillion queries a day and reports improving TAO cache consistency from six nines to over ten nines. The team… | ||
| Leveraging Data in Motion in a Cloud-first World | Jun Rao | 26m |
Apache Kafka becomes the enterprise backbone: Confluent packages Kafka with Kafka Streams and ksqlDB, provides 100+ connectors, and launches infinite storage… | ||
| Introducing Zelos - Zookeeper API leveraging Delos | Ali Zaveri, Suyog Mapara | 22m |
Zelos implements ZooKeeper semantics on top of Delos, uses a native log plus RocksDB in production, and reaches order-of-magnitude more data per ensemble while… | ||
| Hosting Open Source Relational Databases at Scale | Rakesh Gujjula | 20m |
Azure hosts managed PostgreSQL, MariaDB and MySQL services that grow from an initial Windows/container-based platform to a Linux VM–backed Flexible Server GA… | ||
| Systems @Scale Summer Live Q&A Session #1 | Ernesto Gonzalez | 23m |
Polaris acts as a client-only detector that flags cache state divergence while a per-host consistency tracing library embedded in every cache traces state… | ||
| How Meta Keeps its Large-scale Infrastructure Hardware Up and Running | Fred Lin | 21m |
End-to-end remediation flow runs Machine Checker → Alertmanager → BAR auto-remediation → Cyborg reimage/firmware → repair ticket when physical touch or… | ||
| DADI @ Scale: Deploying Containers at Scale | Huiba Li | 16m |
DADI is a block-level image system that replaces full image download and unpack with on-demand block reads over a 3D P2P topology, using an overlay block… | ||
| Scaling End to End Reliability Tracking Across Large Scale, Multiplexed Products and Services | Kewei Qu | 17m |
A vertical, product-centered reliability system federates metric ownership to product teams and measures user-facing failures by HTTP response code and error… | ||
| Don't Ship the Org Chart: Rebuilding Istio for User Maintainability | Craig Box, Sam Naser | 22m |
Istio originally mirrors Google’s multi-service control plane, with about six separate control-plane components, but that layout proves hard for small teams to… | ||
| Systems @Scale Summer Live Q&A Session #2 | Amaya Booker | 20m |
Hardware monitoring optimizes availability by balancing measurable cost against detected benefits with a simple cost/benefit equation, and anomaly detection… | ||
| Configuration Safety at Scale with Ads | Joseph Eley | 20m |
Meta runs ~10,000 generated config files used by >100 critical Ads services with ~1,000 engineers and ~400 manual commits per day; historically ~60% of config… | ||
| Getting from Schemaless Ingest to Fast SQL | Nathan Bronson, Louis Brandy | 19m |
Rockset delivers low-latency SQL on schemaless JSON by ingesting data in seconds and answering selective queries in milliseconds. It implements a C++ IValue… | ||
| The Ent Framework: Meta’s Object-Relational Mapping | Patricia McKenzie, Rohit Ahuja | 17m |
Meta's Ent framework is an object-relational layer that enforces privacy per load via generated privacy policies, evaluates rules in order, and denies or… | ||
| Systems @Scale Summer Live Q&A Session #3 | Sherry Chen | 13m |
Built a 100% accurate mapping from configs to consuming services so commit authors get targeted test plans; many tests still run at 15-minute land-time tests… | ||
| Infra Cloud Service Platform (ICSP) | David Meisner | 24m |
A single platform layer provides a declarative YAML-based config repo called the service configuration graph with validation and dry-run and change diffs that… | ||
| Lessons Learned from Scaling Infrastructure as Code | Rosemary Wang | 22m |
Adopts Terraform and then scales it company-wide, discovering that unpinned modules and out‑of‑band edits break things; fixes include versioned Terraform… | ||
| Global Capacity Management | Kenny Yu, Ranjith Kumar S | 20m |
Meta explains a system that turns global datacenters into a single schedulable computer by offering Global reservations that use an assignment solver to… | ||
| Systems @Scale Summer Live Q&A Session #4 | Yun Jin | 32m |
Live Q&A covers actionable details: Terraform enforces state locking, treats each resource as a transaction (apply stops on a failing resource and resumes… | ||
| nothing matches | ||