Data @Scale Seattle 2015
2015-06-17
Seattle, United States
who it's for
data engineers, storage engineers, backend engineers, systems architects, infrastructure engineers, site reliability engineers
topics
Presto on sharded MySQL; bucketed sharding for parallelism; Raptor columnstore development; multi-query batching for dashboards; Data Engine columnstore; Kafka into lightweight indexers; Firefly full-text search stack; namespace sharding for privacy; SFrame columnar storage; append-only graph partitioning; JSON->tree unioned path index; RocksDB-backed distributed store
| title | author | length |
|---|---|---|
| Data @Scale Seattle- Eric Hwang introduced by Ganapathy Krishnamoorthy | Eric Hwang, Ganapathy Krishnamoorthy | 32m |
Presto runs directly on a sharded MySQL fleet to power user‑facing analytics, implementing three connector APIs (metadata, data location, data stream) and… | ||
| Data @Scale Seattle- Pawel Terlecki | Pawel Terlecki | 30m |
Tableau reduces dashboard latency by batching and optimizing worksheet requests into multi-query batching and running many requests in parallel, cutting a 25s… | ||
| Data @Scale Seattle- Sundaram Narayanan | Narayanan Sundaram | 30m |
Built LogLens, a lightweight log service replacing Elasticsearch with a pipeline using Kafka into partitioners, ~100–150 one‑core indexers and HDFS for… | ||
| Data @Scale Seattle Samir Goel | Samir Goel | 30m |
Firefly is Dropbox’s from‑scratch full‑text search backing Firefly that indexes hundreds of millions of documents and over 10 trillion tokens, processes more… | ||
| Data @scale Seattle - Yucheng Low | Yucheng Low | 27m |
Claims a practical stack that runs large-graph ML on one box: SFrame columnar storage holds tables on SSD with lazy, columnar access and arbitrary nested… | ||
| Data @Scale Seattle - Dharma Shukla | Dharma Shukla | 31m |
Azure DocumentDB converts JSON documents into a unified JSON→tree model and builds a unioned path index (labels map to terms with postings) so queries run… | ||
| Data @Scale Seattle- Muthu Annamalai | Muthu Annamalai | 30m |
ZippyDB is a distributed key‑value store built on RocksDB that Facebook ships after an 8–9 month build and now runs on thousands of servers serving hundreds of… | ||
| Data @Scale Seattle- Naresh Sundaram | Naresh Sundaram | 32m |
Outlook Service chooses a single sharding axis — shard by user or group — and runs every component (cache, index, blobs, compute) on the same server hosting… | ||
| Data @Scale Seattle - Kestutis Patiejunas | Kestutis Patiejunas | 29m |
Facebook builds a cold-storage stack deployed to a dedicated Oregon data center in 2014, using racks with 15 drives where one powered drive per 15 stays online… | ||
| Data @Scale Seattle- Aaron Ogus | Aaron Ogus | 34m |
Projects storage cost models out to 2020 and claims a zettabyte is practical if architecture picks the right media and tiering. Uses rack-level designs like… | ||
| Data @Scale Seattle- Brian Beach | Brian Beach | 28m |
Backblaze builds a horizontally scalable storage system where clients upload directly to rackmount pods (45 drives, ext4) and a vault is 20-node vault with… | ||
| nothing matches | ||