~/talk

Multi-tenant HBase Solutions at Facebook

on YouTube 43m
Talkat Berlin Buzzwords 2012 · 2012-06-04..06-05· [databases, devops-and-delivery]

speaker

name:Nicolas Spiegelberg
links:none on file

resources

video:https://youtu.be/IWyTWCYdrUY
slides:none on file

summary

Facebook runs HBase for multiple production systems including Messages which handles 180 billion messages per month. Infrastructure details: HBase on HDFS with ZooKeeper and BookKeeper experiments, Haystack for large attachments, MapReduce for schema upgrades and rollups, memcache for hot reads, and MD5-based sharding in a controlled multi-tenant layer called hash out. Live footprint claims ~90 billion read/write ops for messages, 4.5 PB compressed storage (≈15 PB replicated), ~400 TB growth per month, and clusters from ~16 to ~200 nodes.

AI-written summary · about

chapters (19)

  1. 0:00Start
  2. 0:41Multi-Tenant Hbase Solutions
  3. 2:50Hbase Overview
  4. 5:46Horizontal Scalability
  5. 6:29Summary of the Right Path and Read Path
  6. 7:25System Overview
  7. 7:49What Sort of Use Cases Do We Have in Production
  8. 8:03Facebook Insights
  9. 8:57Facebook Messages
  10. 9:55Stats
  11. 22:47Pre-Production
  12. 23:21Shadow Testing
  13. 27:08Do You Need a New Column Family or a New Table
  14. 28:06Real-Time Facebook Insights
  15. 32:10An Operational Data Store
  16. 32:53Schema Design
  17. 34:09Lessons Learned
  18. 35:44Multi-Tenant Used Cases
  19. 39:43Constant Upgrades

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.