Scale Your Elasticsearch Cluster
summary
Shows exact steps: uses a three-node hot/warm/cold demo cluster (one node per tier), an ILM policy that rolls over on 5 minutes or 5 MB, moves shards hot→warm→cold, force-merges and shrinks, snapshots every 10 minutes and deletes after 20, and demonstrates index lifecycle management. Explains frozen indices cut memory (one parallel frozen search per node, queue 100) and shows rollups that aggregate metrics into five‑minute buckets. Searchable snapshots are coming as a paid option.
AI-written summary · about
chapters (16)
- 0:00Intro
- 2:03Overview
- 3:27Lifecycle Management
- 5:25Index Lifecycle Management
- 6:55Lifecycle Actions
- 14:40Demo
- 18:23Index Life Cycle
- 23:29Minimum Age
- 23:50Elastic Curator
- 25:12Snapshots
- 27:27Code Storage
- 29:50Frozen Index
- 38:15Rollups
- 38:50Docker Dashboard
- 43:42Wrap up
- 46:00Questions
related talks
58mTroubleshooting your Elasticsearch cluster like a Support Engineer
16mTop Elasticsearch tips
57mBuilding a Scalable Analytical Solution Using IaaS and Elasticsearch
32mAutoscaling Elasticsearch for Logs on Kubernetes
29mHow (not) to Scale Elasticsearch for Data Analytics!
40mMaking your elastic cluster perform
41mTips and Tricks to Scale Elasticsearch for 1M RPMs and Beyond
45mMonitoring Your OpenSearch Cluster Effectively