(R)Evolution — You Know, for Search…

on YouTube ↗41m

" summary

Elasticsearch 5.6 adds strict bootstrap checks and a cluster allocation explain API that tells exactly why a shard is unassigned, and 6 enables rolling upgrades (mixed 5.x/6.x clusters) demonstrated working live; cross-cluster search replaces heavy tribe nodes, and flood-stage watermark at 95% locks indices for safety to avoid corruption. New sequence numbers with a global checkpoint let replicas replay only missed ops, speeding recovery, and types are phased out (new indices single-type in 6, types optional in 7, removed in 8). cluster all mixed-mode upgrade sequence numbers and global checkpoint

AI-written summary · about

" chapters (16)

1. 0:00Start
2. 0:36Revolution
3. 1:39Who uses Elasticsearch?
4. 2:18elastic Infrastructure Developer Advocate
5. 2:43the_birth_of_compass
6. 4:10elasticsearch.
7. 10:39Parameters & configs
8. 11:14Bootstrap checks
9. 12:02Shard Allocation API 5.2
10. 19:24Cross Cluster Search 5.3
11. 22:09Rolling Upgrades 6.0
12. 26:34Floodstage Watermark 6.0
13. 27:49Sequence Numbers 6.0
14. 38:17C3: Cutting Tail Latency in Cloud Data Stores via Adaptive Replica Selection
15. 38:33Exponentially Weighted Moving Average (EWMA)
16. 40:31Conclusion

" related talks

• 41mRule #2: Double Tap. An Elasticsearch Journey of ResiliencyGeorge Kobar · REdeploy 2019
• 46mTwo steps forward, one step backward - backward compatibility in ElasticsearchAlexander Reelsen · JCON 2020
• 54mScale Your Elasticsearch ClusterPhilipp Krenn · Highload fwdays'20
• 31mSharding 2.0: Unlocking Infinite Search Scalability in OpenSearchVikas Bansal, Paras Jain · OpenSearchCon Europe 2026
• 40mWhat's evolving in Elasticsearch and Lucene?Simon Willnauer · Berlin Buzzwords 2019
• 01h 01mElasticsearch Do's, Don'ts and Pro-TipsItamar Syn Hershko · NDC London 2017
• 16mTop Elasticsearch tipsNicolas Buisson · Devoxx Belgium 2017
• 21mEvolution of Yelp search to a ranking platformUmesh Dangat · Berlin Buzzwords 2019