Keeping Adobe Commerce Live Search results fresh in real time
summary
Live Search keeps Adobe Commerce search current by combining full indexing and streaming updates: full indexes are built from catalog exports to S3 and swapped atomically while streaming applies SNS/SQS product notifications to Elasticsearch, then replays updates that occurred during the swap. It runs multi‑tenant on Kubernetes (Adobe Ethos), uses a meta‑index service to coordinate, targets under 200 ms SLA, has 125+ deployments this year, and reports working scale so far while evaluating Kafka, multi‑region, and cluster‑split strategies.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 2:25Native vs Live Search
- 8:46Indexing Challenges
- 10:30Full Indexing Overview
- 13:20Full Indexing Architecture
- 17:50Streaming Updates
- 21:41Scalability and Future
related talks
41mE-Commerce search at scale on Apache Lucene
23mAdobe + Aerospike: Real-time Streaming Segmentation
41mScaling Search and Powering Vector-Based Retrieval With OpenSea...
30mIncrease text search speed & accuracy with Amazon OpenSearch Service
17mMaintaining performance across a highly dynamic commerce site
32mReal time customer experience across industries
29mMastering Search Performance: Advanced Query Insights for Production OpenSearch
28mSearch and Sushi; Freshness Counts