Beyond Slow Logs: Implementing Advanced Query Insights in OpenSearch
summary
Query Insights adds real-time, phase-level visibility into OpenSearch queries with APIs in earlier releases and dashboard support from version 3.0, letting teams list top-N queries by CPU or latency over configurable windows (example: 30 minutes) and return exact phase timings, index lists, coordinator node and shard counts. It exports either to a local index or via OpenTelemetry exporter, supports group-by similarity to collapse user-id noise, and keeps configurable historical retention (14 days default).
AI-written summary · about
chapters (15)
- 0:00Query latency challenges
- 1:47Query Insights overview
- 3:12Search latency monitoring evolution
- 5:02Slow log limits and Query Insights
- 6:06Query Insights features
- 8:13Troubleshooting with Query Insights
- 8:34Query Insights architecture
- 9:39Top N queries by CPU
- 10:43Monitoring query latency
- 11:26Exporting Query Insights data
- 11:46Reducing noise with similarity
- 13:12Query Insights dashboard
- 17:28Configuration and support
- 18:11Summary
- 18:35Q&A
related talks
29mMastering Search Performance: Advanced Query Insights for Production OpenSearch
17mMastering the Query Insights Dashboard in OpenSearch
20mUnified Performance Observability in OpenSearch: Integrating Workload Management and Query Insights
04mOpenSearch Performance and Monitoring
38mUser Behavior Insights
20mMeasuring Data with OpenSearch to Better Serve the Community
32mUnleash Your Cluster's Potential with OpenSearch Benchmark
31mSharding 2.0: Unlocking Infinite Search Scalability in OpenSearch