Building analytics application with streaming expressions
summary
Introduces Apache Solr's Streaming Expressions (available since Solr 6.0) and explains how they can be used in SolrCloud for near-real-time analytics and visualization on large datasets. Covers the Streaming Expressions language and its function library for parallel operations — aggregations, parallel relational algebra, batch processing, distributed graph traversal and MapReduce-style tasks — and discusses challenges encountered when building large-scale, near-real-time analytics applications at Lucidworks.
AI-written summary · about
chapters (8)
- 0:00Start
- 0:38Outline
- 3:09Streaming API
- 6:53Streaming Expressions - Use cases
- 15:11Streaming Expressions - Shuffle
- 23:44Statistical Programming - Use cases
- 24:07Takeaway
- 24:43References & Knowledge Base
related talks
39mParallel SQL & Streaming Expressions in Apache Solr 6
41mBuilding an Open Source Streaming Analytics Stack with Kafka and Druid
50mAnalytics and Graph Traversal with Solr
25mApache Lucene: From Text Indexing to Artificial Intelligence
14mMulticloud Analytics Made Simple
34mReal time OLAP and Stream Processing Friends or Foes
10mData Rivers — The New Analytics Architecture
36mSolrCloud and NoSQL