Apache Lens: Cut Data Analytics Silos In Your Enterprise
summary
Apache Lens provides a unified OLAP cube abstraction over Hadoop and columnar warehouses, with metadata stored in Hive metastore and a driver API that plugs engines (Hive, JDBC, Spark) for execution. Demo shows a compound query routed to an aggregate in the columnar store returning in ~1s while the Hive path takes ~2.27s, illustrating cost-based engine selection and query rewriting to physical tables. Architecture includes driver-based pluggable connectors and OLAP cube abstraction over multiple storages.
AI-written summary · about
chapters (32)
- 0:00Introduction
- 1:00Typical Enterprise
- 2:00Data Loading
- 3:00Challenges
- 5:00UTM Cycles
- 7:00Data Warehouses
- 13:00Data Science Query
- 14:00Query
- 17:00Data Source
- 18:00Drivers
- 19:00Single Entity Lens
- 20:00Connection
- 21:00Lens Storage
- 22:00Measures
- 23:00Cube
- 25:00Fact Table
- 26:00Time Range
- 28:00Demo
- 30:00Sales Cube
- 31:00Customer City
- 32:00Delivery City
- 33:00Aggregated Facts
- 40:00Road Map
- 41:00Throttling
- 42:00Service Scheduler
- 43:00Query Output
- 46:00Simple UI
- 47:00Unifying Stores
- 48:00Query Interface
- 49:00Date Range
- 50:00Driver Estimate
- 51:00Data Injection
related talks
39mAccelerate big data analytics with Apache Kylin
14mAn introduction to Apache Kylin Business Intelligence ...
02h 05mBig Data and the Data Lake from the Analyst Perspective
07mIn-Hadoop Analytics: Bringing analytics to big data
11mBreaking Data Silos: Enterprise Data Management
20mData Caching for Enterprise-Grade Petabyte-Scale OLAP
24mData Mesh and Lakehouse
29mRealtime Analytics Unleashed: Unlocking the Potential of Data at Scale