Data Engineering in Practice
summary
Hotmart built its own Analytics platform on a microservices architecture and this talk explains the practical steps taken to create it. It covers the four key areas—data ingestion, transformation, storage, and visualization—and shows how the Analytics platform boosted Hotmart’s maturity and increased user sales, drawing on the team’s lessons and experience.
AI-written summary · about
chapters (10)
- 0:00Hotmart Analytics introduction
- 3:08Platform creation motivations
- 7:32Architecture and best practices
- 10:32Data flow and transformations
- 16:44Real-time processing
- 21:03Data lake storage
- 27:44Spark and Athena transformations
- 33:29Visualization and dashboards
- 35:39Customer benefits
- 39:43Q&A
related talks
32mBuilding a scalable data platform
25m"Data Engineering: The World Between Worlds"
38mUnleashing the Power of Analytics Engineering
33mAnalytics Platform at Petabyte Scale
58mAvito Data Store: Analytics for a Microservices Architecture
49mTransforming Analytical Data with Event-Driven Architecture
25mHyreCar Data Analytics: Pushing the Pedal to the Metal
08mExtracting Knowledge from Data - Case Study