Processing OpenShift 4 health data at scale

on YouTube ↗24m

" summary

Covers the architecture used to ingest and process continuous health telemetry from thousands of OpenShift 4 clusters for Red Hat Insights, focusing on scalable, stable components and orchestration that ensure timely processing and no data loss. Names OpenShift 4 and Red Hat Insights and addresses end-to-end pipeline concerns from ingestion through analysis and presentation of customer analytics.

AI-written summary · about

" chapters (6)

1. 0:00Start
2. 0:03Red Hat Insights
3. 5:15Processing pipeline architecture
4. 7:10Processed data
5. 11:213633 events per hour
6. 16:35Possible speedup

" related talks

• 25mSecure Large-Scale Data Analysis and AI with Polyglot Data SourcesTushar Katarki, Buck Woody · Global Artificial Intelligence Conference 2020
• 08mRed Hat's expansion into dataGreg Kleiman · Strata + Hadoop World Conference in Barcelona 2014
• 31mTowards an open operations data communityAakanksha Duggal, Oindrilla Chatterjee · OpenInfra Summit Berlin 2022
• 14mAlejandro Lopez Osornio, Argentine Ministry of Health | Red Hat Summit 2020Alejandro Lopez Osornio · Red Hat Summit 2020 Virtual Experience
• 24mUncovering Community and Project Insights Through Data Driven MethodsOindrilla Chatterjee · Community Leadership Conference @ Open Source Summit Europe 2022
• 34mTransforming Data Processing with Kubernetes: Journey Towards a Self-Serve Data MeshRakesh Subramanian Suresh, Jainik Vora · Data on Kubernetes Day North America 2023
• 42mIngestion at Scale: Open Source Pipelines for Getting Data Into Open...Anurag Gupta, Kevin Fallis · OpenSearchCon North America 2025
• 45mBuilding an Analytics PlatformJeff Klukas · PyOhio 2016