Fast Data at ING
summary
ING builds a production streaming data platform using Apache Flink and Kafka that delivers actionable notifications and fraud detection. The platform processes roughly 0.5M events/sec with latency under 50ms in tests and meets operational targets of subsecond decisions for transactions. Flink CEP, sliding windows and online scoring run PMML models inside Flink; models are produced offline today and loaded at runtime via a Kafka control stream using a simple PMML models interoperability approach. Continuous retraining is planned.
AI-written summary · about
chapters (7)
- 0:00Introduction and background
- 10:16Building the streaming platform
- 22:54Fraud detection with Flink
- 26:04Actionable financial insights
- 31:27Why Flink at ING
- 38:14Future ambitions and summary
- 40:01Q&A session
related talks
43mDevOps at ING Analytics
25mData: Moving with the flow
51mReal Time Investment Alerts using Apache Kafka & Spring Kafka at ING Bank
45mApache Flink — Real-Time Data Processing
41mBeyond the Hype: When Apache Flink Solves Real Problems
27mArchitecting Sub-Second Analytics Pipelines
50mData Science in the Enterprise
57mEmergence of Real-Time Analytics: Real-time Analysis of...
