Real-Time Data Integration
summary
StreamSets integrates with SingleStore and watsonx to provide near-real-time ingestion that scales horizontally, pipelines that claim automatic schema‑drift handling without code changes, and the ability to write simultaneously to an Iceberg-style open table format and to SingleStore for low-latency queries. A Data Gate replicates mainframe data into the distributed store, watsonx offers a prompt lab, fine‑tuning and MLOps plus model inventory and monitoring for governance, and pipelines can enrich data and feed the enriched records back to the lakehouse.
AI-written summary · about
chapters (9)
- 0:00Introduction to IBM data integration
- 1:26StreamSets capabilities overview
- 3:11StreamSets key features and benefits
- 5:17IBM WatsonX AI pillar explained
- 8:05IBM WatsonX data pillar deep dive
- 12:02IBM WatsonX AI operationalization
- 14:13IBM WatsonX governance framework
- 16:20SingleStore and IBM integration
- 19:30Q&A and closing remarks
related talks
14mStreaming Data Pipelines to Enhance Real-Time Decision-Making
27mStream, Store, Visualize: Fast-Track Real-Time Analytics the OSS Way
21mBuilding Data Integration Services In Real Time
31mMaster Constant Change & Drive Agility With DataOps
17mDatabricks LakeFlow: A Unified, Intelligent Solution for Data Engineering
24mBreak Barriers In Real-time With Data Streaming
08mReal-Time Data Systems: Speed, Scale, and Resilience
30mSmart Streams: A Real-time framework for scoring Big and Fast Data