Architecture and Tools for Selected Data Integration Cases (Part 2)
summary
Survey of real-world data integration patterns comparing protocols JDBC, HTTP and S3 and when to use each; evaluation of integration tools Debezium and StreamSets; and cost-saving approaches using Spring REST and PostgREST. Covers strategies for data versioning and audit, presenting practical implementations based on database triggers and Hibernate Envers.
AI-written summary · about
chapters (12)
- 0:00Introduction
- 3:35Integration cases overview
- 7:49Personal account + timepad
- 15:14Personal account + online backend
- 17:41Personal account + analytics
- 19:49REST API for data integration
- 21:56Rate Limit management
- 27:15Parallel job runs and shadlock
- 30:09Cronjobs and limits
- 31:54Job registrar alternative
- 33:18Data audit with Hibernate Envers
- 38:56Summary
related talks
40mThe Changing Face Of ETL: Event-driven Architectures for Data Engineers
41mChange Data Streaming Patterns in Distributed Systems
51mEmpowering Enterprise Architectures with Polyglot Persistence
31mData Unleashed: A Developer's Perspective on Navigating the Architecture Maze
49mBuilding data lakes for your customers
43mAnalytics capabilities architectural patterns: A journey for data-driven insights
29mEvent-First Thinking: Building Data-Driven Integration Architectures
13mArchitectural Patterns for Oracle SOA Suite Integration