DataEngBytes Panel discussion - Sydney
summary
Panel boils down to practice not platitudes: real claims about running Kafka and building Australia's first Big Data streaming pipeline on AWS, the use of Snowflake and Redshift in government flows for MyService and flood response, and the push toward data mesh and distributed pipelines across domains. Hiring advice lists primary vs secondary skills (architecture and data-crafting first, specific tools second). Several panelists report prototypes and migrations underway, with staffing bootcamps and active recruitment to prove what actually works.
AI-written summary · about
chapters (11)
- 0:00Introduction
- 2:00Dean Carter
- 2:35Ingrid Sola
- 5:50Simon Smith
- 9:50Ingrid
- 10:35Government
- 15:30Requirement conversations
- 17:00Questions
- 19:00Challenges
- 20:20Data Engineers in government
- 24:10Data Engineer Roles
related talks
50mThe future of Data Engineering panel
47mExpert Panel: Current & Future State of the Art in Real-Time Data Infrastructure
51mPanel Debate: Rise Of The Data Engineer
59mPanel: Future of Data Services
31mFuture of data engineering: what's in store?
20mAsk Me Anything Panel Discussion
41mOn Data: Sky above, sand below, peace within
43mData Lake beyond the Buzzword