Interview

on YouTube ↗10m

" summary

Works at Nasdaq managing data flow and big SQL pipelines and describes building an integration layer between two frameworks in a single collaborative session, producing a usable adapter that connects Quill with Doobie and lets existing SQL code move into modern pipelines that push terabytes for regulatory reporting. Emphasizes open source for correct abstractions, mixing proprietary stacks with Kubernetes/DevOps, reactive and messaging layers, and recommends adding a conference hackathon to accelerate small, practical integrations.

AI-written summary · about

" chapters (6)

1. 0:00Introduction
2. 1:27Memes
3. 3:06Big Data
4. 5:29Apache
5. 5:56Integration
6. 8:39Scale By The Bay

" related talks

• 04mInterviewArtem Aliev · Scale By the Bay 2017
• 08mInterviewArun Gupta · Devoxx Belgium 2015
• 04mThayne McCombs InterviewAlexy Khrabrov, Thayne McCombs · Scale By the Bay 2017
• 31mData Unleashed: A Developer's Perspective on Navigating the Architecture MazeBronwen Zande · RubyConf AU 2024
• 41mModern Data Stack: Optimising and Scaling Data in a Tech CompanyNacho Aranguren · PyData Yerevan 2022
• 32mCloud-Native Data: What is it? - Majors, Dunlap, O’Grady, Richardson, DrewitzCharity Majors, Drewitz, Brian Dunlap, Steve O’Grady, Timmy Richardson · SpringOne Platform 2017
• 01h 01mCurrent Methods for Building Data PipelinesElena Lazovik, Antonio Murgia, Yingjun Wu, Ravi Bhatt, Bongani Shongwe · Big Data Conference Europe 2023
• 27mDave Stokes talks open - Stocking the flames of open source - Episode 1Dave Stokes · Percona Live 2022