Data on Kubernetes Day Europe 2024
2024-03-19
Paris, France
[Data on Kubernetes Day Europe 2024, Data on Kubernetes Day Europe 2025, Data on Kubernetes Day Europe 2026]
as the organisers put it
DoK Day @ KubeCon Paris - Data on Kubernetes Community | Data on Kubernetes Community
who it's for
data engineers, platform engineers, database administrators, kubernetes operators, site reliability engineers, machine learning engineers, cloud infrastructure engineers
topics
metadata-driven ML platform; Presto + Apache Iceberg; Kubeflow Pipelines; CloudNativePG operator; Postgres synchronous replica; CRIU-based GPU checkpointing; WAL archive to object stores; GitOps with Argo CD and Flux; asset-based lineage with Dagster; CSI-FUSE for object stores; Alluxio-like distributed cache; KRaft Kafka migration (Strimzi)
| title | author | length |
|---|---|---|
| Welcome + Opening Remarks | Paul Au, Sheetal Joshi | 10m |
Community update on growth and resources since 2020: the group runs monthly town halls, a DO SIG that meets every other week, and a new resource library and… | ||
| Discover How to Create Your Own Metadata-Driven ML Platform from Scratch | Ted Chang, Yihong Wang | 33m |
Metadata-driven ML platform implemented on Kubernetes combines Presto + Apache Iceberg for an open lakehouse and Kubeflow Pipelines for orchestration, plus… | ||
| From Zero to Hero: Scaling Postgres in Kubernetes Using the Power of... | Gabriele Bartolini | 27m |
Shows how CloudNativePG operator runs PostgreSQL on Kubernetes with one primary and two replicas, supports a synchronous replica option, and exposes Prometheus… | ||
| Lightning Talk: Enabling Hot Restart of Stateful Applications Including GPU-Accelerate... | Bernie Wu | 11m |
A Kubernetes operator implements transparent CPU+GPU checkpoint/restore by extending CRIU-based operator workflows and an NVIDIA CUDA utility to dump device… | ||
| Lightning Talk: My Database Runs on Kubernetes. What's Next? Data Platforms! | Robert Hodges | 07m |
Databases run reliably on Kubernetes now, so the next step is building data platforms that replace costly cloud services by composing operators, GitOps, and… | ||
| Lightning Talk: Ditching Data Pipelines: why treating Data as Assets is the best... | Andrea Giardini | 05m |
Argues that replacing step-by-step pipelines with asset-based lineage simplifies modern cloud data platforms, claiming Dagster infers dependencies just by… | ||
| Lessons Learned from Building a Database Operator | Rajdeep Das, Sebastian Łaskawiec | 25m |
A Kubernetes operator that runs MongoDB is presented with a control plane (ops manager + operator) and a data plane (mongod + sidecar agent); the agent renders… | ||
| Advanced CSI-FUSE Filesystem for AI/ML Data Management in Kubernetes | Lu Qiu | 20m |
Compares two concrete approaches: CSI-FUSE (mounts cloud object stores as local filesystems) and an etcd-backed FSB (a lightweight Python filesystem API… | ||
| Cloud-Native Dataspaces: Experiences from the German Research Data Ecosystem | Sebastian Beyvers | 26m |
Cloud-native dataspaces for the German research ecosystem use Kubernetes per domain with S3 as lingua franca for data exchange, a decentralized metadata DB… | ||
| Released From the Cage: Apache Kafka Without Its ZooKeeper | Jakub Scholz | 26m |
Apache Kafka replaces ZooKeeper with KRaft (Kafka Raft protocol) and Strimzi adds support by introducing Kafka node pools and abandoning StatefulSets to manage… | ||
| Closing Remarks | Melissa Logan, Paul Au | 03m |
Community ambassadors are on site and several — Robert and Gabrielle among them — are available for questions, and recent blog posts from the group appear in… | ||
| nothing matches | ||