How to Simplify Data Scientist’s Day in Huge Company Using Kubernetes

on YouTube ↗05m

" summary

Shows how IBM built a Data Science Experience (local) on Kubernetes to speed up data analysis, describing concrete ways to use Docker and Kubernetes for data scientists’ daily work. Covers using a cluster environment to develop, test and manage models created in Jupyter, R and Zeppelin notebooks and reviews the analytics team’s requirements for that cluster.

AI-written summary · about

" chapters (7)

1. 0:00Intro
2. 0:12Data scientist's workflow
3. 0:49Create and use services
4. 1:35Create integrated solutions
5. 2:19Use kes to create dynamic infrastructure
6. 3:11Experiments
7. 4:03How to simplify data scientist's day

" related talks

• 39mHow We Hosted 200+ Data Scientists in a K8S ClusterAleksey Kuznetsov, Mikhail Lepeshkin · Saint HighLoad++ 2022
• 34mThe Data Analytics Platform or How to Make Data Science in a Box PossibleKrzysztof Adamski · KubeCon + CloudNativeCon Europe 2019
• 36mBuilding a Scalable Data Science & Machine Learning cloud using KubernetesMurali Paluru · Big Data Conference Europe 2019
• 42mAI – Addressing the Challenges of Today’s Data ScientistsJeff Reser, Alessandro Festa · All Things Open 2020
• 44mEmpowering Data Science with Kubernetes | Samuele Chiocca and Andrea RotaSamuele Chiocca, Andrea Rota · containerday 2020
• 17mProductionizing Data Science WorkloadsAnand Iragavarapu · PyCon India 2020
• 08mScale & Security for Data Workloads on IBM CloudJason McGee · FoundationDB Summit 2019
• 28mDevOps for Data Science With KubernetesSophie Watson · MLconf Online 2020