Exploring Cloud Native Big Data Platform in SPDB

on YouTube ↗22m

" summary

Describes how Shanghai Pudong Development Bank built a containerized, financial-grade big data platform on Kubernetes to support PB-scale daily growth. Covers using Piraeus for persistent volumes (local-storage optimization, HA, dynamic provisioning, intelligent scheduling), scaling out Hive and Impala executors, and standardizing containerized operation practices for internal big data apps.

AI-written summary · about

" related talks

• 28mProgress For Big Data In KubernetesTed Dunning · Big Data LDN 2018
• 47mFrom a Database in Container to DBaaS on KubernetesPeter Zaitsev · Open Source Summit + Embedded Linux Conference + OSPOCon 2021
• 34mPachyderm: Unlock the Power of Kubernetes for Big DataJoey Zwicker · KubeCon + CloudNativeCon North America 2016
• 24mDynamic Big Data in the Cloud with KubernetesFrank Conrad · Berlin Buzzwords 2019
• 37mCITIC Bank's Containerized Exploration RoadJia Xing · KubeCon + CloudNativeCon China 2019
• 45mFrom Laptop to Cloud: Developing Cloud Native Applications with Containerized DatabasesNicolas Vermande · ContainerCon @ Open Source Summit North America 2022
• 43mSQL Server 2019 Big Data Clusters ArchitectureBuck Woody · SQL Server Virtual Conference 2021
• 26mRe-architecting the Data Platform with Spark on KubernetesSeungYong Oh · Kubernetes Forum Seoul 2019