Basics of cloud computing for data scientists

on YouTube ↗24m

" summary

Claims that basic cloud deployment can be practical for data scientists by showing concrete AWS patterns and trade offs: compute choices (EC2 vs serverless Lambda), storage options (S3, RDS/Aurora, DynamoDB) and monitoring with CloudWatch. Examples include Lambda pulling Docker image from ECR, S3 triggers invoking Lambda and DynamoDB streams triggering downstream Lambda. Notes container orchestration via ECS/EKS, SageMaker endpoints as managed EC2, and emphasizes trade offs like billing by uptime versus execution time.

AI-written summary · about

" chapters (10)

1. 0:00Cloud computing for data scientists
2. 3:14AWS basics
3. 5:01AWS compute options
4. 8:50Containers and orchestration
5. 10:57AWS storage services
6. 14:49Relational databases in AWS
7. 16:59DynamoDB deep dive
8. 18:48Monitoring with CloudWatch
9. 20:33SageMaker lock-in
10. 22:40Emily's use case

" related talks

• 39mFrom Data Science to Production - deploy, scale, enjoy!Sergii Khomenko · PyData Amsterdam 2016
• 40mBest Practices for Deploying Well-Architected, Serverless Python Applications to AWS with CDKKristi Perreault · Python Web Conf 2023
• 31mIntroduction to Data VisualisationJosip Saban · DSC Europe 24
• 39mHow Python Drives Modern Data EngineeringKiana Alessandra Villaera · PyCon Philippines 2023
• 54mServerless Python on AWS Lambda using the Serverless FrameworkTed Mathew dela Cruz · PyCon APAC 2019
• 29mData Science Best Practices : From Proof of Concepts to ProductionYasir Khan · PyCon.DE 2017
• 34mPython in Serverless ArchitecturesDaniel Lindeman · PyOhio 2018
• 29mOrchestrating complex (not complicated) tasks using AWS serverless and PythonMichael Kelly · PyCon AU 2019