Interactive data integration with Glue
summary
AWS Glue Interactive Sessions spins up a serverless Spark in seconds so first query often lands under a minute, each session gets dedicated workers for predictable performance, and idle sessions auto-terminate. Billing is per-second billing (1-minute min). A Jupyter kernel is available and open-source Jupyter kernel installs via PyPI; Magics embed Glue config with code, support library installs, SQL magics, streaming, REST APIs, and Glue Studio Notebooks convert notebooks into runnable Glue jobs for production.
AI-written summary · about
chapters (7)
- 0:00Introduction to AWS Glue
- 2:05Data integration challenges
- 4:34The need for interactivity
- 10:48AWS Glue interactive sessions
- 16:18Interactive sessions demo
- 25:01Glue Studio notebooks
- 30:13Application building and summary
related talks
38mUnleashing the serverless data pipelines
16mAutomated Data Analytics
44mOptimize Costs with Serverless Data Integration Using AWS Glue
24mImproving interactive querying experience on Spark SQL
28mML + Big Data: Spark on Amazon SageMaker with Amazon Glue
28mInnovations in AWS analytics: Data processing
28mTurn Data Into Insights
47mConstruyendo Lagos de Datos y Analíticos en AWS + Datos Abiertos