AWS Pi Week 2021
as the organisers put it
AWS Pi Week will take you back in time as we review the history of AWS and the key decisions involved in the building and evolution of Amazon S3. We’ll pay homage to S3 and highlight the most recent features to help you move more workloads to AWS.
| title | author | length |
|---|---|---|
| 15 years of Amazon S3 - Foundations of Cloud Infrastructure | Werner Vogels, Mai-Lan Tomsen Bukovec | 04m |
Celebrating 15 years since S3 launched in 2006 the talk gives concrete scale and engineering choices: S3 runs 100+ trillion objects with peaks of tens of… | ||
| 15 years of Amazon S3 - Accelerating Data Movement | Werner Vogels, Bill Vass | 06m |
Fifteen years of Amazon S3 shows concrete changes: physical appliances from Snowcone to Snowball Edge to the truck-sized Snowmobile, plus network tools like… | ||
| 15 years of Amazon S3 - Security is Job Zero | Werner Vogels, ERIC BRANDWINE | 07m |
Celebrates 15 years of S3 and claims security as "job zero" with concrete controls: new buckets are private by default and offer block public access plus… | ||
| 15 years of Amazon S3 - Building an Evolvable System | Werner Vogels, Mai-Lan Tomsen Bukovec | 07m |
S3 claims a 15‑year evolution from simple object storage to a platform powering tens of thousands of data lakes and hosting petabytes of imagery, audio… | ||
| Beyond eleven nines - How Amazon S3 is built for durability | Andy Warfield, Seth Markle | 21m |
Amazon S3 aims for eleven nines of durability by baking risk thinking into engineering culture via a formal durability review: a written threat model discussed… | ||
| Architecting for high availability on Amazon S3 | Eno Thereska | 28m |
Amazon S3 claims multi‑decade, multi‑region availability at scale — over 15 years, hundreds of trillions of objects, across 20+ regions and 60+ availability… | ||
| Back to the basics: Getting started with Amazon S3 | Matthew Sidley | 22m |
Amazon S3 stores objects across at least three availability zones and claims 11 nines durability while regional storage waits for cross‑AZ writes before… | ||
| Amazon S3 foundations: Best practices for Amazon S3 | Adnan Pandjou | 30m |
Concrete operating advice for Amazon S3: pick storage classes by access pattern—S3 Standard‑IA saves up to 40% versus Standard and Intelligent‑Tiering now… | ||
| Amazon S3 storage classes primer | Alex Crabbe | 19m |
Overview of the seven S3 storage classes with concrete tradeoffs and numbers: 99.99% availability and eleven nines durability for long term storage… | ||
| Optimize and manage data on Amazon S3 | Souvik Bhattacharya | 21m |
Social media–scale case study: a customer ingests billions of small events daily into an S3 data lake (petabytes) using Kinesis Firehose, batches events to… | ||
| Amazon S3 Replication: For data protection & application acceleration | Bijeta Chakraborty | 16m |
Amazon S3 replication automatically copies objects between buckets, preserves original metadata and version IDs, and can replicate to multiple destinations… | ||
| Backup to Amazon S3 and Amazon S3 Glacier | Mark Kalus | 15m |
Amazon S3 and S3 Glacier promise cloud backup with measurable tradeoffs: 11 nines durability across three+ AZs, global scale (exabytes stored, trillions of… | ||
| Building modern data lakes on Amazon S3 | Sean White | 19m |
Amazon recommends building a lake on S3 with 11 nines durability and seven storage classes plus S3 Intelligent‑Tiering, then running analytics with Amazon S3 +… | ||
| Harness the power of your data with the AWS Lake House Architecture | Mehul Shah | 30m |
AWS Lake Formation gives S3 data lakes govern tables with metadata manifests so updates move only metadata not petabytes, supports ACID transactions… | ||
| Amazon S3 Strong Consistency | Vishwas Narendra, Serdar Tasiran, Ankush Desai | 27m |
Amazon S3 now guarantees strong read‑after‑write consistency for all operations with no change in price, performance, or regional isolation, across exabytes of… | ||
| Breakdown data silos - Build a data lake on Amazon S3 | Devabrat Kumar | 16m |
Amazon S3 claims 11 nines durability and hosts tens of thousands of data lakes while offering 17 ingestion methods including Snowball, Snowmobile and DataSync… | ||
| Modernizing your data archive with Amazon S3 Glacier | Matt Jordan | 16m |
Modern archival options on Amazon S3 balance cost, durability and restore latency: S3 Glacier Deep Archive at $0.00099/GB‑month (~$1/TB‑month) offers 11‑nines… | ||
| Accelerating your migration to Amazon S3 | Jeff Bartley | 27m |
AWS Storage Gateway provides volume, file and tape interfaces (VM, EC2 or hardware) that cache locally while persisting to S3, and AWS DataSync moves data… | ||
| How to be successful in lift and shift migrations | Ryan Sayre | 25m |
Practical checklist and proven numbers: use CloudEndure for block‑level replication and near‑zero downtime migrations (free to AWS customers), choose EBS… | ||
| Move to fully managed file storage with AWS file solutions | David Stein | 25m |
Overview of AWS file solutions with concrete claims and costs: Amazon EFS offers one-zone and multi-AZ tiers, lifecycle infrequent access and 1.33¢/GB month… | ||
| Managed file transfers to Amazon S3 and EFS over SFTP, FTPS, and FTP | Smitha Sriram | 27m |
Managed service that routes files over supports SFTP, FTPS, FTP into AWS storage, with identity plugged via Lambda+API Gateway and optional BYO host keys, IPs… | ||
| Foundations of data security | Becky Weiss | 19m |
Overview of concrete S3 controls and recent launches: shows a live demo of Block Public Access and explains its account-wide enforcement, describes the new IAM… | ||
| Securing Amazon S3 with guardrails and fine-grained access controls | Becky Weiss | 38m |
S3 defaults to private and AWS layers perimeter and fine-grained controls: Block Public Access (2018) prevents accidental public buckets, principal org id and… | ||
| S3 Block Public Access overview and demo | Becky Weiss | 19m |
Live demo walks through a bucket without Block Public Access, adds a bucket policy to share with another AWS account, flips on S3 Block Public Access and… | ||
| Managing access to your Amazon S3 buckets and objects | Raymond Lui | 19m |
Explains concrete controls for S3 access: IAM policy vs bucket policy with JSON examples, two new condition keys s3:ResourceAccount and s3:tls-version (example… | ||
| Protecting your data in Amazon S3 | Shakhi Hali | 26m |
Overview of concrete S3 protections and tradeoffs: explains envelope encryption with AWS KMS and how S3 issues per-object data keys, introduces S3 Bucket Keys… | ||
| Advanced networking with Amazon S3 and AWS PrivateLink | Piyush Kundra | 21m |
Gateway-style VPC endpoints (launched 2015) route S3 traffic via routing table entries and gateway endpoints are free, but they don’t support on‑prem or… | ||
| Demo - Amazon S3 and VPC Endpoints | Piyush Kundra | 09m |
Demo shows how to create a gateway VPC endpoint and an interface VPC endpoint for S3, attach an endpoint policy using the S3 resource account condition key… | ||
| Proactively identifying threats & protecting sensitive data in S3 | Himanshu Verma | 27m |
Amazon provides a layered S3 security stack: Amazon Macie discovers sensitive data at scale using managed identifiers and scheduled jobs that scan only… | ||
| Demo - Amazon S3 security posture management and threat detection | Ryan Holland | 06m |
Amazon GuardDuty adds S3 protection (launched July 2020) and can be auto-enabled across Organizations with a 30-day free trial for new accounts; it ingests S3… | ||
| Demo - Monitor your Amazon S3 inventory & identify sensitive data | Ryan Holland | 15m |
Live demo shows how Security Hub, GuardDuty and Amazon Macie integrate to monitor S3 bucket configuration and scan for sensitive data, with delegated-admin… | ||
| Serverless on Amazon S3 - Introducing S3 Object Lambda | Paul Meighan | 17m |
Announces general availability of S3 Object Lambda, a new S3 feature that invokes AWS Lambda during GET requests so code pulls objects from the underlying… | ||
| The best compute for your storage - Amazon S3 & AWS Lambda | James Beswick, Chris Munns | 21m |
S3 invokes Lambda on object events to run code that resizes and composites images, using SAM for deployment, Lambda layers for native libraries, and tools like… | ||
| Live coding - Uploading media to Amazon S3 from web & mobile apps | James Beswick, Chris Munns | 22m |
Live coding shows a serverless pattern that issues a pre-signed PUT URL from an API Gateway→Lambda function and returns it to the client so the browser or… | ||
| Building serverless applications with Amazon S3 | James Beswick, Chris Munns | 25m |
Shows building a serverless app that uses Amazon S3 + Lambda with concrete artifacts: a 37-line SAM template that creates an S3 bucket, a Lambda function and… | ||
| Accelerate data sharing among serverless containers with Amazon EFS | Will Ochandarena | 29m |
Shared Amazon EFS provides a regional, serverless POSIX file system that mounts into Lambda, Fargate and Kubernetes, auto‑scales and supports tens of thousands… | ||
| S3 & Lambda - flexible pattern at the core of serverless applications | James Beswick, Chris Munns | 22m |
Shows concrete S3→Lambda architectures with deployable repos and clear tradeoffs: automatic translation breaks large files into 5,000‑char chunks and supports… | ||
| Demo - S3 Object Lambda | Carl Summers | 19m |
S3 Object Lambda wraps an S3 access point and runs a real Lambda on GET requests to transform objects: a 2 MB CSV (31,415 lines) demo either returns unchanged… | ||
| S3 Object Lambda - add code to Amazon S3 GET requests to process data | Shasya Sharma | 17m |
S3 Object Lambda adds a synchronous Lambda invocation to every S3 GET, passing a pre-signed URL and the original caller identity so the function fetches… | ||
| nothing matches | ||