Video @Scale 2021
who it's for
encoding engineers, streaming engineers, video infrastructure engineers, platform engineers, site reliability engineers, media quality engineers, machine learning researchers
topics
storage lifecycle management for video; media provenance manifests; user generated content quality assessment; low-latency DASH and CMAF; live encoding on Kubernetes; encoder scaling with Eve; good broadcast rate reliability metrics; automatic smart crop and preview; AVQT perceptual video measurement; ASIC and software hybrid encoding; SVT-AV1 CRF and multi-pass VBR; low-bitrate and spatial audio codecs
| title | author | length |
|---|---|---|
| Optimizing Storage Efficiency for FB Video Processing | Jin Zhang, Jamie Chen | 26m |
Facebook standardizes on Source+MVE policy and implements a Video Lifecycle Manager that classifies videos as recent, hot, or cold and takes concrete actions… | ||
| Media Provenance as a Prevention for Malicious Synthetic Media | Andrew Jenks | 28m |
Malicious synthetic media includes both deepfakes and cheapfakes; creation tools move from a $20,000 Photoshop-era workflow to $24-per-month subscriptions… | ||
| Video Quality Assessment of User Generated Contents | Balu Adsumilli, Yilin Wang | 30m |
YouTube releases YT-UGC, ~1,500 raw uploads with MOS/DMOS and 600+ content labels, and trains a deep model called YouVQ that claims higher correlation to human… | ||
| Performance of Low-Latency DASH/CMAF and Low-Latency HLS Systems | Yuriy Reznik | 27m |
Experimental systems use FFmpeg + Apple HLS tools for LL‑HLS, Node.js DASH and DASH.js variants for LL‑DASH, and Mahi‑Mahi traces from Verizon (1.3 Mbps avg)… | ||
| Highly Available Live Encoding Using Go and Kubernetes | Justin Mason | 23m |
Built a containerized live transcoder using Go for control, a C++ libtranscoder for heavy CPU work, and libSRT for UDP ingest running on Kubernetes (EKS) with… | ||
| Scaling Your Encoding Backend Using Eve | Ronald S. Bultje | 19m |
Eve (Two Orioles) VP9 and AV1 encoder claims actual results: at slow presets it delivers about 10–30% BD‑rate gains versus libvpx and matches x265 quality… | ||
| Measuring the Reliability of Live Video Infrastructure | Petar Zuljevic | 24m |
Facebook Live defines an end-to-end reliability metric called good broadcast rate that classifies each broadcast as good or bad using real-time tracing with a… | ||
| Smart Crop and Smart Preview via Video Understanding | David Liu, Priyam Chatterjee | 40m |
Automatic reframing converts 16:9 videos to 1:1 or 4:5 inside Creator Studio, processing thousands of videos and centering the main subject using a saliency… | ||
| Measuring Video Quality Using AVQT | Pranav Sodhani | 25m |
MeAVQT is a macOS command-line tool that estimates perceptual quality by comparing a reference and a compressed video using AVFoundation for formats and Metal… | ||
| ASIC-RDX and Compute-Compression Efficiency Optimization for UGC Video Processing | Shankar Regunathan, Srinath Reddy | 24m |
Facebook deploys a hybrid ASIC–software RDX pipeline that runs an ASIC in L1 and software or ASIC encoders in L2, achieving production gains: prior RDX showed… | ||
| Highly-Efficient SVT-AV1-based Solutions for VOD Applications | Nader Mahdi, Amir Naghdinezhad, Hassene Tmar | 27m |
SVT-AV1 adds CRF and multi-pass VBR modes with a three-pass VBR (fast IPP, CRF-like middle, final) and TPL-based QP modulation, evaluated on the elfuente… | ||
| The Importance of Audio Live Panel | Mana Aynechi, Ioannis Katsavounidis, Alejandro Luebs, Will Wolcott | 27m |
Panelists describe concrete advances: an open source C++ Lyra codec that runs in real time on midrange phones, Lyra 3 kbps ≈ Opus 8, and a new Soundstream… | ||
| Keynote | Paresh Rajwat | 07m |
Video now accounts for 50 percent of time on the app and is projected to be 79 percent of mobile traffic by end of 2022, with time spent up 22% year over year… | ||
| Behind the Curtains: A/B Tests in Video Land | Vineeth Madhusudanan | 27m |
Short-form video quality improvements increase engagement even when upload latency and failures initially worsen, forcing investment to fix reliability; a… | ||
| nothing matches | ||