On-device Video Playback Upsampling

on YouTube ↗18m

" summary

Mobile playback uses Luma-only DL upscaling plus classical filters to cut latency and compute: models undergo pruning and 8‑bit quantization and leverage hardware DSP, yielding end-to-end inference under 10 ms per frame on recent phones. VSR++ shows ~30% higher quality than Lanczos in benchmarks; Lanczos slightly outperforms bicubic. An adaptive policy picks scaler by device health and resolution and integrates with ABR to stream lower‑bitrate encodings while keeping perceived quality, saving cellular data.

AI-written summary · about

" chapters (8)

1. 0:00Video upsampling challenges
2. 1:56Modern upsampling tech overview
3. 4:26Client-side upsampling
4. 6:16Deep learning on mobile
5. 9:06Optimizing models for mobile
6. 12:17Adaptive upsampling strategies
7. 13:21Upsampling with ABR
8. 16:11Summary and future

" related talks

• 10mAdventures with VP9Haixia Shi, Zen Xu · Demuxed 2019
• 11mFrom Artifacts to Art: A Data-Driven Guide to Android Video EncodingKarl Shaffer · Demuxed 2025
• 16mSwift: Adaptive Video Streaming with Layered Neural CodecsMallesham Dasari, Kumara Kahatapitiya, Aruna Balasubramanian, Dimitris Samaras, Samir R. Das · 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI '22)
• 18mScaling AV1 End-to-End Delivery at MetaRyan Lei · Video @Scale Fall 2022
• 17mDelivering better video encodes for legacy devicesMariana Afonso · Demuxed 2020
• 17mPredict, Prune, Play: Efficient Video Playback Optimization Under Device...Mohammad Alizadeh, Pouya Hamadanian, Arash Nasr-Esfahany, Harsha Sharma, Zahaib Akhtar · NSDI '26
• 41m8K Codec Low-Latency Livestreaming, and AI StreamingByeonghun Park, Youngo Park, Jean-Marc Denoual · Samsung Developer Conference 2019
• 23mDecoder Complexity Aware AV1 Encoding OptimizationZoe Liu · Demuxed 2020