Customizing Your Real Time Video on Android (Code Lab)
summary
Shows how Twilio’s WebRTC Android library wires custom VideoCapture implementations into Chromium’s stack, using camera capture, MediaProjectionManager (API 21) for full-screen capture, and a view-capture running at ~10 fps. Explains the three-method capture interface (getSupportedFormats, startCapture, stopCapture), how addLocalVideoTrack triggers start and onFrameCaptured feeds frames, and a snapshot renderer that converts I420→YUV→JPEG→Bitmap (then applies rotation). Demonstrates dynamic add/remove of tracks, reusing one local media across multiple rooms, and a developer preview at twilio.com/video.
AI-written summary · about
chapters (10)
- 0:00Introduction to Twilio Video
- 2:46Real-time video basics
- 5:39Customizing local media captures
- 10:37Screen capture demo
- 13:51View capture for apps
- 18:13Building custom video capture
- 20:23Rendering video frames
- 22:33Custom image processing renderer
- 25:44Leveraging local media flexibly
- 26:49Recap and next steps
related talks
44mBuilding an ML-powered Android Live-streaming App
26mReal-time Audio Streaming Dreams with ReactNative and Kotlin
20mReact and WebRTC - Real-time communication on mobile
38mReal-time Communication on Mobile
24mWebRTC on Android. Simplier than you thought!
58mRealtime Communication with WebRTC
44mSeamless mobile real-time communication with WebRTC
36mWebRTC Use Cases