Getting the most from the new multi-camera API
summary
Demo apps show Android P multi‑camera giving two physical streams from a single logical camera (Pixel 3, Mate 20) and swapping them instantly in one session. Implementation uses CameraCharacteristics → getPhysicalCameraIds, create OutputConfiguration with setPhysicalCameraId, build one SessionConfiguration, then submit capture requests; lens distortion correction OFF when computing stereo depth. Depth maps use OpenCV stereoBM/SGBM + WLS filtering; bokeh works but needs face‑region and GrabCut fixes for shiny highlights and missing eyes.
AI-written summary · about
chapters (30)
- 0:00Intro
- 0:31Your camera apps matter!
- 0:52Update on camera2 API
- 1:33Devices with multi-camera API
- 2:25Multi-camera use cases
- 3:47Multi-camera streams
- 5:211. Find physical cameras (contd.)
- 5:39Get physical camera IDs
- 6:00Open logical camera
- 6:28Create output configurations
- 7:16Session configuration
- 7:584. Create capture session (contd.)
- 8:25Dispatch capture requests
- 9:29Implementing optical zoom
- 11:51Lens distortion (contd.)
- 12:46BasicBokeh demo (Pixel 3)
- 15:19Floating head bokeh
- 15:43FaceDetect
- 16:38Fun background effects
- 17:18Background effects (blur)
- 18:00Crop and feather foreground
- 19:11Double capture
- 22:29Rotation/translation
- 23:21Pixel 3- camera translation
- 24:47Camera characteristics
- 26:30Camera matrix
- 26:47Distortion co-efficients
- 29:47Weighted Least Squares (WLS) filter
- 30:43Mask out background
- 32:58Optimization
related talks
41mCreating delightful camera experiences
31mBuild a universal camera app
42mCamera2 API and beyond
26mCameraX: Portrait of an API
14mWhat's new in Android Camera
35mBuilding Camera Apps on Android Today
47mCamera 2.0: The New Camera Hardware Interface in Android 4.2
09mYour Camera app on different form factors