Software ISP FOSS Support for MIPI Cameras
summary
A fully open software ISP for MIPI/CSI2 cameras is upstream in libcamera and runs real-time on common x86 laptops at ~30 fps; GPU offload uses GLES2 fragment shaders and reuses existing debayer code to reach line rate once render-to-texture is available. Color correction uses nine multiplications replaced by nine lookup tables to save cycles but lacks a calibrated CCM yet. On smaller SOCs CCM on the CPU can drop to ~2 fps (SM8250) while a Satara board hits ~15 fps. PipeWire integration already enables video calls.
AI-written summary · about
chapters (6)
- 0:00FOSS MIPI camera support
- 4:15MIPI cameras need open ISPs
- 11:36Software ISP development
- 13:44GPU acceleration for ISP
- 26:10White balance and debayering demo
- 30:01Q&A
related talks
34mExtending Libcamera to Provide a Fully Open Camera SoftISP Stack
43mApplication Support with Libcamera
41mLearn How to Support Your SoC and ISP in Libcamera
49mAdvanced Camera Support on Allwinner SoCs with Mainline Linux
48mGiving Linux a Camera Stack: libcamera's 3 Years Journey and Exciting Future
27mBoF: Cameras on Linux
28mCamera Applications with Libcamera and PipeWire
43mApplication support with libcamera