Extending Libcamera to Provide a Fully Open Camera SoftISP Stack
summary
A SoftISP prototype turns raw Bayer frames into a usable webcam stream by implementing CPU debayer + 3A + sensor tuning inside libcamera, exposing framebuffers to userspace and routing them through PipeWire integration to browsers. Current CPU code hits ~14 FPS in debug and ~30 FPS in release on powerful Qualcomm/Intel laptops but drops to ~2 FPS on an older i.MX8 for a 4K sensor, so work moves toward GPU compute shaders (OpenGL ES → Vulkan) and DMA/uncached buffer handling to reach practical performance; libcamera v0.3 depends on merging the CPU ISP.
AI-written summary · about
chapters (11)
- 0:00Introduction
- 1:54Bayer encoding importance
- 7:37Hardware ISP limitations
- 12:17Need for open SoftISP
- 15:12Libcamera and PipeWire integration
- 20:11CPU SoftISP performance
- 23:48GPU acceleration for SoftISP
- 26:41Live demo and CPU analysis
- 30:36Q&A: Implementation
- 32:30Q&A: Vector processing
- 33:55Closing
related talks
42mSoftware ISP FOSS Support for MIPI Cameras
43mApplication Support with Libcamera
28mCamera Applications with Libcamera and PipeWire
25mLibcamera: Making Complex Cameras Easy
43mApplication support with libcamera
41mLearn How to Support Your SoC and ISP in Libcamera
46mWhy Embedded Cameras are Difficult, and How to Make Them Easy
29mComposite Video Device Abstraction for Libcamera