Exploring Real-Time 3D in Flutter
summary
Gaussian Splatting brings a differentiable, explicit 3D representation into Flutter by encoding each Gaussian into five texels, sorting them per-frame with a radix sort in an isolate, then splatting each Gaussian as four vertices in the vertex shader and shading view‑dependent color with spherical harmonics. The pipeline uses ANGLE for GPU access, COLMAP for camera poses and brush-cli for training, runs in real time on mobile in demos (toy car, restaurant menus, Google Maps immersive) and integrates with Flutter widgets.
AI-written summary · about
chapters (14)
- 0:00Real-time 3D in Flutter
- 0:20Classical 3D rendering limits
- 1:24Novel view synthesis & ML
- 3:31Radiance fields & implicit rep
- 6:49Gaussian splatting fast render
- 8:56Gaussian splatting in Flutter
- 10:21GPU data prep for Gaussians
- 11:47Sorting Gaussians & GPU pipeline
- 13:15Vertex shader & splatting
- 14:19Fragment shader & final render
- 15:223D integration in Flutter
- 16:28Training Gaussian splats
- 17:52Gaussian splatting real apps
- 18:56Conclusion & future
related talks
28mFragment Shaders In Flutter: A whole new World
40mImplementing custom fragment shaders
32mCode Meets Art: Flutter for Creative Coding
43mPortable Material: Flutter physical models
31mWelcome to 3D
32mEnhance your Flutter painting skills
33mApplying Matrix4 Transformations in Flutter
23mAdd a third dimension to your embedded development with Qt 3D