Spatial computing with React
summary
Fork of React Native targets visionOS, adding a Window Manager API so multiple windows share one JavaScript thread and routes instead of separate apps, plus an XR session API modeled on the web spec so immersive spaces can hand control to native Swift renders. Uses React Native Gesture Handler and Reanimated to rotate and animate 3D models entirely in JavaScript, hits expected runtime errors during porting but runs in the Apple simulator, ships the open source retive-vision-os implementation day one, and contributes fixes to Hermes, macOS and tvOS for compatibility.
AI-written summary · about
chapters (10)
- 0:00Introduction to spatial computing
- 1:31React and spatial computing potential
- 4:30React Native for visionOS approach
- 7:20Hand and eye tracking integration
- 8:45Multi-window support in visionOS
- 10:13Immersive content and XR API
- 11:43Demo of React Native visionOS app
- 16:28Project outcomes and contributions
- 17:15How to start building today
- 18:42Acknowledgments and thanks
related talks
29mIt all starts with navigation
30mReact, Meet Virtual Reality
26mDeveloping Immersive cross-platform AR and VR Apps using React-Native
39mThe use cases and practices of spatial computing in enterprises
32mReact A Romance of Many Dimensions
29mJourney Through VR and AR with React
36mBlasting React into Space: Building fluid interface swith React and WebGL
26mAugmented Reality with React Native — a Medium Worth to Bridge?