Looking Beyond Traditional Testing: Introducing VR-Eye, a Unity and Flutter Application for AMD Pro
summary
Proof of concept VR-Eye is a Flutter front end that embeds Unity via flutter_unity_widget to run VR vision tests on a phone in a cardboard headset, designed to let AMD and diabetic retinopathy patients self‑monitor at home for a condition affecting ~300 million people. Speech control runs offline using VOSK in Unity for simple commands and Whisper (whisper‑dart + whisper‑cpp) for accurate transcription of recorded voice tests; results and audio files store locally, no server required. CI builds use Azure DevOps and required custom macOS agents.
AI-written summary · about
chapters (8)
- 0:00Introduction to VR-Eye
- 1:53AMD and diabetic retinopathy challenge
- 3:43Home-based VR eye testing solution
- 5:51Flutter and Unity integration
- 9:25Speech recognition in Unity
- 10:29Whisper integration for tests
- 13:01CI/CD setup with Azure DevOps
- 15:11Useful resources and conclusion
related talks
47mDesigning Reality: How Immersive Technologies Are Shaping the Future of Human Experience
21mPro-tips for Mobile VR Production Workflows
31mNo prescription required
47mKeynote: How VR, AR, MR and XR are changing the world
37mThe next frontier WebGL and WebVR
24mThe future of AR, VR and Mixed Reality
45mThe future of XR authoring:
29mUFH Environment Grant winners conversation