Giving agents hands and eyes in React Native
summary
Agents gain runtime sight and touch via Rosenite and agent device so they can inspect MMKV and AsyncStorage and SQLite and Zustand and Redux, run profiling and heap snapshots, and interact with simulators using the accessibility tree to tap swipe and take screenshots. Cloud agents connect to remote Mac minis or emulators, record flows into an AD file for deterministic replay, and autonomously reproduce, diagnose, update broken locators, and verify fixes.
AI-written summary · about
chapters (11)
- 0:00Introduction
- 1:35Agents need app visibility
- 3:01Agent testing limits
- 6:16Rosite for insights
- 9:07Agent Device for UI
- 11:56Scaling agents to cloud
- 13:42Rosite and Agent Device
- 15:51Autonomous bug reproduction
- 16:36Agent Device Replay
- 18:40Agent challenges
- 21:32Resources and closing
related talks
18mCloud agents that test mobile apps on real devices
35mWeb-Like Development and Release Agility for React Native
23mReimagining Mobile App Testing with Vision AI-Powered Agents
30mBuilding Smarter Mobile Apps with On-device AI Agents & GraphRAG
28mDebugging and Beyond with Reactotron
13mRe-architecting the ElevenAgents SDK for React Native
40mReact Native is Coming – the story of hybrid mobile application testing
11mTips for Building Successful React Native Apps