Muse Prototype Challenges
summary
A prototype iPad app built for Apple Pencil-only input lets users collect images PDFs and web snippets on nested zoomable boards with cards, a pull-up shelf, and excerpts that keep a live link back to the source via a “wormhole.” Interaction is modeless: finger for nav, pencil for editing, tilt to switch tools. Implementation uses view-controller push/pop animations, GPU snapshots plus a background Core Graphics renderer to keep zooming smooth, but memory and snapshot timing force depth limits (~15–20 boards). Testers use it daily and the team explores turning it into a product.
AI-written summary · about
chapters (7)
- 0:00Introduction and project overview
- 1:06What is Muse app
- 3:15Live demo of Muse
- 8:36Design principles behind Muse
- 14:56Technical challenges in Muse
- 27:05Future of Muse and commercialization
- 30:38Q&A session
related talks
10mPencilKit: From simple drawings to custom creative tools
38mSpark Your Creativity: The Power of iPad Playgrounds
33mMastering Multi-screen iOS Apps
20mTips for Supporting Apple Pencil
32mThe Story of an App and a Hidden Gem of iOS
30mEvolving Existing Projects With SwiftUI
19mPDFKit Basics
44mRecreate some of the classic prototype implementations on visionOS (live code)