Enhancing Cross-Device Interaction Scripting with Interactive Illustrations
summary
DemoScript parses Weave scripts into an AST, auto-generates a step-by-step cross-device storyboard and a device library, lets developers edit code by dragging storyboard blocks and select devices by example, and supports scripting-by-demonstration to inject inferred selectors. The prototype runs inside an IDE and maps code to concrete phone/tablet/watch visuals; an 8-programmer lab shows it surfaces mismatched event ordering and wrong device selections and significantly improves debugging speed and comprehension versus a text+emulator baseline.
AI-written summary · about
chapters (8)
- 0:00Introduction and motivation
- 1:53Prior work on cross-device tools
- 4:01DemoScript approach overview
- 6:49Real-time interaction visualization
- 9:37Scripting by demonstration
- 11:01User study and evaluation
- 13:50Future opportunities and applications
- 14:11Conclusion and Q&A
related talks
49mClojureScript: Fun and productive web development with next level tooling
34mA conceptual future for the multi-device web
20mWebstrates: Shareable Dynamic Media
21mCodestrates: Literate Computing with Webstrates
48mMobile debugging
32mWhy don’t browser dev tools understand your code?
25mSagascript - JS at the forefront of emerging storytelling
18mExploring alternative interactions in JavaScript