UIST 2020
| title | author | length |
|---|---|---|
| Geno: A Developer Tool for Authoring Multimodal Interaction on Existing Web Applications | Ritam Jyoti Sarmah, Yunpeng Ding, Di Wang, Cheuk Yin Phipson Lee, Cheuk Yin Phipson Lee, Toby Jia-Jun Li, Toby Li, Xiang 'Anthony' Chen | 10m |
Geno is a JavaScript/Electron IDE that trains a Rasa-backed language model and uses the WebSpeech API to add voice commands to existing web apps by mapping… | ||
| Design Adjectives: A Framework for Interactive Model-Guided Exploration of Parameterized Design ... | Evan Shimizu, Matthew David Fisher, Sylvain Paris, James McCann, Kayvon Fatahalian | 11m |
A domain-agnostic framework maps bounded parameter spaces to a learned intent model that runs interactively and learns from a few labeled examples using… | ||
| Reactive Video: Adaptive Video Playback Based on User Motion for Supporting Physical Activity | Christopher Clarke, Doga Cavdir, Patrick Chiu, Laurent Denoue, Don Kimber | 14m |
System synchronises existing exercise videos to a user’s motion in real time, using OpenPose for instructor skeletons and a Microsoft Kinect for live capture… | ||
| Omni: Volumetric Sensing and Actuation of Passive Magnetic Tools for Dynamic Haptic Feedback | Thomas Langerak, Juan Zarate, Juan Jose Zarate, David Lindlbauer, Christian Holz, Otmar Hilliges | 11m |
A self-contained bench-sized device tracks and pushes a passive handheld tool that contains only a small permanent magnet, using an iron-core 3 DoF spherical… | ||
| FileWeaver: Flexible File Management with Automatic Dependency Tracking | Julien Gori, Han L. Han, Han Han, Michel Beaudouin-Lafon | 15m |
FileWeaver is a desktop file manager that automatically detects and updates file dependencies using strace to record file I/O and stores content under git in a… | ||
| Mesh: Scaffolding Comparison Tables for Online Decision Making | Joseph Chee Chang, Nathan Hahn, Aniket Kittur | 15m |
Mesh is a Chrome extension that scaffolds comparison tables by importing open Amazon tabs and additional URLs, fetching reviews that mention each criterion and… | ||
| B2: Bridging Code and Interactive Visualization in Computational Notebooks | Yifan Wu, Joseph M. Hellerstein, Arvind Satyanarayan | 14m |
B2 instruments data frames to track queries and automatically synthesizes visualizations into a dashboard that mirrors notebook provenance, reifies… | ||
| CoVR: A Large-Scale Force-Feedback Robotic Interface for Non-Deterministic Scenarios in VR | Elodie Bouzbib, Gilles Bailly, Sinan D Haliyo, Sinan Haliyo, Pascal Frey | 15m |
CoVR is a ceiling-mounted XY Cartesian robot with a movable column that delivers up to 100 N kinesthetic feedback, carries up to 80 kg, and overlays physical… | ||
| Augmenting Physical Buttons with Vibrotactile Feedback for Programmable Feels | Chaeyong Park, Jinhyuk Yoon, Seungjae Oh, Seungmoon Choi | 15m |
Uses a linear mechanical switch plus a vibrotactile actuator to produce 40 vibration waveforms (varying frequency, amplitude, duration and envelope, timed to… | ||
| TelemetRing: A Batteryless and Wireless Ring-shaped Keyboard using Passive Inductive Telemetry | Ryo Takahashi, Masaaki Fukumoto, Changyo Han, Takuya Sasatani, Yoshiaki Narusue, Yoshihiro Kawahara | 13m |
A batteryless and wireless ring-shaped keyboard is built: five ring sensor coils (each a 6 g, 3.5 cm3 coil with a piezo and varactor) and a wristband readout… | ||
| C-Face: Continuously reconstructing facial expressions by deep learning contours of the face ... | Tuochao Chen, Benjamin Steeper, Kinan Alsheikh, Songyun Tao, François Guimbretière, Cheng Zhang | 15m |
Ear-mounted RGB cameras embedded into headphones and earphones capture facial contour silhouettes and a CNN regresses 42 landmarks (mouth, eyes, eyebrows)… | ||
| Autocomplete Animated Sculpting | Mengqi Peng, Li-Yi Wei, Rubaiat Habib Kazi, Vladimir Kim, Vladimir Kim | 14m |
A unified keyframe sculpting system autocompletes brush strokes and in-betweens by deforming recorded strokes from prior frames using a deformation-based… | ||
| Back-Hand-Pose: 3D Hand Pose Estimation for a Wrist-worn Camera via Dorsum Deformation Network | Erwin Wu, Ye Yuan, Hui-Shyong Yeo, Aaron J Quigley, Hideki Koike, Kris M. Kitani | 14m |
A wrist-mounted fisheye RGB prototype uses a two-stream ResNet18 + LSTM Kalman pipeline called DorsalNet that regresses a 19D finger representation from RGB… | ||
| Skyline: Interactive In-Editor Computational Performance Profiling for Deep Neural Network Training | Geoffrey X. Yu, Tovi Grossman, Gennady Pekhimenko | 14m |
Skyline is an interactive in-editor profiler implemented as an Atom plugin for PyTorch that builds empirical models predicting throughput and GPU memory versus… | ||
| KnitGIST: A Programming Synthesis Toolkit for Generating Functional Machine-Knitting Textures | Megan Hofmann, Jennifer Mankoff, Scott E. Hudson | 10m |
KnitGIST is a program-synthesis pipeline that generates machine-knittable KnitSpeak programs from high-level objectives by mapping weighted objectives (curl… | ||
| PolicyKit: Building Governance in Online Communities | Amy Zhang, Amy X. Zhang, Grant Hugh, Michael S. Bernstein | 14m |
PolicyKit is a working infrastructure that replaces static roles with executable procedures: policies are Python scripts that run continuously, intercept… | ||
| GyroSuite: General-Purpose Interactions for Handheld Perspective Corrected Displays | Thibault Louis, Jocelyne Troccaz, Amélie Rochet-Capellan, François Bérard | 15m |
GyroSuite implements general-purpose interactions for a two-handed spherical HPCD: a 3D cross cursor, magnet cursor and proxy cursor for distant picking… | ||
| Haptic PIVOT: On-Demand Handhelds in VR | Robert Kovacs, Eyal Ofek, Mar Gonzalez-Franco, Alexa F Siu, Alexa Siu, Sebastian Marwecki, Christian Holz, Mike Sinclair | 05m |
A wrist‑worn prototype called PIVOT mounts on a forearm cuff and uses a single actuated hinge to pivot a generic handle into the palm on demand, combining… | ||
| Tsugite: Interactive Design and Fabrication of Wood Joints | Maria Katarina Larsson, Hironori Yoshida, Nobuyuki Umetani, Takeo Igarashi | 15m |
An interactive system called Tsugite lets users design voxelized wood joints with real-time metrics for slidability, fabricability, and durability and exports… | ||
| Kerf-Canceling Mechanisms: Making Laser-Cut Mechanisms Operate across Different Laser Cutters | Thijs Jan Roumen, Ingo Apel, Jotaro Shigeyama, Muhammad Abdullah, Patrick Baudisch | 12m |
KerfCanceler converts 2D SVG cutting plans by replacing bearings sliders and gear pairs with an extra wedge or inset so mechanisms keep working when different… | ||
| DeepFisheye: Near-Surface Multi-Finger Tracking Technology Using Fisheye Camera | Keunwoo Park, Sunbum Kim, Youngwoo Yoon, Tae-Kyun Kim, Geehyuk Lee | 14m |
A fisheye camera mounted beneath a touchscreen captures the whole hand and a deep network pipeline converts RGB to depth with Pix2Depth then a modified ResNet… | ||
| ReMap: Lowering the Barrier to Help-Seeking with Multimodal Search | C. Ailie Fraser, Julia M. Markel, N. James Basa, Mira Dontcheva, Scott Klemmer | 13m |
ReMap is a prototype that embeds video help into desktop apps using speech-initiated queries and deictic resolution (clicking an element adds its accessibility… | ||
| Rescribe: Authoring and Automatically Editing Audio Descriptions | Amy Pavel, Gabriel Reyes, Jeffrey P. Bigham | 14m |
Rescribe auto-edits author-written descriptions by generating 200–300 candidate compressions per caption, scoring them for informativeness, coherence (using… | ||
| PoseTween: Pose-driven Tween Animation | Jingyuan Liu, Jingyuan Liu, Hongbo Fu, Chiew-Lan Tai | 10m |
PoseTween generates pose-driven tween animations by anchoring virtual objects to body joints or limbs and interpolating object offsets inside a local frame… | ||
| OddEyeCam: A Sensing Technique for Body-Centric Peephole Interaction using WFoV RGB and NFoV ... | Daehwa Kim, Keunwoo Park, Geehyuk Lee | 14m |
A prototype mobile tracking system fuses a wide-view fisheye RGB image with a narrow-field depth camera to estimate device position relative to the trunk and… | ||
| FS-Pad: Video Game Interactions with a Force Feedback Gamepad | Youngbo Aram Shim, Keunwoo Park, Sangyoon Lee, Jeongmin Son, Taeyun Woo, Geehyuk Lee | 15m |
Built device: a gamepad with a force-feedback thumbstick driven by coreless motors, gears, rotary pots and a Teensy, using an open-loop impedance renderer… | ||
| SurfaceFleet: Exploring Distributed Interactions Unbounded from Device, Application, User, and Time | Frederik Brudy, David Ledo, Michel Pahud, Nathalie Henry Riche, Christian Holz, Anand Waghmare, Hemant Bhaskar Surale, Marcus Peinado, Xiaokuan Zhang, Shannon Joyner, Badrish Chandramouli, Umar Farooq Minhas, Jonathan Goldstein, William A.S. Buxton, Ken Hinckley | 15m |
SurfaceFleet is a Windows C#/WPF reference implementation and toolkit that decouples UI elements and state via Azure so floating Applets and Portfolios sync… | ||
| HERMITS: Dynamically Reconfiguring the Interactivity of Self-propelled TUIs with Mechanical ... | Ken Nakagaki, Joanne Leong, Jordan L Tappa, João Wilbert, Hiroshi Ishii | 14m |
HERMITS presents a modular architecture that extends self‑propelled TUIs with passive mechanical shells that robots can automatically dock and undock. A… | ||
| Expanding the Bounds of Seated Virtual Workspace | Mark McGill, Aidan Kehoe, Euan Freeman, Stephen A. Brewster | 14m |
Implemented head-orientation counter-rotation that lets a 60° window per virtual display span either 180° (3 displays) or 300° (5 displays) while keeping neck… | ||
| DepthLab: Real-time 3D Interaction with Depth Maps for Mobile Augmented Reality | Ruofei Du, Eric Turner, Eric Lee Turner, Max Dzitsiuk, Luca Prasso, Ivo Ferrao Duarte, Jason Dourgarian, Joao Afonso, Jose Pascoal, Josh Gladstone, Nuno Cruces, Shahram Izadi, Adarsh Kowdle, Konstantine Tsotsos, David Kim | 15m |
DepthLab is an open-source library that turns ARCore depth-from-motion maps (depth-16, usable to ~8 m, best 0.5–5 m) into three realtime primitives—depth array… | ||
| Optimal Control for Electromagnetic Haptic Guidance Systems | Thomas Langerak, Juan Zarate, Velko Vechev, Daniele Panozzo, Otmar Hilliges, David Lindlbauer | 15m |
Real-time model predictive contour control guides a magnetized stylus by optimizing electromagnet position and current on a biaxial linear stage rather than… | ||
| Slice of Light: Transparent and Integrative Transition Among Realities in a Multi-HMD-User ... | Chiu-Hsuan Wang, Chia-En Tsai, Seraphina Yong, Liwei Chan | 14m |
Slice of Light is a visualization that overlays sliced views of each co-located HMD user's VR world into a guest's view and lets the guest step into a slice… | ||
| HMD Light: Sharing In-VR Experience via Head-Mounted Projector for Asymmetric Interaction | Chiu-Hsuan Wang, Hsin-Yu Chen, Yuan-Syun Ye, Seraphina Yong, Liwei Chan | 09m |
A prototype HMD adds a steerable head-mounted projector plus servo motor, pro‑cam and stereo camera to project the VR user’s view into the physical world; it… | ||
| Video-Annotated Augmented Reality Assembly Tutorials | Masahiro Yamaguchi, Shohei Mori, Peter Mohr, Markus Tatzgern, Ana Stanescu, Hideo Saito, Denis Kalkofen | 15m |
System converts an unmodified 2D tutorial plus a 3D CAD model into interactive AR steps by computing an assembly graph, inferring disassembly in reverse, and… | ||
| Tilt-Responsive Techniques for Digital Drawing Boards | Hugo Romat, Christopher Collins, Nathalie Henry Riche, Michel Pahud, Christian Holz, Adam Riddle, William A.S. Buxton, Ken Hinckley | 13m |
Prototypes on a Microsoft Surface Studio use an accelerometer to map continuous tilt to app behavior, e.g., replaying recorded UI frames proportional to angle… | ||
| Capacitivo: Contact-Based Object Recognition on Interactive Fabrics using Capacitive Sensing | Te-Yen Wu, Lu Tan, Yuji Zhang, Yuji Zhang, Teddy Seyed, Xing-Dong Yang | 13m |
Capacitivo uses a resonance-based capacitive sensor built as a 12 x 12 electrode grid of conductive fabric with a ground plane, tuned to 7mm electrode size and… | ||
| Direction-of-Voice (DoV) Estimation for Intuitive Speech Interaction with Smart Device Ecosystems | Karan Ahuja, Andy Kong, Mayank Goel, Chris Harrison | 12m |
System builds a lightweight DoV estimator using a four-channel mic array, physics-informed features (autocorrelation, SRMR reverberation measure, GCC-PHAT… | ||
| DepthLab: Real-time 3D Interaction with Depth Maps for Mobile Augmented Reality | Ruofei Du, Eric Turner, Eric Lee Turner, Max Dzitsiuk, Luca Prasso, Ivo Ferrao Duarte, Jason Dourgarian, Joao Afonso, Jose Pascoal, Josh Gladstone, Nuno Cruces, Shahram Izadi, Adarsh Kowdle, Konstantine Tsotsos, David Kim | 15m |
DepthLab is an open-source library that turns ARCore depth-from-motion maps into three runtime structures—depth array (16-bit, e.g. 160×120), real-time depth… | ||
| HapLinkage: Prototyping Haptic Proxies for Virtual Hand Tools Using Linkage Mechanism | Nianlong Li, Han-Jong Kim, Luyao Shen, Feng Tian, Teng Han, Xing-Dong Yang, Tek-Jin Nam | 08m |
HapLinkage presents a prototyping framework that builds physical haptic proxies for hand tools using linkage mechanisms, providing six linkage templates that… | ||
| ElastiLinks: Force Feedback between VR Controllers with Dynamic Points of Application of Force | Tzu-Yun Wei, Hsin-Ruey Tsai, Yu-So Liao, Chieh Tsai, Yi Shan Chen, Yi Shan Chen, Chi Wang, Bing-Yu Chen | 11m |
A pair of handheld devices called ElastiLinks controllers physically link two VR controllers with rotatable tracks and movable connectors that act as dynamic… | ||
| Authr: A Task Authoring Environment for Human-Robot Teams | Andrew Schoen, Curt Henrichs, Mathias Strohkirch, Bilge Mutlu | 12m |
Authr is a ROS-based authoring and simulation tool with a web front end that encodes tasks as simplified HTA trees of therbligs (six physical therbligs) plus… | ||
| MorphSensor: A 3D Electronic Design Tool for Reforming Sensor Modules | Junyi Zhu, Yunyi Zhu, Jiaming Cui, Leon Cheng, Jackson C Snowden, Mark Chounlakone, Michael Wessely, Stefanie Mueller | 17m |
MorphSensor morphs off-the-shelf 2D sensor modules into free-form 3D component layouts while maintains logical connectivity so circuits remain functional as… | ||
| Wearable Subtitles: Augmenting Spoken Communication with Lightweight Eyewear for All-day Captioning | Alex Olwal, Kevin Balke, Dmitrii Votintcev, Thad E. Starner, Paula Conn, Bonnie Chinh, Benoit Corda | 14m |
A lightweight head-worn captioning system implements a hybrid low-power architecture around a MediaTek MT2523D Cortex-M4 SOC and BLE radio, an 8-layer temple… | ||
| Acustico: Surface Tap Detection and Localization using Wrist-based Acoustic TDOA Sensing | Jun Gong, Aakar Gupta, Hrvoje Benko | 13m |
A wristband with two accelerometers and two microphones and a PicoScope DAQ sampling at 1MHz detects taps on uninstrumented surfaces by extracting 24 TDOA… | ||
| nothing matches | ||