~/conference

UIST 2021

date:2021-10-10..2021-10-14
location:-- online --
series:UIST · 8 editions
titleauthorlength
HandyTrak: Recognizing the Holding Hand on a Commodity Smartphone from Body Silhouette ImagesHyunchul Lim, David Lin, Jessica Tweneboah, Cheng Zhang10m
HandyTrak is a software pipeline that takes front-facing camera silhouettes, segments body outlines, and feeds them to a user-dependent CNN to classify left…
Talk on
SemanticAdapt: Optimization-based Adaptation of Mixed Reality Layouts Leveraging ...Yifei Cheng, Yukang Yan, Xin Yi, Yuanchun Shi, David Lindlbauer10m
An optimization-backed system automatically assigns virtual UI elements to voxelized containers in new spaces using a linear program that encodes semantic…
Talk on
Automated Accessory Rigs for Layered 2D Character IllustrationsJingyi Li, Wilmot Li, Sean Follmer, Maneesh Agrawala08m
Automated system builds directed acyclic graph linking each accessory to a single parent body or accessory layer and infers four constraint types (occlusion…
Talk on
ReflecTrack: Enabling 3D Acoustic Position Tracking Using Commodity Dual-Microphone SmartphonesYuzhou Zhuang, Yuntao Wang, Yukang Yan, Xuhai Xu, Yuanchun Shi08m
Uses a smartwatch or earbud to emit inaudible FMCW and leverages a nearby reflective surface to create mirror microphones so a dual‑microphone phone obtains…
Talk
Game Illusionization: A Workflow for Applying Optical Illusions to Video GamesPo-Yao (Cosmos) Wang, Cong-He Xu, Ping-Yi Wang, Hsin-Yu Huang, Yu-Wei Chang, Jen-Hao Cheng, Yu-Hsin Lin, Lung-Pan Cheng09m
A five-stage workflow guides designers to pick a game object, find a match in a 163-illusion tag database, choose an illusion mechanic, integrate the effect…
Talk on
AirConstellations: In-Air Device Formations for Cross-Device Interaction via Multiple ...Nicolai Marquardt, Nathalie Henry Riche, Christian Holz, Hugo Romat, Michel Pahud, Frederik Brudy, David Ledo, Chunjong Park, Molly Jane Nicholas, Teddy Seyed, Eyal Ofek, Bongshin Lee, William A.S. Buxton, Ken Hinckley08m
AirConstellations is a platform that retrofits off‑the‑shelf mounts with low‑cost sensors to create 2–5 armatures that track device pose in 7DoF and enable…
Talk on
Modeling Touch Point Distribution with Rotational Dual Gaussian ModelYan Ma, Shumin Zhai, IV Ramakrishnan, Xiaojun Bi07m
Proposes the Rotational Dual Gaussian (RDG) model that orients the bivariate Gaussian major axis along finger movement and uses projected width and height (via…
Talk on
Trusscillator: a System for Fabricating Human-Scale Human-Powered Oscillating DevicesRobert Kovacs, Lukas Rambold, Lukas Fritzsche, Dominik Meier, Jotaro Shigeyama, Shohei Katakura, Ran Zhang, Patrick Baudisch10m
End-to-end system that lets non-engineers design human-scale, human-powered oscillating machines by swapping truss edges for coil-springs, tuning…
Talk on
So Predictable! Continuous 3D Hand Trajectory Prediction in Virtual RealityNisal Menuka Gamage, Deepana Ishtaweera, Martin Weigel, Anusha Withana08m
Kinematic regression predicts continuous 3D hand trajectories for VR using OptiTrack data from 20 participants and gaming plus pointing tasks, achieving RMSE…
Talk on
TouchPose: Hand Pose Prediction, Depth Estimation, and Touch Classification from Capacitive ImagesKaran Ahuja, Paul Streli, Christian Holz05m
A multi-task convolutional model TouchPose learns to reconstruct a 3D hand skeleton, predict depth maps, and classify touch from low-resolution capacitive…
Talk on
iText: Hands-free Text Entry on an Imaginary Keyboard for Augmented Reality SystemsXueshi Lu, Difeng Yu, Hai-Ning Liang, Jorge Goncalves08m
iText implements a hands-free imaginary keyboard for AR HMDs and evaluates three selection methods: E-Type (eye blinks), D-Type (dwell), and G-Type (head…
Talk on
Just Speak It: Minimize Cognitive Load for Text Editing with a Smart Voice AssistantJiayue Fan, Chenning Xu, Chun Yu, Yuanchun Shi07m
SmartEdit is a smartphone voice agent (ASR + TTS, headset buttons) that uses a BERT sequence‑labeler to remove colloquial inserts automatically and two…
Talk on
Voice and Touch Based Error-tolerant Multimodal Text Editing and Correction for SmartphonesMaozheng Zhao, Wenzhe Cui, IV Ramakrishnan, Shumin Zhai, Xiaojun Bi09m
A smartphone system called VT combines touch plus speech so users tap approximate location then speak insertions or editing commands; it generates substitution…
Talk on
Weaving Schematics and Code: Interactive Visual Editing for Hardware Description LanguagesRichard Lin, Rohit Ramesh, Nikhil Jain, Josephine Koe, Ryan Nuqui, Prabal Dutta, Bjoern Hartmann07m
An IDE for the Polymorphic Blocks HDL that keeps code primary while generating a live block-diagram from edits, with speculative block insertion that updates…
Talk on
Taming fNIRS-based BCI Input for Better Calibration and Broader UseLiang Wang, Zhe Huang, Ziyu Zhou, Devon McKeon, Giles Blaney, Michael C. Hughes, Robert J.K. Jacob09m
A new multi-subject fNIRS dataset (27 recruited, 15 eligible) and open-source code accompany a 3-phase pipeline that first trains on synthetic data from other…
Talk on
Situated Live Programming for Human-Robot CollaborationEmmanuel Senft, Michael Hagenow, Robert Radwin, Michael Zinn, Michael Gleicher, Bilge Mutlu09m
A situated live programming system lets end users draw annotations on a robot-mounted camera feed to create atomic trigger-action pairs (presence, absence…
Talk on
GesturAR: An Authoring System for Creating Freehand Interactive Augmented Reality ApplicationsTianyi Wang, Xun Qian, Fengming He, Xiyun Hu, Yuanzhi Cao, Karthik Ramani08m
GesturAR is an end-to-end authoring system that maps embodied freehand demonstrations to AR reactions using trigger-action visual programming, letting users…
Talk on
Dynamic Guidance for Decluttering Photographic CompositionsJane L E, Kevin Zhai, Jose Echevarria, Ohad Fried, Pat Hanrahan, James A. Landay08m
A realtime camera overlay uses object-based saliency plus edge detection to segment subject, subject border, image border and background and color-code edges…
Talk on
MoiréBoard: A Stable, Accurate and Low-cost Camera Tracking MethodChang Xiao, Changxi Zheng09m
A camera tracking method that recovers 3-DOF position from moiré patterns produced by two overlaid grids claims commercial-VR accuracy while using cheap…
Talk on
False Positives vs. False Negatives: The Effects of Recovery Time and Cognitive Costs on Input ...Ben Lafreniere, Tanya R. Jonker, Stephanie Santosa, Mark Parent, Michael Glueck, Tovi Grossman, Hrvoje Benko, Daniel Wigdor09m
Two user studies use a controlled tile search task with injected false positives and false negatives and manipulated tile reopening times to measure…
Talk on
Tilt-Explore: Making Tilt Gestures Usable for Low-Vision Smartphone UsersFarhani Momotaz, Syed Masum Billah11m
Tilt-Explore is a tilt-to-pan mode added to screen magnifiers that activates by touch-and-hold 800 ms and uses audio-haptic cues plus a dynamic reference…
Talk on
Screen Parsing: Towards Reverse Engineering of UI Models from ScreenshotsJason Wu, Xiaoyi Zhang, Jeffrey Nichols, Jeffrey P. Bigham09m
System predicts full UI trees from screenshots using three stages: an object detection model, an LSTM encoder plus stack‑pointer decoder that emits…
Talk on
SensiCut: Material-Aware Laser Cutting Using Speckle Sensing and Deep LearningMustafa Doga Dogan, Steven Vidal Acevedo Colon, Varnika Sinha, Kaan Akşit, Stefanie Mueller10m
A compact hardware add-on uses lensless speckle camera imaging and a deep-learning classifier to sense surface microstructure and map sheets to laser…
Talk on
HelpViz: Automatic Generation of Contextual Visual Mobile Tutorials from Text-Based InstructionsMingyuan Zhong, Gang Li, Peggy Chi, Yang Li08m
HelpViz converts web text instructions into contextual visual mobile tutorials by parsing actions, executing them on an array of Android emulators, and…
Talk on
Evaluating the Effects of Saccade Types and Directions on Eye Pointing TasksXinyong Zhang10m
A 2D IDeye extension is implemented and fit to data from two experiments with 12 saccade directions and 12 amplitude/width/height combinations per direction to…
Talk on
HoloBoard: a Large-format Immersive Teaching Board based on Pseudo HoloGraphicsJiangtao Gong, Teng Han, Siling Guo, Jiannan Li, Siyu Zha, Liuxin Zhang, Feng Tian, Qianying Wang, Yong Rui08m
HoloBoard is a large-format pseudo-holographic transparent display built from a semi‑transparent projector screen plus 4 VR base stations with 2 handlers and 4…
Talk on
Altering Perceived Softness of Real Rigid Objects by Restricting Fingerpad DeformationYujie Tao, Shan-Yuan Teng, Pedro Lopes10m
A wearable device that hollow frame pulled by motor restricts fingerpad lateral deformation and makes rigid surfaces feel softer; it uses a pulley, force…
Talk
Do We Need a Faster Mouse? Empirical Evaluation of Asynchronicity-Induced JitterAuejin Ham, Junsu Lim, Sunjun Kim10m
Empirical test uses an 8000‑Hz mouse, high‑refresh displays, a spinning‑poller logger validated against low‑level API and a theoretical jitter model, and 23…
Talk on
Bit Whisperer: Enabling Ad-hoc, Short-range, Walk-Up-and-Share Data Transmissions via ...Youngwook Do, Siddhant Singh, Zhouyu Li, Steven R Craig, Phoebe J Welch, Chengzhi Shi, Thad E. Starner, Gregory D. Abowd, Sauvik Das08m
Bit Whisperer sends short messages via inaudible surface-restricted acoustics (18–20 kHz) using frequency-shift keying, forward error correction and…
Talk on
SimpModeling: Sketching Implicit Field to Guide Mesh Modeling for 3D Animalmorphic Head DesignZhongjin Luo, Jie Zhou, Heming Zhu, Dong Du, Xiaoguang Han, Hongbo Fu10m
Two-stage sketch pipeline separates global shape and local detail: closed-contour input and curve handles produce M0 then deform to coarse M1 using a…
Talk on
MotionRing: Creating Illusory Tactile Motion around the Head using 360° Vibrotactile HeadbandsShao-Yu Chu, Yun-Ting Cheng, Shih Chin Lin, Yung-Wen Huang, Yi Chen, Mike Y. Chen08m
A 360° vibrotactile headband uses a 1‑D sparse array of vibration motors to produce apparent tactile motion by timing motor onsets rather than moving parts…
Talk
GazeChat: Enhancing Virtual Conferences with Gaze Awareness and Interactive 3D PhotosZhenyi He, Keru Wang, Brandon Yushan Feng, Ruofei Du, Ken Perlin09m
System uses a single webcam with WebGazer (smoothed by a 1€ filter) plus optional Tobii input to estimate gaze, synthesizes 20 eye-angle frames with a…
Talk on
LipNotif: Use of Lips as a Non-Contact Tactile Notification Interface Based on Ultrasonic ...Arata Jingu, Takaaki Kamigaki, Masahiro Fujiwara, Yasutoshi Makino, Hiroyuki Shinoda07m
LipNotif is a prototype that uses mid-air ultrasonic transducers to present focal tactile points to the lips, locating stimulation spots by facial landmarks…
Talk on
PocketView: Through-Fabric Information DisplaysAntony Albert Raj Irudayaraj, Rishav Agarwal, Nikhita Joshi, Aakar Gupta, Omid Abari, Daniel Vogel07m
Claims that bright low-res displays can be read through clothing using an 8x8 RGBW LED matrix, validated by a technical test on 40 fabrics tested measuring…
Talk on
Marcelle: Composing Interactive Machine Learning Workflows and InterfacesJules Françoise, Téo Sanchez, Baptiste Caramiaux09m
Marcelle is an open-source JavaScript toolkit (MIT) that composes interactive ML workflows from modular components embedding data, models and GUIs; it…
Talk on
DextrEMS: Achieving Dexterity in Electrical Muscle Stimulation by Combining it with BrakesRomain Nith, Shan-Yuan Teng, Pengyu Li, Yujie Tao, Pedro Lopes10m
Combines electrical muscle stimulation with per-joint mechanical ratchet brakes to actuate eight joints (MCP and PIP for four fingers) on an untethered 68 g…
Talk on
Weirding Haptics: In-Situ Prototyping of Vibrotactile Feedback in Virtual Reality through ...Donald Degraen, Bruno Fruchard, Frederik Smolders, Emmanouil Potetsianakis, Seref Güngör, Antonio Krüger, Jürgen Steimle07m
A VR design tool converts recorded vocalizations into controller vibrations and supports four inferred spatio-temporal mappings: instantaneous, continuous…
Talk on
Route Tapestries: Navigating 360 Virtual Tour Videos Using Slit-Scan VisualizationsJiannan Li, Jiahe Lyu, Maurício Sousa, Ravin Balakrishnan, Anthony Tang, Tovi Grossman08m
Route Tapestries construct continuous strip previews for 360° virtual tour videos by joining boundary pixel slices using slit-scan imaging after estimating…
Talk on
Identifying Contact Fingers on Touch Sensitive Surfaces by Ring-Based Vibratory CommunicationSeungjae Oh, Chaeyong Park, Yo-Seb Jeon, Seungmoon Choi06m
System identifies which finger touches a surface by sending coded vibrations through wearable rings and reading them with a microphone, achieving up to 93% lab…
Talk on
ModularHMD: A Reconfigurable Mobile Head-Mounted Display Enabling Ad-hoc Peripheral ...Isamu Endo, Kazuki Takashima, Maakito Inoue, Kazuyuki Fujita, Kiyoshi Kiyokawa, Yoshifumi Kitamura09m
A reconfigurable HMD prototype uses a stereoscopic mobile display plus iPod touch modules and 3D‑printed mounts to add three removable modules that each…
Talk on
SoundsRide: Affordance-Synchronized Music Mixing for In-Car Audio Augmented RealityMohamed Kari, Tobias Grosse-Puppendahl, Alexander Jagaciak, David Bethge, Reinhard Schütte, Christian Holz08m
SoundsRide mixes recorded songs to align high-contrast music events with route affordances by 1) estimating ETAs to annotated GPS events, 2) fusing those ETAs…
Talk
AutoAssembler: Automatic Reconstruction of Laser-Cut 3D ModelsThijs Jan Roumen, Conrad Lempert, Ingo Apel, Erik Brendel, Markus Brand, Laurenz Seidel, Lukas Rambold, Patrick Baudisch08m
AutoAssembler converts 2D laser‑cutting plans into editable 3D models using a beam search over plate-assembly candidates and a hash table of joint shapes to…
Talk on
An Aligned Rank Transform Procedure for Multifactor Contrast TestsLisa A. Elkin, Matthew Kay, James J Higgins, Jacob O. Wobbrock08m
Introduces ART-C a new aligned-rank-contrast algorithm that claims to let aligned rank transform handle post-hoc contrasts across multiple factors without…
Talk on
Unravel: A Fluent Code Explorer for Data WranglingNischal Shrestha, Titus Barik, Chris Parnin05m
Unravel is a web app embedded in RStudio that opens when code is piped to unravel and surfaces intermediate dataframes with always-on visualizations and…
Talk on
MARS: Nano-Power Battery-free Wireless Interface for Touch, Swipe and Speech InputNivedita Arora, Ali Mirzazadeh, Injoo Moon, Charles Ramey, Yuhui Zhao, Daniela C. Rodriguez, Gregory D. Abowd, Thad E. Starner07m
A battery-free wireless sticker that senses touch, swipe and speech by modulating an ultra-low-power LC oscillator and backscattering a carrier, built from…
Talk on
Relevance and Applicability of Hardware-independent Pointing Transfer FunctionsRaiza Hanada, Damien Masson, Géry Casiez, Mathieu Nancel, Sylvain Malacria08m
Hardware-dependent transfer functions in pixels per count change pointer behaviour across setups: a controlled study with 32 participants and 8 OS transfer…
Talk on
Capturing Tactile Properties of Real Surfaces for Haptic ReproductionDonald Degraen, Michal Piovarči, Bernd Bickel, Antonio Krüger08m
An end-to-end pipeline captures and reproduces stable microgeometry from real fabrics using a transparent elastomer, aluminum powder and a calibrated bench…
Talk on
X-Rings: A Hand-mounted 360 Degree Shape Display for Grasping in Virtual RealityEric J Gonzalez, Eyal Ofek, Mar Gonzalez-Franco, Mike Sinclair08m
A hand-mounted stack of motor-driven expandable rings physically renders radially symmetric, graspable surfaces using 5.7–7.7 cm rings with up to 15 N per…
Talk on
HapticBots: Distributed Encountered-type Haptics for VR with Multiple Shape-changing Mobile RobotsRyo Suzuki, Eyal Ofek, Mike Sinclair, Daniel Leithinger, Mar Gonzalez-Franco07m
HapticBots builds a swarm of tabletop shape-changing robots that move and extend metal-tape reels to render on-demand touch points and continuous surfaces in…
Talk on
Automatic Instructional Video Creation from a Markdown-Formatted TutorialPeggy Chi, Nathan Frey, Katrina Panovich, Irfan Essa07m
An automated pipeline called HowToCut converts Markdown tutorials into narrated, step-timed videos by extracting text and media, adding connective phrasing…
Talk on
NavStick: Making Video Games Blind-Accessible via the Ability to Look AroundVishnu Nair, Jay L Karp, Samuel Silverman, Mohar Kalra, Hollis Lehv, Faizan Jamil, Brian A. Smith09m
NavStick repurposes the right thumbstick to let blind players "look" around a 3D scene and announces objects via spatialized 3D sound from query direction…
Talk on
GestuRING: A Web-based Tool for Designing Gesture Input with Rings, Ring-Like, and Ring-Ready ...Radu-Daniel Vatavu, Laura-Bianca Bilius07m
A systematic review of 84 papers yields nearly 1,000 catalogued ring gestures and exactly 579 gesture-to-function mappings, with an average vocabulary size of…
Talk on
Shapir: Standardizing and Democratizing Access to Web APIsTarfah Alrashed, Lea verou, David R Karger10m
A standardized, machine-readable ontology called WoOPI maps diverse REST endpoints to typed objects and Schema.org properties, and an authoring GUI generates…
Talk on
VEmotion: Using Driving Context for Indirect Emotion Prediction in Real-TimeDavid Bethge, Thomas Kosch, Tobias Grosse-Puppendahl, Lewis L Chuang, Mohamed Kari, Alexander Jagaciak, Albrecht Schmidt10m
A smartphone-only system predicts driver emotions from contextual signals (GPS speed and acceleration, road type, speed limit, real-time traffic, weather…
Talk on
Screen2Words: Automatic Mobile UI Summarization with Multimodal LearningBryan Wang, Gang Li, Xin Zhou, Zhourong Chen, Tovi Grossman, Yang Li07m
Automatic system generates concise UI phrases from mobile screenshots using a multimodal pipeline: 112k summaries across ~22k screens collected from RICO with…
Talk on
Planning Epidemic Interventions with EpiPolicyZain Tariq, Miro Mannino, Mai Le Xuan Anh, Whitney Bagge, Azza Abouzied, Dennis Shasha09m
EpiPolicy is a GUI-based epidemic simulation and policy-aid that lets teams write disease models, specify interventions as Python functions, and declaratively…
Talk on
Rapido: Prototyping Interactive AR Experiences through Programming by DemonstrationGermán Leiva, Jens Emil Sloth Grønbæk, Clemens Nylandsted Klokmose, Cuong Nguyen, Rubaiat Habib Kazi, Paul Asente08m
Rapido turns a non‑interactive AR video into a working prototype by letting designers record input taps and world touches, record animation finger paths and…
Talk on
ETNA: Harvesting Action Graphs from WebsitesOriana Riva, Jason Kace08m
Etna extracts action graphs from websites by turning interaction traces into timelines, classifying fine-grained states (empty vs populated cart), and…
Talk on
Chemical Haptics: Rendering Haptic Sensations via Topical StimulantsJasmine Lu, Ziwei Liu, Jas Brooks, Pedro Lopes10m
Identifies five skin-active chemicals—sanshool (tingling), menthol (cooling), capsaicin (warming), cinnamaldehyde (stinging), lidocaine (numbing)—and…
Talk on
Space, Time, and Choice: A unified approach to flexible personal schedulingVicky Bilbily, Elaine Huynh, Karan Singh, Fanny Chevalier09m
A unified space–time claim: a mobile prototype maps events and travel together, letting users drag places into a timeline while travel times update and…
Talk on
App-Based Task Shortcuts for Virtual AssistantsDeniz Arsan, Ali Zaidi, Aravind Sagar, Ranjitha Kumar10m
SAVANT automatically maps natural language tasks to app UI screens by mining interaction traces (screenshots, render properties, gestures) and Play Store text…
Talk on
Roadkill: Nesting Laser-Cut Objects for Fast AssemblyMuhammad Abdullah, Romeo Sommerfeld, Laurenz Seidel, Jonas Noack, Ran Zhang, Thijs Jan Roumen, Patrick Baudisch07m
Roadkill converts 3D models into 2D laser cutting layouts that encode assembly order so users assemble parts faster For a 12 person study layouts produced by…
Talk on
MedKnowts: Unified Documentation and Information Retrievalfor Electronic Health RecordsLuke Murray, Divya Gopinath, Monica Agrawal, Steven Horng, David Sontag, David R Karger08m
A deployed prototype unifies note editing and search for Emergency Department scribes, capturing structured data via autocomplete chips (rule-based triggers…
Talk on
VHP: Vibrotactile Haptics Platform for On-body ApplicationsArtem Dementyev, Pascal Getreuer, Dimitri Kanevsky, malcolm slaney, Richard F Lyon09m
VHP is an open hardware vibrotactile platform that drives 12 independent channels of arbitrary waveforms at a 2 kHz sampling rate, using an nRF52 MCU, PWM with…
Talk on
Bi-3D: Bi-Manual Pen-and-Touch Interaction for 3D Manipulation on TabletsKen Pfeuffer, Abdullatif Dinc, Jan Obernolte, Radiah Rivu, Yasmeen Abdrabou, Franziska Shelter, Yomna Abdelrahman, Florian Alt09m
A tablet prototype implements Bi-3D, a 3DOF bi-manual pen+touch technique where the pen drags in-screen and a pinch gesture moves the object in depth…
Talk on
OmniFiber: Integrated Fluidic Fiber Actuators for Weaving Movement-based Interactions into the ...Ozgun Kilic Afsar, Ali Shtarbanov, Hila Mor, Ken Nakagaki, Jack Forman, Karen Modrei, Seung Hee Jeong, Klas Hjort, Kristina Höök, Hiroshi Ishii09m
OmniFiber presents a concrete toolkit: spray‑printed carbon black strain sensors on microtubules, fluidic McKibben‑style contractible fibers that shorten ~32%…
Talk on
TypeBoard: Identifying Unintentional Touch on Pressure-Sensitive Touchscreen KeyboardsYizheng Gu, Chun Yu, Xuanzhong Chen, Zhuojun Li, Yuanchun Shi08m
A pressure-sensitive touchscreen keyboard called TypeBoard uses embedded pressure sensors and a machine-learning classifier to suppress unintentional touches…
Talk on
Taxon: a Language for Formal Reasoning with Digital Fabrication MachinesJasper Tran O'Leary, Chandrakana Nandi, Khang Lee, Nadya Peek06m
Taxon is a programmatic system that encodes machines, workflows, and reusable heuristics so makers can verify feasibility and safety before fabricating…
Talk on
SymbolFinder: Brainstorming Diverse Symbols Using Local Semantic NetworksSavvas Petridis, Hijung Valentina Shin, Lydia B. Chilton09m
SymbolFinder is an interactive tool that generates local semantic networks from a root concept using Small World of Words, clusters associations with Louvain…
Talk on
Midair Balloon Interface: A Soft and Lightweight Midair Object for Proximate InteractionsTakuro Furumoto, Takumi Kasai, Masahiro Fujiwara, Yasutoshi Makino, Hiroyuki Shinoda08m
Prototype uses eleven ultrasound transducer array units and high-speed stereo cameras to control a 10-cm helium balloon in 3D with closed-loop, time-sliced…
Talk on
FaraPy: An Augmented Reality Feedback System for Facial Paralysis using Action Unit Intensity ...Giuliana Barrios Dell'Olio, Misha Sra07m
FaraPy is a mobile AR mirror-therapy system that uses a LW-FAU lightweight CNN to estimate left- and right-side facial action unit intensities in real time on…
Talk on
SGToolkit: An Interactive Gesture Authoring Toolkit for Embodied Conversational AgentsYoungwoo Yoon, Keunwoo Park, Minsu Jang, Jaehong Kim, Geehyuk Lee10m
SGToolkit is an interactive authoring system that generates upper‑body gestures from speech using a neural generative model trained on TED data, exposing fine…
Talk on
Tabs.do: Task-Centric Browser Tab ManagementJoseph Chee Chang, Yongsung Kim, Victor Miller, Michael Xieyang Liu, Brad A. Myers, Aniket Kittur08m
A Chrome extension called Tabs.do groups open tabs into task bundles, offers drag‑and‑drop nesting, notes and color/priorities, and reopens or closes whole…
Talk on
Snowy: Recommending Utterances for Conversational Visual AnalysisArjun Srinivasan, Vidya Setlur10m
SNOWY is a prototype that generates and surfaces parameterized natural language utterances for visual analysis by combining data interestingness and language…
Talk on
Variance and Distribution Models for Steering TasksMichael Wang, HANG ZHAO, Xiaolei Zhou, Xiangshi Ren, Xiaojun Bi09m
Proposes a quadratic variance model that predicts movement-time variance as a quadratic function of index of difficulty with effectively zero linear term and…
Talk on
MetaSense: Integrating Sensing Capabilities into Mechanical MetamaterialJun Gong, Olivia Seow, Cedric Honnet, Jack Forman, Stefanie Mueller10m
Method converts opposing metamaterial cell walls into capacitive electrodes and uses a multi‑material 3D printer plus a dual‑head workflow to export two STL…
Talk on
reCode: A Lightweight Find-and-Replace Interaction in the IDE for Transforming Code by ExampleWode Ni, Joshua Sunshine, Vu Le, Sumit Gulwani, Titus Barik06m
reCode is a Visual Studio Code extension that turns a simple search into a demonstrated, synthesized transformation: type a short search like bind or expect…
Talk on
Sporq: An Interactive Environment for Exploring Code Using Query-by-ExampleAaditya Naik, Jonathan Mendelson, Nathaniel Sands, Yuepeng Wang, Mayur Naik, Mukund Raghothaman10m
Sporq is an interactive VS Code extension that converts a codebase with CodeQL into relational program representations, synthesizes Datalog queries from…
Talk on
ScaffoldSketch: Accurate Industrial Design Drawing in VRXue Yu, Stephen DiVerdi, Akshay Sharma, Yotam Gingold07m
ScaffoldSketch is a VR drawing system that auto-corrects two staged strokes: scaffold auto-correction snaps straight construction lines by endpoints…
Talk on
Idyll Studio: A Structured Editor for Authoring Interactive & Data-Driven ArticlesMatthew Conlen, Megan Vo, Alan Tan, Jeffrey Heer09m
A web-based authoring tool implements Idyll extensions that let documents inspect and edit their own code at runtime, exposing components, text, state, and…
Talk on
Strives: String-based Force Feedback for Automotive EngineeringAlexander Achberger, Fabian Aust, Daniel Pohlandt, Kresimir Vidackovic, Michael Sedlmair10m
A string-based device called STRIVE provides low-cost, mobile force feedback for automotive VR, mounting on backpacks, controllers or fixtures and covering a 2…
Talk on
Lenticular Objects: 3D Printed Objects with Lenticular Lens Surfaces that Can Change their ...Jiani Zeng, Honghao Deng, Yunyi Zhu, Michael Wessely, Axel Kilian, Stefanie Mueller09m
Method that prints lenticular lenses and color patterns onto curved surfaces so objects show different images from different angles: a 3D editor computes lens…
Talk on
Umitation: Retargeting UI Behavior Examples for Website DesignYan Chen, Tovi Grossman07m
Umitation is a browser prototype that records DOM events and attribute changes to let designers extract, edit, adapt UI behaviors from live sites; it presents…
Talk on
Retargeted Self-Haptics for Increased Immersion in VR without Hand InstrumentationCathy Mengying Fang, Chris Harrison09m
Introduces a method that warps tracked hand positions so one real hand acts as a physical prop for the other, implemented as retargeted self-haptics across 12…
Talk on
EIT-kit: An Electrical Impedance Tomography Toolkit for Health and Motion SensingJunyi Zhu, Jackson C Snowden, Joshua Verdejo, Emily Chen, Paul Zhang, Hamid Ghaednia, Joseph H Schwab, Stefanie Mueller10m
A complete EIT prototyping stack that combines a Rhino Grasshopper 3D editor, a customizable sensing motherboard, an Arduino-style microcontroller library, and…
Talk on
FabHydro: Printing Interactive Hydraulic Devices with an Affordable SLA 3D PrinterZeyu Yan, Huaishu Peng12m
FabHydro demonstrates printing sealed, deformable hydraulic devices on an off‑the‑shelf SLA printer using flexible resins (F39/F69) and custom panel supports…
Talk on
Assuage: Assembly Synthesis Using A Guided ExplorationJingmei Hu, Priyan Vaithilingam, Stephen Chong, Margo Seltzer, Elena L. Glassman09m
Assuage is a parallel interactive assembly synthesizer built on CEGIS that lets users run multiple guided searches as parallel synthesis instances with…
Talk on
PneuSeries: 3D Shape Forming with Modularized Serial-Connected InflatablesWei-Ju Lin, Yu-Wen Chen, Yi Chen, Lung-Pan Cheng10m
A serial inflatable system that forms 3D shapes using modular cubical, cuboidal, tetrahedral, prismatic and custom units connected with embedded bidirectional…
Talk on
Ten Million Users and Ten Years Later: Python Tutor's Design Guidelines for Building Scalable ...Philip J. Guo03m
Python Tutor is a web-based code visualizer that grows over 12 years to over ten million users in 180+ countries, contributes to 55 papers across 35 groups in…
Talk on
Urban Brush: Intuitive and Controllable Urban Layout EditingBedrich Benes, Xiaochen Zhou, Pascal Chien-Hsi Chang, Marie-Paule R. Cani10m
Interactive brushes let users move population and jobs as agents while preserving total agents and geometry, using atomic operations that split or merge…
Talk on
Adroid: Augmenting Hands-on Making with a Collaborative RobotRundong Tian, Eric Paulos07m
A robotic system mounts hand tools to a KUKA arm and measures user-applied forces to move or resist the tool, creating software-defined jigs that constrain…
Talk on
Per Garment Capture and Synthesis for Real-time Virtual Try-onToby Chong, I-Chao Shen, Nobuyuki Umetani, Takeo Igarashi09m
A pipeline captures each garment with a 9-DOF actuated mannequin and a color-coded measurement garment to record body shape and pose, collecting about 80,000…
Talk on
Daedalus in the Dark: Designing for Non-Visual Accessible Construction of Laser-Cut ArchitectureRuei-Che Chang, Chih-An Tsao, Fang-Ying Liao, Seraphina Yong, Tom Yeh, Bing-Yu Chen07m
A Fusion 360 plugin named Daedalus generates laser-cut layouts plus tactile aids (engraved lines and arrows, hollow entry circles and layered ground supports)…
Talk on
Hierarchical Summarization for Longform Spoken DialogDaniel Li, Thomas Chen, Albert Tung, Lydia B. Chilton06m
A system combines a two-stage ASR+summarization pipeline with semantic segmentation and merging algorithms to make 20–30 minute spoken recordings skimmable; it…
Talk on
KondoCloud: Improving Information Management in Cloud Storage via Recommendations Based on File ...Will Brackenbury, Andrew M McNutt, Kyle Chard, Aaron Elmore, Blase Ur09m
KondoCloud is a web file-browser that surfaces ML recommendations to retrieve, move, or delete cloud files by comparing each file to others using logistic…
Talk on
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.