IUI 2021
| title | author | length |
|---|---|---|
| Increasing the User Experience in Autonomous Driving through different Feedback Modalities | Tobias Schneider, Sabiha Ghellal, Steve Love, Ansgar R.S. Gerlicher | 05m |
Built a Unity VR prototype and runs a within‑subject study with 22 participants who experience four driving scenarios and five unimodal cues plus a no‑feedback… | ||
| Key Qualities of Conversational Chatbots - the PEACE Model | Ekaterina Svikhnushina, Pearl Pu | 09m |
Large-scale survey on Amazon Mechanical Turk collects 1,000 responses and after filtering analyzes 536 US participants, using the Toronto Empathy… | ||
| Interactive Music Genre Exploration with Visualization and Mood Control | Yu Liang, Martijn C. Willemsen | 10m |
Compares a bar chart to a contour plot and adds two mood control sliders (energy and valence) using Spotify audio features, with an online study of N=102… | ||
| Comparing Apples and Oranges: Human and Computer Clustered Affinity Diagrams Under the Microscope | Parzival Borlinghaus, Stephan Huber | 08m |
Evaluates seven text‑mining models and picks fastText (Spearman r = .44) to pre-cluster short affinity notes, finding automatic clusters match human diagrams… | ||
| Decision rule elicitation for domain adaptation | Alexander Nikitin, Samuel Kaski | 06m |
Elicits simple heuristic decision rules from experts and composes them with a trained model via a weighted sum of expert rules (weights theta, similarity-based… | ||
| TextFlow: Screenless Access to Non-Visual Smart Messaging | Pegah Karimi, Emanuele Plebani, Davide Bolchini | 10m |
TextFlow generates short, entirely auditory message options from a 4M Weibo corpus using RoBERTa retrieval, ranks them by entailment probability and serves… | ||
| Model LineUpper: Supporting Interactive Model Comparison at Multiple Levels for AutoML | Shweta Narkar, Yunfeng Zhang, Q. Vera Liao, Dakuo Wang, Justin D. Weisz | 05m |
Model LineUpper is a prototype that combines multiple XAI techniques and visualizations — a metrics table for elimination, a probability scatter matrix for… | ||
| DeepNAG: Deep Non-Adversarial Gesture Generation | Mehran Maghoumi, Eugene Matthew Taranta, Joseph LaViola | 10m |
A generator-only training method replaces the discriminator by minimizing a differentiable combination of soft DTW and the average Hausdorff distance… | ||
| TeethTap: Recognizing Discrete Teeth Gestures using Motion and Acoustic Sensing on an Earpiece | Wei Sun, Franklin Mingzhe Li, Benjamin Steeper, Songlin Xu, Feng Tian, Cheng Zhang | 10m |
TeethTap is a 3D‑printed earpiece with IMU and contact microphone that recognizes 13 discrete teeth gestures using bandpass denoising, SVM for noise detection… | ||
| XAlgo: a Design Probe of Explaining Algorithms' Internal States via Question-Answering | Xiang 'Anthony' Chen | 12m |
XAlgo models deterministic algorithms by parsing questions into five types, mapping them to a pseudocode-derived hierarchical directive a cyclic graph, and… | ||
| EnglishBot: An AI-Powered Conversational System for Second Language Learning | Sherry Ruan, Liwei Jiang, Qianyao Xu, Zhiyuan Liu, Glenn M Davis, Emma Brunskill, James A. Landay | 10m |
EnglishBot is a voice-based chatbot with deep-learning speech recognition (94.5% speech recognition accuracy), adaptive English feedback and Chinese hints… | ||
| Critiquing for Music Exploration in Conversational Recommender Systems | Wanling Cai, Yucheng Jin, Li Chen | 10m |
A music chatbot with three critiquing variants is implemented and evaluated online (between-subject N=107) to test how user-initiated critiquing and two… | ||
| Do You Have Time for a Quick Chat? Designing a Conversational Interface for Sexual Harassment ... | Hyo Jin Do, Seon Hye Yang, Boo-Gyoung Choi, Wayne T. Fu, Brian P. Bailey | 10m |
A web-based proof-of-concept conversational interface simulates a real-time chat with "Jane" using a first-person vignette and pre-scripted short replies plus… | ||
| Facilitating Knowledge Sharing from Domain Experts to Data Scientists for Building NLP Models | Soya Park, April Yi Wang, Ban Kawas, Q. Vera Liao, David Piorkowski, Marina Danilevsky | 10m |
A framework called Ziva guides domain experts to extract concepts from representative samples (card-sorting UI) and provide five elicitation types — backup… | ||
| How to Support Users in Understanding Intelligent Systems? Structuring the Discussion | Malin Eiband, Daniel Buschek, Heinrich Hussmann | 09m |
A literature survey using theoretical sampling and three-step coding analyzes 222 papers to produce a user-centered framework with three categories (user… | ||
| Towards Guidelines for Designing Human-in-the-Loop Machine Training Interfaces | Almar van der Stappen, Mathias Funk | 05m |
Pilot study builds a recommender training UI with four interface variants (like/dislike, feature toggles, comparative nearest‑neighbour, and labeled-reason… | ||
| Learning to Engage in Interactive Digital Art | Zoe Tong, Dana Kulic | 05m |
A web version of The Plants is built with three randomized modes: single harp sound bank, predetermined rotating banks, and a learning agent using temporal… | ||
| Anchoring Bias Affects Mental Models and User Reliance in Explainable AI Systems | Mahsan Nourani, Chiradeep Roy, Jeremy E. Block, Donald R. Honeycutt, Tahrima Rahman, Eric D. Ragan, Vibhav Gogate | 09m |
Controlled user study builds an explainable video activity recognition tool for a cooking domain and tests 8 policies (4 strengths and 4 weaknesses) with order… | ||
| Positioning left-hand movement in violin performance: system and user study on fingering pattern ... | Yi-Hsin Jen, Tsung-Ping Chen, Shih-Wei Sun, Li Su | 05m |
An automated fingering system trains BiLSTM modules for string, hand position, and finger on a new dataset of 10 pieces annotated by 10 professionals yielding… | ||
| Non-Linear Consumption of Videos Using a Sequence of Personalized Multimodal Fragments | Gaurav Verma, Trikay Nalamada, Keerti Harpavat, Pranav Goel, Aman Mishra, Balaji Vasan Srinivasan | 10m |
NoVoExp generates a sequence of image+sentence multimodal fragments by extracting keyframes, timestamped transcripts, contiguous clusters, and selecting… | ||
| Perception of Fairness in Group Music Recommender Systems | Nyi Nyi Htun, Elisa Lecluse, Katrien Verbert | 05m |
A web app built on the Spotify API tests two ranking methods: time-based ranking (chronological playlist) and a dissimilarity score ranking that pushes songs… | ||
| Multi-modal Multi-scale Attention Guidance in Cyber-Physical Environments | Guillermo Reyes, Alexandra Alles | 09m |
Method ranks visual and auditive output devices by a computed closeness and salience suitability score that uses sigmoids for distance and direction, scaled… | ||
| HowDIY: Towards Meta-Design Tools to Support Anyone to 3D Print Anywhere | Alexander Berman, Ketan Thakare, Joshua Howell, Francis Quek, Jeeeun Kim | 10m |
A website called HowDIY aggregates millions of Thingiverse designs, scrapes comments from Thingiverse, Reddit, and StackExchange, and analyzes 36 online 3D… | ||
| Rapid Assisted Visual Search: Supporting Digital Pathologists with Imperfect AI | Martin Lindvall, Claes Lundström, Jonas Löwgren | 10m |
An interactive review tool pairs a convolutional neural network that scores cancer probability per pixel (section score = max pixel) with an automated… | ||
| Wait, But Why?: Assessing Behavior Explanation Strategies for Real-Time Strategy Games | Justus Robertson, Athanasios Vasileios Kokkinakis, Jonathan Hook, Ben Kirman, Florian Block, Marian F Ursu, Sagarika Patra, Simon Demediuk, Anders Drachen, Oluseyi Olarewaju | 09m |
111 Dota 2 players watch a 10‑minute pro match via a browser platform with an interactive minimap showing 12 event icons; three groups compare no extra info… | ||
| ProtoAI: Model-Informed Prototyping for AI-Powered Interfaces | Hariharan Subramonyam, Colleen Seifert, Eytan Adar | 09m |
ProtoAI implements a concrete workflow called model-informed prototyping that merges model exploration, UI prototyping, and evaluation in one tool. Designers… | ||
| The Effect of Surrounding Scenery Complexity on the Transfer of Control Time in Highly Automated ... | Frederik Wiehr, Baris Cakar, Florian Daiber, Antonio Krüger | 05m |
A driving-simulator study (pilot N=4, main N=12) measures take-over control time across five visually graded scenes built in ESRI CityEngine and run on an… | ||
| Increasing the Speed and Accuracy of Data Labeling Through an AI Assisted Interface | Michael Desmond, Michael Muller, Zahra Ashktorab, Casey Dugan, Evelyn Duesterwald, Kristina Brimijoin, Catherine Finegan-Dollak, Michelle Brachman, Aabhas Sharma, Narendra Nath Joshi, Qian Pan | 12m |
An AI-assisted labeling interface uses a semi-supervised model to Rank, Annotate and Reduce label choices and initially shows the top five predictions with a… | ||
| Interactive Layout Transfer | Niraj Ramesh Dayama, Simo Santala, Lukas Brückner, Kashyap Todi, Jingzhou Du, Antti Oulasvirta | 08m |
Method automatically maps a rough draft to a closest template from a company thousand-plus reference designs library, then transforms the draft to match the… | ||
| Improving Artificial Teachers by Considering How People Learn and Forget | Aurelien Nioche, Pierre-Alexandre Murena, Carlos de la Torre-Ortiz, Antti Oulasvirta | 09m |
A model-based tutoring system treats teaching as a POMDP, uses a simple exponential forgetting model with two parameters inferred by Bayesian online updates… | ||
| Understanding Driving Distractions: A Multimodal Analysis on Distraction Characterization | Michalis Papakostas, Kais Riani, Andrew Brian Gasiorowski, Yan Sun, Mohamed Abouelenien, Rada Mihalcea, Mihai Burzo | 12m |
Dataset records 45 participants across 12 modalities including visual AUs and physiological signals (BVP, skin conductance, respiration, temperature). Four… | ||
| Learning Network-Based Multi-Modal Mobile User Interface Embeddings | Gary Ang, Ee Peng Lim | 10m |
Frames mobile UIs as a bipartite screen–element graph and learns joint embeddings that reconstruct adjacency and attributes, using per-modality GAT encoders… | ||
| Detection and Differentiation of Obstacles in Repeated Adaptive Human-Computer Interactions from ... | Mazen Salous, Felix Putze | 11m |
System implements a matching-card task with two induced obstacles: a memory load via a cumulative-sum secondary task and a visual impairment by showing… | ||
| Quantitative Evaluation of Machine Learning Explanations: A Human-Grounded Benchmark | Sina Mohseni, Jeremy E. Block, Eric D. Ragan | 09m |
Proposes a repeatable benchmark that aggregates selection masks from 10 annotators into gradated human attention maps and compares them to saliency outputs… | ||
| Data-centric disambiguation for data transformation with programming-by-example | Minori Narita, Nolwenn Maudet, Yi Lu, Takeo Igarashi | 10m |
A system called FlashAttention highlights ambiguous outputs from a programming-by-example engine (FlashFill/FlashProg family), shows orange ambiguity markers… | ||
| User Preferences for Automated Curation of Snackable Content full strip notes | Allyson King, Eric Zavesky, Michael J Gonzales | 05m |
Two user studies compare human edits with automated cutters using classifiers and simple heuristics on movie and TV content: study one shows 150 clips to 1226… | ||
| Exploring Smartphone Keyboard Interactions for Experience Sampling Method driven Probe Generation | Surjya Ghosh, Salma Mandi, Bivas Mitra, Pradipta De | 05m |
Custom Android keyboard logs ~3,500 typing sessions from a 3-week in-the-wild study (N = 22) and labels probes as opportune (83%) or inopportune (17%)… | ||
| From Philosophy to Interfaces: an Explanatory Method and a Tool Inspired by Achinstein's Theory ... | Francesco Sovrano, Fabio Vitali | 10m |
A concrete pipeline converts about 60 web pages into a knowledge graph, builds information clusters by answering a minimal set of archetypal questions, and… | ||
| The Subconscious Director: Dynamically Personalizing Videos Using Gaze Data | Melanie Heck, Janick Edinger, Jonathan Bünemann, Christian Becker | 09m |
A webcam-based system called eyeDirect records gaze and computes nine fixation-based features per area of interest to infer which on-screen element a viewer… | ||
| GO-Finder: A Registration-Free Wearable System for Assisting Users in Finding Lost Objects via ... | Takuma Yagi, Takumi Nishiyasu, Kunimasa Kawasaki, Moe Matsuki, Yoichi Sato | 10m |
A wearable neck camera system automatically detects hands, crops held-item patches, and clusters instances using convolutional neural network features with… | ||
| The Sound Sketchpad: Expressively Combining Large and Diverse Audio Collections | Nikhil Singh | 04m |
An algorithm-in-the-loop audio–graphical tool that turns a sung or whistled guide plus drawn paths into collaged music, extracting time-varying features (pitch… | ||
| Multimodal Emotion Recognition of Hand-Object Interaction | Radoslaw Niewiadomski, Alessandra Sciutti | 07m |
A 5 cm sensorized cube called iCube records capacitive touch (no pressure) and an accelerometer while 11 people perform action sequences; 237 trials produce 17… | ||
| Dynamic Manipulation of Player Performance with Music Tempo in Tetris | Aline Hufschmitt, Stéphane Cardon, Éric Jacopin | 10m |
Researchers build Sonotris and DynaTris in Unity with Wwise and run experiments showing music tempo can push player performance up or down. They test with 44… | ||
| Spinning Icons: Introducing a Novel SSVEP-BCI Paradigm Based on Rotation | Maurice Rekrut, Tobias Jungbluth, Jan Alexandersson, Antonio Krüger | 11m |
Introduces a new SSVEP paradigm using spinning icons—icons rotated around their vertical axis at 7.5, 10, or 13 Hz—and tests it with a g.Nautilus EEG headset… | ||
| Auto-Icon: An Automated Code Generation Tool for Icon Designs Assisting In UI Development | Sidong Feng, Suyu Ma, Jinzhong Yu, Chunyang Chen, TingTing Zhou, Yankun Zhen | 08m |
Auto-Icon converts icon images into icon fonts plus readable labels using a font trace algorithm, a MobileNet classifier for 40–100 curated icon classes, and… | ||
| Are Explanations Helpful? A Comparative Study of the Effects of Explanations in AI-Assisted ... | Xinru Wang, Ming YIN | 09m |
Randomized controlled experiments on MTurk (782 recidivism, 561 forest cover) compare five conditions: feature importance, feature contribution, nearest… | ||
| DIY: Helping People Assess the Correctness of Natural Language to SQL Systems | Arpit Narechania, Adam Fourney, Bongshin Lee, Gonzalo Ramos | 10m |
Built a sandbox called DIY that generates a sample database (five records per table), splits a generated SQL into steps, and shows mappings plus multimodal… | ||
| Designing a Personalised Sensor Glove Using Deep-Learning | Jeremy Chan, Eduardo Veas, Jörg Simon | 08m |
A sensor glove with IMUs, flex sensors, pressure, gyros and magnetometers records 31 gestures from 22 participants and trains a neural network augmented with… | ||
| Human-in-the-loop Pose Estimation via Shared Autonomy | Zhefan Ye, Jean Y. Song, Zhiqiang Sui, Stephen Hart, Jorge Vilchis, Walter S. Lasecki, Odest Chadwicke Jenkins | 05m |
A mixed-initiative pose estimator combines a human click-and-drag initialization with a sampling-based machine step that compares rendered hypotheses to the… | ||
| Stress Management Training using Biofeedback guided by Social Agents | Tanja Schneeberger, Naomi Sauerwein, Manuel S. Anglet, Patrick Gebhard | 10m |
A virtual biofeedback system uses chest sensors over Bluetooth to display an HRV arrow and breathing circles while an interactive social agent Gloria guides… | ||
| Forsense: Accelerating online research through sensemaking integration and machine research support. | Napol Rachatasumrit, Gonzalo Ramos, Jina Suh, Rachel Ng, Christopher Meek | 10m |
ForSense is a browser extension that integrates foraging and sensemaking by letting users clip paragraph-sized text, organize clips on a spatial canvas, and… | ||
| The Design and Development of a Game to Study Backdoor Poisoning Attacks: The Backdoor Game | Zahra Ashktorab, Casey Dugan, James M. Johnson, Aabhas Sharma, Dustin Ramsey Torres, Ingrid Lange, Benjamin Hoover, Heiko Ludwig, Bryant Chen, Nathalie Baracaldo, Werner Geyer, Qian Pan | 10m |
A browser game implements activation clustering to let players probe poisoned image classifiers, upload candidate backdoor images, and test triggers… | ||
| OralViewer: 3D Demonstration of Dental Surgeries for Patient Education with Oral Cavity ... | Yuan Liang, Liang Qiu, Tiancheng Lu, Zhujun Fang, Dezhan Tu, Jiawei Yang, Yiting Shao, Kun Wang, Xiang 'Anthony' Chen, Lei He | 11m |
OralViewer reconstructs a patient-specific oral cavity from a single 2D panoramic X-ray by splitting the task into teeth localization and single-tooth… | ||
| A large, crowdsourced evaluation of gesture generation systems on common data: The GENEA ... | Taras Kucherenko, Patrik Jonell, Youngwoo Yoon, Pieter Wolfert, Gustav Eje Henter | 10m |
A community benchmark generates gestures from a common ~4-hour speech+3D-motion dataset, renders every entry on the same avatar, and evaluates them with a… | ||
| Augmenting Visual Information in Knowledge Graphs for Recommendations | Thanet Markchom, Huizhi Liang | 05m |
Proposes integrating image-derived features into item knowledge graphs and learning hybrid user profiles via Skip-gram node embeddings to boost top-N… | ||
| Crowdsourcing Scholarly Discourse Annotations | Allard Oelen, Markus Stocker, Sören Auer | 10m |
A web interface asks authors to mark key sentences in uploaded PDFs, converts those annotations into a scholarly knowledge graph, and limits selections to a… | ||
| Knowledge Graph Completion-based Question Selection for Acquiring Domain Knowledge through Dialogues | Kazunori Komatani, Yuma Fujioka, Keisuke Nakashima, Katsuhiko Hayashi, Mikio Nakano | 09m |
Framework selects missing knowledge-graph triplets to turn into natural questions by ranking KGC scores and asking high-scoring items; model uses… | ||
| I Think I Get Your Point, AI! The Illusion of Explanatory Depth in Explainable AI | Michael Chromik, Malin Eiband, Felicitas Buchner, Adrian Krüger, Andreas Martin Butz | 10m |
Non-technical users see local SHAP values in a spreadsheet interface and feel they understand the model yet the illusion of explanatory depth appears… | ||
| An Activity Recognition System for Taking Medicine Using In-The-Wild Data to Promote Medication ... | Josh Cherian, Samantha Ray, Tracy Hammond | 09m |
An activity recognition system uses Polar M600 smartwatches (both wrists) and an Android app to collect inertial data from 9 participants, extracts 106… | ||
| Visual, textual or hybrid: the effect of user expertise on different explanations | Maxwell Szymanski, Martijn Millecamp, Katrien Verbert | 09m |
Two between-subject studies (each with 10 experts and 10 non-experts) compare a textual explanation, a visual explanation using partial dependence plots, and a… | ||
| Interactive Exploration-Exploitation Balancing for Generative Melody Composition | Yijun Zhou, Yuki Koyama, Masataka Goto, Takeo Igarashi | 05m |
A web app (React + Python, MIDI pipeline) couples a pre-trained MusicVAE (512‑dim, reduced) latent space to human-in-the-loop Bayesian optimization using… | ||
| An Intelligent System to Analyze Sketched Solutions to Open-Ended Truss Problems | Matthew Runyon, Seth Polsley, Blake Williford, Sin-Ning Cindy Liu, Josh Hurt, Julie Linsey, Tracy Hammond | 11m |
A web app recognizes hand-drawn 2D truss sketches using shortstraw segmentation plus a substroke graph, computes logical node coordinates via breadth-first… | ||
| Perfection Not Required? Human-AI Partnerships in Code Translation | Justin D. Weisz, Michael Muller, Stephanie Houde, John Richards, Steven I. Ross, Fernando Martinez, Mayank Agarwal, Kartik Talamadupula | 10m |
Unsupervised NMT model TransCoder translates Java/C++/Python but only passes unit tests about 75% of the time, so outputs often need repair; 11 software… | ||
| DeepSI: Interactive Deep Learning for Semantic Interaction | Yail Bian, Chris North | 10m |
DeepSI-finetune fine-tunes a pretrained BERT inside the interactive loop so semantic interactions update model weights and produce user- and task-specific… | ||
| Continuous and Gradual Style Changes of Graphic Designs with Generative Model | Michihiko Ueno, Shin’ichi Satoh | 10m |
Proposes a pixel-based encoder–decoder that generates layout segmentation images with dual critic networks (KL encoder constraint and Wasserstein decoder… | ||
| nothing matches | ||