~/talk

Summon and Select: Rapid Interaction with Interface Controls in Mid-air

on YouTube 21m
Talkat ISS 2017 · 2017-10-17..10-20· [ux-and-product-design]

speakers

name:Aakar Gupta
links:none on file
name:Thomas Pietrzak
links:none on file
name:Cleon Yau
links:none on file
name:Nicolas Roussel
links:none on file
name:Ravin Balakrishnan
links:none on file

resources

video:https://youtu.be/PXE9mZdf_Z8
slides:none on file

summary

Summon and Select brings controls to the hand with a summoning gesture, uses hand-positioned disambiguation zones to pick among nearby widgets, then manipulates via a pinch/grip and releases with an open hand. Implementations use Kinect/Leap Motion tracking; a 12-participant selection study finds summon is ~1.0 s faster on large buttons and ~2.5 s faster on small ones and is agnostic to button size. After 10 minutes training participants complete ~93% error-free trials; limitations include maps, checkbox groups and potential Midas Touch false activations.

AI-written summary · about

chapters (12)

  1. 0:00Introduction and motivation
  2. 1:12Problems with point and select
  3. 3:19Introducing summon and select
  4. 4:27Interaction steps and disambiguation
  5. 7:01Examples of summon and select
  6. 8:56Advantages over point and select
  7. 9:59Limitations of summon and select
  8. 10:40Midas Touch evaluation results
  9. 11:23Performance comparison study
  10. 13:12Study results summary
  11. 13:33Future directions and open questions
  12. 14:42Q&A session begins

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.