TY - JOUR
T1 - Gestures that people can understand and use
AU - Ardito, Carmelo
AU - Costabile, Maria Francesca
AU - Jetter, Hans Christian
N1 - Funding Information:
This work is partially supported by the Italian Ministry of University and Research (MIUR) under grant PON 02_00563_3470993 “VINCENTE” and by the Italian Ministry of Economic Development (MISE) under grant PON Industria 2015 MI01_00294 “LOGIN”.
Publisher Copyright:
© 2014 Elsevier Ltd.
PY - 2014/10/1
Y1 - 2014/10/1
N2 - Recent advances in computing devices push researchers to envision new interaction modalities that go beyond traditional mouse and keyboard input. Typical examples are large displays for which researchers hope to create more "natural" means of interaction by using human gestures and body movements as input. In this article, we reflect about this goal of designing gestures that people can easily understand and use and how designers of gestural interaction can capitalize on the experience of 30 years of research on visual languages to achieve it. Concretely, we argue that gestures can be regarded as "visual expressions to convey meaning" and thus are a visual language. Based on what we have learned from visual language research in the past, we then explain why the design of a generic gesture set or language that spans many applications and devices is likely to fail. We also discuss why we recommend using gestural manipulations that enable users to directly manipulate on-screen objects instead of issuing commands with symbolic gestures whose meaning varies among different users, contexts, and cultures.
AB - Recent advances in computing devices push researchers to envision new interaction modalities that go beyond traditional mouse and keyboard input. Typical examples are large displays for which researchers hope to create more "natural" means of interaction by using human gestures and body movements as input. In this article, we reflect about this goal of designing gestures that people can easily understand and use and how designers of gestural interaction can capitalize on the experience of 30 years of research on visual languages to achieve it. Concretely, we argue that gestures can be regarded as "visual expressions to convey meaning" and thus are a visual language. Based on what we have learned from visual language research in the past, we then explain why the design of a generic gesture set or language that spans many applications and devices is likely to fail. We also discuss why we recommend using gestural manipulations that enable users to directly manipulate on-screen objects instead of issuing commands with symbolic gestures whose meaning varies among different users, contexts, and cultures.
UR - http://www.scopus.com/inward/record.url?scp=84908211728&partnerID=8YFLogxK
U2 - 10.1016/j.jvlc.2014.07.002
DO - 10.1016/j.jvlc.2014.07.002
M3 - Journal articles
AN - SCOPUS:84908211728
SN - 1045-926X
VL - 25
SP - 572
EP - 576
JO - Journal of Visual Languages and Computing
JF - Journal of Visual Languages and Computing
IS - 5
ER -