Aircraft Cockpit Interaction in Virtual Reality with Visual, Auditive, and Vibrotactile Feedback.

Stefan Auer; Christoph Anthes; Harald Reiterer; Hans-Christian Jetter

doi:10.1145/3626481

Aircraft Cockpit Interaction in Virtual Reality with Visual, Auditive, and Vibrotactile Feedback.

Stefan Auer, Christoph Anthes, Harald Reiterer, Hans-Christian Jetter

Institute of Multimedia and Interactive Systems

Abstract

Safety-critical interactive spaces for supervision and time-critical control tasks are usually characterized by many small displays and physical controls, typically found in control rooms or automotive, railway, and aviation cockpits.

Using Virtual Reality (VR) simulations instead of a physical system can significantly reduce the training costs of these interactive spaces without risking real-world accidents or occupying expensive physical simulators.

However, the user's physical interactions and feedback methods must be technologically mediated. Therefore, we conducted a within-subjects study with 24 participants and compared performance, task load, and simulator sickness during training of authentic aircraft cockpit manipulation tasks. The participants were asked to perform these tasks inside a VR flight simulator (VRFS) for three feedback methods (acoustic, haptic, and acoustic+haptic) and inside a physical flight simulator (PFS) of a commercial airplane cockpit.

The study revealed a partial equivalence of VRFS and PFS, control-specific differences input elements, irrelevance of rudimentary vibrotactile feedback, slower movements in VR, as well as a preference for PFS.

Original language	English
Title of host publication	Proceedings of the ACM on Human-Computer Interaction
Editors	Jeffrey Nichols
Number of pages	24
Volume	7
Place of Publication	NY, USA
Publisher	ACM
Publication date	31.10.2023
Edition	ISS
Pages	420-443
Article number	445
DOIs	https://doi.org/10.1145/3626481
Publication status	Published - 31.10.2023
Event	CHI 2023: CHI Conference on Human Factors in Computing Systems - Conference Center Hamburg, Hamburg, Germany Duration: 23.04.2023 → 28.04.2023 https://chi2023.acm.org/

Research Areas and Centers

Research Area: Intelligent Systems

DFG Research Classification Scheme

409-05 Interactive and Intelligent Systems, Image and Language Processing, Computer Graphics and Visualisation

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1145/3626481

Cite this

@inproceedings{35e6bb6a4c0849fbb3f6d514a5541450,

title = "Aircraft Cockpit Interaction in Virtual Reality with Visual, Auditive, and Vibrotactile Feedback.",

abstract = "Safety-critical interactive spaces for supervision and time-critical control tasks are usually characterized by many small displays and physical controls, typically found in control rooms or automotive, railway, and aviation cockpits.Using Virtual Reality (VR) simulations instead of a physical system can significantly reduce the training costs of these interactive spaces without risking real-world accidents or occupying expensive physical simulators.However, the user's physical interactions and feedback methods must be technologically mediated. Therefore, we conducted a within-subjects study with 24 participants and compared performance, task load, and simulator sickness during training of authentic aircraft cockpit manipulation tasks. The participants were asked to perform these tasks inside a VR flight simulator (VRFS) for three feedback methods (acoustic, haptic, and acoustic+haptic) and inside a physical flight simulator (PFS) of a commercial airplane cockpit.The study revealed a partial equivalence of VRFS and PFS, control-specific differences input elements, irrelevance of rudimentary vibrotactile feedback, slower movements in VR, as well as a preference for PFS.",

author = "Stefan Auer and Christoph Anthes and Harald Reiterer and Hans-Christian Jetter",

note = "DBLP's bibliographic metadata records provided through http://dblp.org/search/publ/api are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.; CHI 2023: CHI Conference on Human Factors in Computing Systems, CHI 2023 ; Conference date: 23-04-2023 Through 28-04-2023",

year = "2023",

month = oct,

day = "31",

doi = "10.1145/3626481",

language = "English",

volume = "7",

series = "Proc. ACM Hum. Comput. Interact.",

publisher = "ACM",

pages = "420--443",

editor = "Jeffrey Nichols",

booktitle = "Proceedings of the ACM on Human-Computer Interaction",

edition = "ISS",

url = "https://chi2023.acm.org/",

}

Auer, S, Anthes, C, Reiterer, H & Jetter, H-C 2023, Aircraft Cockpit Interaction in Virtual Reality with Visual, Auditive, and Vibrotactile Feedback. in J Nichols (ed.), Proceedings of the ACM on Human-Computer Interaction. ISS edn, vol. 7, 445, Proc. ACM Hum. Comput. Interact., ACM, NY, USA, pp. 420-443, CHI 2023: CHI Conference on Human Factors in Computing Systems, Hamburg, Hamburg, Germany, 23.04.23. https://doi.org/10.1145/3626481

Aircraft Cockpit Interaction in Virtual Reality with Visual, Auditive, and Vibrotactile Feedback. / Auer, Stefan; Anthes, Christoph; Reiterer, Harald et al.
Proceedings of the ACM on Human-Computer Interaction. ed. / Jeffrey Nichols. Vol. 7 ISS. ed. NY, USA: ACM, 2023. p. 420-443 445 (Proc. ACM Hum. Comput. Interact.).

Research output: Chapters in Books/Reports/Conference Proceedings › Conference contribution › peer-review

TY - GEN

T1 - Aircraft Cockpit Interaction in Virtual Reality with Visual, Auditive, and Vibrotactile Feedback.

AU - Auer, Stefan

AU - Anthes, Christoph

AU - Reiterer, Harald

AU - Jetter, Hans-Christian

N1 - DBLP's bibliographic metadata records provided through http://dblp.org/search/publ/api are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.

PY - 2023/10/31

Y1 - 2023/10/31

N2 - Safety-critical interactive spaces for supervision and time-critical control tasks are usually characterized by many small displays and physical controls, typically found in control rooms or automotive, railway, and aviation cockpits.Using Virtual Reality (VR) simulations instead of a physical system can significantly reduce the training costs of these interactive spaces without risking real-world accidents or occupying expensive physical simulators.However, the user's physical interactions and feedback methods must be technologically mediated. Therefore, we conducted a within-subjects study with 24 participants and compared performance, task load, and simulator sickness during training of authentic aircraft cockpit manipulation tasks. The participants were asked to perform these tasks inside a VR flight simulator (VRFS) for three feedback methods (acoustic, haptic, and acoustic+haptic) and inside a physical flight simulator (PFS) of a commercial airplane cockpit.The study revealed a partial equivalence of VRFS and PFS, control-specific differences input elements, irrelevance of rudimentary vibrotactile feedback, slower movements in VR, as well as a preference for PFS.

AB - Safety-critical interactive spaces for supervision and time-critical control tasks are usually characterized by many small displays and physical controls, typically found in control rooms or automotive, railway, and aviation cockpits.Using Virtual Reality (VR) simulations instead of a physical system can significantly reduce the training costs of these interactive spaces without risking real-world accidents or occupying expensive physical simulators.However, the user's physical interactions and feedback methods must be technologically mediated. Therefore, we conducted a within-subjects study with 24 participants and compared performance, task load, and simulator sickness during training of authentic aircraft cockpit manipulation tasks. The participants were asked to perform these tasks inside a VR flight simulator (VRFS) for three feedback methods (acoustic, haptic, and acoustic+haptic) and inside a physical flight simulator (PFS) of a commercial airplane cockpit.The study revealed a partial equivalence of VRFS and PFS, control-specific differences input elements, irrelevance of rudimentary vibrotactile feedback, slower movements in VR, as well as a preference for PFS.

U2 - 10.1145/3626481

DO - 10.1145/3626481

M3 - Conference contribution

VL - 7

T3 - Proc. ACM Hum. Comput. Interact.

SP - 420

EP - 443

BT - Proceedings of the ACM on Human-Computer Interaction

A2 - Nichols, Jeffrey

PB - ACM

CY - NY, USA

T2 - CHI 2023: CHI Conference on Human Factors in Computing Systems

Y2 - 23 April 2023 through 28 April 2023

ER -

Aircraft Cockpit Interaction in Virtual Reality with Visual, Auditive, and Vibrotactile Feedback.

Abstract

Research Areas and Centers

DFG Research Classification Scheme

UN SDGs

Access to Document

Fingerprint

Cite this