One of the most challenging aspects of the implementation of Virtual/Mixed reality training systems is the effective simulation of real-world manipulation of the physical devices included in control interfaces like buttons, sliders, levers, knobs, etc. In this paper we describe a mockup airplane cockpit (XR-Cockpit), featuring interactive components of this kind that demonstrate the feasibility of effective simulations of device manipulation using low cost hand tracking technology and gesture recognition. Based on this system, we performed a user study to compare the effectiveness of the interaction with virtual tools using different visualization solutions: immersive VR, optical and video see-through based MR. In our study, we also checked how well it is possible to perform manipulation of real objects wearing the two video see-through solutions. The analysis of the experimental results provides useful guidelines for the design of Virtual and Mixed Reality training systems involving virtual and physical actions on manipulation devices.

XR-Cockpit: a comparison of VR and AR solutions on an interactive training station

Caputo, Fabio Marco;Jacota, Sergiu;Pesavento, Marco;Pellacini, Fabio;Giachetti, Andrea
2020-01-01

Abstract

One of the most challenging aspects of the implementation of Virtual/Mixed reality training systems is the effective simulation of real-world manipulation of the physical devices included in control interfaces like buttons, sliders, levers, knobs, etc. In this paper we describe a mockup airplane cockpit (XR-Cockpit), featuring interactive components of this kind that demonstrate the feasibility of effective simulations of device manipulation using low cost hand tracking technology and gesture recognition. Based on this system, we performed a user study to compare the effectiveness of the interaction with virtual tools using different visualization solutions: immersive VR, optical and video see-through based MR. In our study, we also checked how well it is possible to perform manipulation of real objects wearing the two video see-through solutions. The analysis of the experimental results provides useful guidelines for the design of Virtual and Mixed Reality training systems involving virtual and physical actions on manipulation devices.
2020
978-1-7281-8956-7
Virtual Reality, Augmented Reality, User Study, Interaction
File in questo prodotto:
File Dimensione Formato  
IEEE_ETFA_XR_COCKPIT.pdf

solo utenti autorizzati

Descrizione: Articolo principale
Tipologia: Versione dell'editore
Licenza: Accesso ristretto
Dimensione 751.37 kB
Formato Adobe PDF
751.37 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11562/1030081
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 6
  • ???jsp.display-item.citation.isi??? 2
social impact