A 3D interface integrating head tracking and mouse input

Abstract

This paper describes a 3D multimodal user interface integrating 2D mouse input and 3D head tracking for 3D desktop virtual environments (DVE). A novel test-bed is proposed to evaluate the functionality and usability of this 3D interface by combining traditional direct manipulation techniques performed by the rotation of head to interact with the objects in 3D DVE that is composed of a relatively up-to-date desktop computer, a webcam and a mouse. We presume the results will indicate how suitable head tracking is as a 3D interface integrated with 2D interaction device to be used in a 3D DVE. © 2013 IEEE. © 2014 Elsevier B.V., All rights reserved.