TrackCap: Enabling Smartphones for 3D Interaction on Mobile Head-Mounted Displays

Peter Mohr-Ziak, Markus Tatzgern, Tobias Langlotz, Andreas Lang, Dieter Schmalstieg, Denis Kalkofen

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review


The latest generation of consumer market Head-mounted displays (HMD) now include self-contained inside-out tracking of head motions, which makes them suitable for mobile applications. However, 3D tracking of input devices is either not included at all or requires to keep the device in sight, so that it can be observed from a sensor mounted on the HMD. Both approaches make natural interactions cumbersome in mobile applications. TrackCap, a novel approach for 3D tracking of input devices, turns a conventional smartphone into a precise 6DOF input device for an HMD user. The device can be conveniently operated both inside and outside the HMD's field of view, while it provides additional 2D input and output capabilities.
Original languageEnglish
Title of host publicationProceedings of the 2019 CHI Conference on Human Factors in Computing Systems
Number of pages585
Publication statusPublished - 2019


Dive into the research topics of 'TrackCap: Enabling Smartphones for 3D Interaction on Mobile Head-Mounted Displays'. Together they form a unique fingerprint.

Cite this