Hybrid Eye Tracking - Combining Iris Contour and Corneal Imaging

Alexander Plopski*, Christian Nitschke, Kiyoshi Kiyokawa, Dieter Schmalstieg, Haruo Takemura

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review


Passive eye-pose estimation methods that recover the eye-pose from natural images generally suffer from low accuracy, the result of a static eye model, and the recovery of the eye model from the estimated iris contour. Active eye-pose estimation methods use precisely calibrated light sources to estimate a user specific eye-model. These methods recover an accurate eye-pose at the cost of complex setups and additional hardware. A common application of eye-pose estimation is the recovery of the point-of-gaze (PoG) given a 3D model of the scene. We propose a novel method that exploits this 3D model to recover the eye-pose and the corresponding PoG from natural images. Our hybrid approach combines active and passive eye-pose estimation methods to recover an accurate eye-pose from natural images. We track the corneal reflection of the scene to estimate an accurate position of the eye and then determine its orientation. The positional constraint allows us to estimate user specific eye-model parameters and improve the orientation estimation. We compare our method with standard iris-contour tracking and show that our method is more robust and accurate than eye-pose estimation from the detected iris with a static iris size. Accurate passive eye-pose and PoG estimation allows users to naturally interact with the scene, e.g., augmented reality content, without the use of infra-red light sources
Original languageEnglish
Title of host publicationEurographics Symposium on Virtual Environments
Publication statusPublished - 2015
Event20th Eurographics Symposium on Virtual Environments: ICAT-EGVE 2015 - Kyoto, Japan
Duration: 28 Oct 201530 Oct 2015


Conference20th Eurographics Symposium on Virtual Environments
Abbreviated titleICAT-EGVE 2015

Fields of Expertise

  • Information, Communication & Computing

Cite this