Contour-Guided Gaze Gestures: Eye-based Interaction with Everyday Objects and IoT Devices

Florian Jungwirth; Michael Haslgrübler-Huemer; Alois Ferscha

doi:10.1145/3131542.3140262

Contour-Guided Gaze Gestures: Eye-based Interaction with Everyday Objects and IoT Devices

Florian Jungwirth, Michael Haslgrübler-Huemer, Alois Ferscha

Institute of Pervasive Computing

Research output: Chapter in Book/Report/Conference proceeding › Conference proceedings › peer-review

Abstract

The eyes are gaining increasing interest within the HCI (human-computer interaction) community as they are a fast and accurate input modality. However, the applicability of mobile eye-based HCI so far is restricted by several issues, such as calibration or the Midas Touch Problem [5]. In this work we propose the idea of contour-guided gaze gestures, which overcome these problems by relying on relative eye movements, as users trace the contours of (interactive) objects within a smart environment. Matching the trajectory of the eye movements and the contour's shape allows to estimate which object was interacted with and to trigger the corresponding actions. We describe the concept of the system and illustrate several application scenarios, demonstrating its value.

Original language	English
Title of host publication	Proceedings of the 7th International Conference on the Internet of Things
Editors	Simon Mayer, Stefan Schneegass, Bernhard Anzengruber-Tánase, Alois Ferscha, Gabriele Anderst-Kotsis, Joseph Paradiso
Publisher	ACM DL
Number of pages	2
DOIs	https://doi.org/10.1145/3131542.3140262
Publication status	Published - 2017

Fields of science

102 Computer Sciences
102009 Computer simulation
102013 Human-computer interaction
102019 Machine learning
102021 Pervasive computing
102022 Software development
102025 Distributed systems

JKU Focus areas

Computation in Informatics and Mathematics
Engineering and Natural Sciences (in general)

Access to Document

10.1145/3131542.3140262

EyeControl: Eye-Controlled Machines
Amrouche, S. (Researcher), Campos, Y. (Researcher), Elancheliyan, P. (Researcher), Gollan, B. (Researcher), Haslgrübler-Huemer, M. (Researcher), Jungwirth, F. (Researcher), Murauer, M. (Researcher), Timofeev, M. (Researcher), Wirth, C. (Researcher) & Ferscha, A. (PI)
01.09.2016 → 28.02.2020
Project: Funded research › FFG - Austrian Research Promotion Agency

Cite this

Jungwirth, F., Haslgrübler-Huemer, M., & Ferscha, A. (2017). Contour-Guided Gaze Gestures: Eye-based Interaction with Everyday Objects and IoT Devices. In Simon Mayer, Stefan Schneegass, Bernhard Anzengruber-Tánase, Alois Ferscha, Gabriele Anderst-Kotsis, Joseph Paradiso (Ed.), Proceedings of the 7th International Conference on the Internet of Things ACM DL. https://doi.org/10.1145/3131542.3140262

Jungwirth, Florian ; Haslgrübler-Huemer, Michael ; Ferscha, Alois. / Contour-Guided Gaze Gestures: Eye-based Interaction with Everyday Objects and IoT Devices. Proceedings of the 7th International Conference on the Internet of Things. editor / Simon Mayer, Stefan Schneegass, Bernhard Anzengruber-Tánase, Alois Ferscha, Gabriele Anderst-Kotsis, Joseph Paradiso. ACM DL, 2017.

@inproceedings{30f80813c1da46d0acf93f539c4bbd17,

title = "Contour-Guided Gaze Gestures: Eye-based Interaction with Everyday Objects and IoT Devices",

abstract = "The eyes are gaining increasing interest within the HCI (human-computer interaction) community as they are a fast and accurate input modality. However, the applicability of mobile eye-based HCI so far is restricted by several issues, such as calibration or the Midas Touch Problem [5]. In this work we propose the idea of contour-guided gaze gestures, which overcome these problems by relying on relative eye movements, as users trace the contours of (interactive) objects within a smart environment. Matching the trajectory of the eye movements and the contour's shape allows to estimate which object was interacted with and to trigger the corresponding actions. We describe the concept of the system and illustrate several application scenarios, demonstrating its value.",

author = "Florian Jungwirth and Michael Haslgr{\"u}bler-Huemer and Alois Ferscha",

year = "2017",

doi = "10.1145/3131542.3140262",

language = "English",

editor = "\{Simon Mayer, Stefan Schneegass, Bernhard Anzengruber-T{\'a}nase, Alois Ferscha, Gabriele Anderst-Kotsis, Joseph Paradiso\}",

booktitle = "Proceedings of the 7th International Conference on the Internet of Things",

publisher = "ACM DL",

}

Jungwirth, F, Haslgrübler-Huemer, M & Ferscha, A 2017, Contour-Guided Gaze Gestures: Eye-based Interaction with Everyday Objects and IoT Devices. in Simon Mayer, Stefan Schneegass, Bernhard Anzengruber-Tánase, Alois Ferscha, Gabriele Anderst-Kotsis, Joseph Paradiso (ed.), Proceedings of the 7th International Conference on the Internet of Things. ACM DL. https://doi.org/10.1145/3131542.3140262

Contour-Guided Gaze Gestures: Eye-based Interaction with Everyday Objects and IoT Devices. / Jungwirth, Florian; Haslgrübler-Huemer, Michael; Ferscha, Alois.
Proceedings of the 7th International Conference on the Internet of Things. ed. / Simon Mayer, Stefan Schneegass, Bernhard Anzengruber-Tánase, Alois Ferscha, Gabriele Anderst-Kotsis, Joseph Paradiso. ACM DL, 2017.

Research output: Chapter in Book/Report/Conference proceeding › Conference proceedings › peer-review

TY - GEN

T1 - Contour-Guided Gaze Gestures: Eye-based Interaction with Everyday Objects and IoT Devices

AU - Jungwirth, Florian

AU - Haslgrübler-Huemer, Michael

AU - Ferscha, Alois

PY - 2017

Y1 - 2017

N2 - The eyes are gaining increasing interest within the HCI (human-computer interaction) community as they are a fast and accurate input modality. However, the applicability of mobile eye-based HCI so far is restricted by several issues, such as calibration or the Midas Touch Problem [5]. In this work we propose the idea of contour-guided gaze gestures, which overcome these problems by relying on relative eye movements, as users trace the contours of (interactive) objects within a smart environment. Matching the trajectory of the eye movements and the contour's shape allows to estimate which object was interacted with and to trigger the corresponding actions. We describe the concept of the system and illustrate several application scenarios, demonstrating its value.

AB - The eyes are gaining increasing interest within the HCI (human-computer interaction) community as they are a fast and accurate input modality. However, the applicability of mobile eye-based HCI so far is restricted by several issues, such as calibration or the Midas Touch Problem [5]. In this work we propose the idea of contour-guided gaze gestures, which overcome these problems by relying on relative eye movements, as users trace the contours of (interactive) objects within a smart environment. Matching the trajectory of the eye movements and the contour's shape allows to estimate which object was interacted with and to trigger the corresponding actions. We describe the concept of the system and illustrate several application scenarios, demonstrating its value.

U2 - 10.1145/3131542.3140262

DO - 10.1145/3131542.3140262

M3 - Conference proceedings

BT - Proceedings of the 7th International Conference on the Internet of Things

A2 - Simon Mayer, Stefan Schneegass, Bernhard Anzengruber-Tánase, Alois Ferscha, Gabriele Anderst-Kotsis, Joseph Paradiso, null

PB - ACM DL

ER -

Jungwirth F, Haslgrübler-Huemer M, Ferscha A. Contour-Guided Gaze Gestures: Eye-based Interaction with Everyday Objects and IoT Devices. In Simon Mayer, Stefan Schneegass, Bernhard Anzengruber-Tánase, Alois Ferscha, Gabriele Anderst-Kotsis, Joseph Paradiso, editor, Proceedings of the 7th International Conference on the Internet of Things. ACM DL. 2017 doi: 10.1145/3131542.3140262

Contour-Guided Gaze Gestures: Eye-based Interaction with Everyday Objects and IoT Devices

Abstract

Fields of science

JKU Focus areas

Access to Document

Projects

EyeControl: Eye-Controlled Machines

Cite this