Telling Eyes: Linking Eye-Tracking Indicators to Affective Variables

Research has tried to link affective states to different eye-tracking measures with varying success. Although previous research has proposed that using live eye-tracking data for video games could considerably enhance adaptive gameplay techniques’ capabilities, little research has been done. The main goal of the current study was to link eye-tracking indicators to affective states (confusion, frustration). Thirty-nine participants were recruited to play a riddle game in virtual reality similar to the game “Portal”, with levels differently manipulating affective states in a within-study design. Participants did self-rate confusion and frustration retrospectively watching a recording of their gameplay. It was shown that different levels of frustration and confusion could be evoked. Hypotheses about the relationship between confusion/frustration and eye-tracking data could only be partially supported. Analyses revealed various possible reasons for contradictory results and several implications for future research, including aspects of eye-tracking indicators and the underlying eye-tracking technology.