A Bermuda Triangle? A Review of Method Application and Triangulation in User Experience Evaluation

Ingrid Pettersson, Florian Lachner, Anna-Katharina Frison, Andreas Riener, Andreas Butz

Research output: Chapter in Book/Report/Conference proceedingConference proceedingspeer-review

Abstract

User experience (UX) evaluation is a growing field with diverse approaches. To understand the development since previous meta-review efforts, we conducted a state-of-the-art review of UX evaluation techniques with special attention to the triangulation between methods. We systematically selected and analyzed 100 papers from recent years and while we found an increase of relevant UX studies, we also saw a remaining overlap with pure usability evaluations. Positive trends include an increasing percentage of field rather than lab studies and a tendency to combine several methods in UX studies. Triangulation was applied in more than two thirds of the studies, and the most common method combination was questionnaires and interviews. Based on our analysis, we derive common patterns for triangulation in UX evaluation efforts. A critical discussion about existing approaches should help to obtain stronger results, especially when evaluating new technologies.
Original languageEnglish
Title of host publicationProceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, Montreal, QC, Canada, April 21-26, 2018
PublisherACM DL
Number of pages16
DOIs
Publication statusPublished - Apr 2018

Fields of science

  • 202017 Embedded systems
  • 102 Computer Sciences
  • 102009 Computer simulation
  • 102013 Human-computer interaction
  • 102019 Machine learning
  • 102020 Medical informatics
  • 102021 Pervasive computing
  • 102022 Software development
  • 102025 Distributed systems
  • 211902 Assistive technologies
  • 211912 Product design

JKU Focus areas

  • Computation in Informatics and Mathematics
  • Engineering and Natural Sciences (in general)

Cite this