The Last JITAI? Exploring Large Language Models for Issuing Just-in-Time Adaptive Interventions: Fostering Physical Activity in a Prospective Cardiac Rehabilitation Setting

  • David Haag
  • , Devender Kumar
  • , Sebastian Gruber
  • , Dominik P. Hofer
  • , Mahdi Sareban
  • , Gunnar Treff
  • , Josef Niebauer
  • , Christopher N. Bull
  • , Albrecht Schmidt
  • , Jan David Smeddinck

Research output: Chapter in Book/Report/Conference proceedingConference proceedingspeer-review

Abstract

We evaluated the viability of using Large Language Models (LLMs) to trigger and personalize content in Just-in-Time Adaptive Interventions (JITAIs) in digital health. As an interaction pattern representative of context-aware computing, JITAIs are being explored for their potential to support sustainable behavior change, adapting interventions to an individual's current context and needs. Challenging traditional JITAI implementation models, which face severe scalability and flexibility limitations, we tested GPT-4 for suggesting JITAIs in the use case of heart-healthy activity in cardiac rehabilitation. Using three personas representing patients affected by CVD with varying severeness and five context sets per persona, we generated 450 JITAI decisions and messages. These were systematically evaluated against those created by 10 laypersons (LayPs) and 10 healthcare professionals (HCPs). GPT-4-generated JITAIs surpassed human-generated intervention suggestions, outperforming both LayPs and HCPs across all metrics (i.e., appropriateness, engagement, effectiveness, and professionalism). These results highlight the potential of LLMs to enhance JITAI implementations in personalized health interventions, demonstrating how generative AI could revolutionize context-aware computing.
Original languageEnglish
Title of host publicationProceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI 2025), 26 April 2025 - 1 May 2025, Yokohama, Japan
EditorsNaomi Yamashita, Vanessa Evers, Koji Yatani, Xianghua Sharon Ding, Bongshin Lee, Marshini Chetty, Phoebe Toups-Dugas
PublisherACM Press
Number of pages18
ISBN (Electronic)9798400713941
ISBN (Print)979-8-4007-1394-1
DOIs
Publication statusPublished - May 2025

Fields of science

  • 102030 Semantic technologies
  • 502050 Business informatics
  • 102010 Database systems
  • 102035 Data science
  • 503008 E-learning
  • 502058 Digital transformation
  • 509026 Digitalisation research
  • 102033 Data mining
  • 102 Computer Sciences
  • 102027 Web engineering
  • 102028 Knowledge engineering
  • 102016 IT security
  • 102015 Information systems
  • 102025 Distributed systems

JKU Focus areas

  • Digital Transformation

Cite this