Advancing Human-AI Research: Methodological Nuances from the HOXAI Project

Description

Understanding the impact of Explainable Artificial Intelligence (XAI) on decision-making and trust stands as a pivotal endeavor in human-AI interaction. The Austrian interdisciplinary HOXAI - Hands on Explainable AI project presents a comprehensive exploration encompassing four empirical studies, each illuminating facets of AI‘s influence on human decision processes. In doing so, we conducted a series of experimental studies involving N > 1200 participants utilizing the context of mushroom picking aided by an AI classification system. Initially, we examined XAI effects on trust calibration through an online study, establishing the use case of mushroom hunting and developing suitable test items. Building upon this foundation, a subsequent conceptual replication study, within an immersive indoor forest installation, delved deeper into contextual nuances. An additional online experiment compared three different XAI methods, advancing our comprehension of explanation characteristics driving decision-making. Beyond the realms of trust, the project probed the moral attribution of AI-induced errors. This project offers five contributions that are thought-provoking and share methodological insights for fellow psychologists interested in human-AI interaction: 1. Establishing mushroom identification as a research context with characteristics crucial for studying trust, setting it apart from other contexts. 2. Demonstrating the effectiveness of XAI, inherently contributing to the field‘s understanding of human-AI interaction. 3. Replicating online findings in real-world settings to enhance mundane realism and ecological validity. 4. Leveraging immersion and gamification to ensure sustained participant motivation and engagement. 5. Elevating participant experience and science communication within an artistic environment, fostering both scientific engagement and public discourse.

Period	16 Sept 2024
Event title	53rd DGPs Congress/15th ÖGP Conference
Event type	Conference
Location	AustriaShow on map