The Rach3 Dataset: Towards Data-Driven Analysis of Piano Performance Rehearsal

Research output: Chapter in Book/Report/Conference proceedingConference proceedingspeer-review

Abstract

Musicians spend more time practicing than performing live, but the process of rehearsal has been understudied. This paper introduces a dataset for using AI and machine learning to address this gap. The project observes the progression of pianists learning new repertoire over long periods of time by recording their rehearsals, generating a comprehensive multimodal dataset, the Rach3 dataset, with video, audio, and MIDI for computational analysis. This dataset will help investigating the way in which advanced students and professional classical musicians, particularly pianists, learn new music and develop their own expressive interpretations of a piece.
Original languageEnglish
Title of host publicationProceedings of the Multimedia Modeling Conference MMM24
EditorsStevan Rudinac, Alan Hanjalic, Cynthia Liem, Marcel Worring, Björn Þór Jónsson, Bei Liu, Yoko Yamakata
Pages28-41
Number of pages14
DOIs
Publication statusPublished - Mar 2024

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14565 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Fields of science

  • 202002 Audiovisual media
  • 102 Computer Sciences
  • 102001 Artificial intelligence
  • 102003 Image processing
  • 102015 Information systems

JKU Focus areas

  • Digital Transformation

Cite this