Npw published in ACM Computing Surveys: Survey on the Evaluation of Generative Systems in Music.
Despite the rapid progress in generative music models, evaluating generative systems remains a major challenge. This comprehensive overview:
- Outlines key evaluation targets
- Compares methodologies across studies
- Discusses metrics and their limitations
The main goal of this text is to provide a clearer framework for assessing generative music systems — a crucial step toward more robust and meaningful research in this space. Writing this paper with Claire Arthur, Nick Bryan-Kinns, Corey Ford, Qianyi Sun, and Ashvala Vinay has been a long-term effort ideated at the ISMIR unconference in Milan 2023.
The Music Informatics Group is in the Georgia Tech School of Music, Georgia Tech College of Design.