Publications

A Design Space for Live Music Agents

Yewon Kim, Stephen Brade, Alexander Wang, David Zhou, Haven Kim, Bill Wang, Sung-Ju Lee, Hugo F Flores Garcia, Cheng-Zhi Anna Huang, Chris Donahue

CHI 2026

Agents in Concert: A Case-Study of Bringing AI to the Stage in Practice

Stephen Brade, Teng Ma, Lancelot Blanchard, Kimaya Lecamwasam, Carlos Mariano Salcedo, Suwan Kim, Perry Naseck, Andrew Li, Matthew R Michalek, Sebastian Franjou, Anna Huang

Generative Adversarial Post-Training Mitigates Reward Hacking in Live Human-AI Music Interaction

Y Wu, S Brade, T Ma, TJ Fowler, E Yang, B Banar, A Courville, N Jaques*, CZA Huang*

ICLR 2026

Latent Fourier Transform

Mason Wang, CZA Huang

ICLR 2026 (Oral)

Live Music Diffusion Models: Efficient Fine-Tuning and Post-Training of Interactive Diffusion Music Generators

Zachary Novack, Stephen Brade, Haven Kim, Hugo Flores García, Nithya Shikarpur, Chinmay Talegaonkar, Suwan Kim, Valerie K Chen, Julian McAuley, Taylor Berg-Kirkpatrick, Cheng-Zhi Anna Huang

arXiv preprint arXiv:2605.22717

Stemphonic: All-At-Once Flexible Multi-Stem Music Generation

Shih-Lun Wu, Ge Zhu, Juan-Pablo Caceres, Cheng-Zhi Anna Huang, Nicholas J Bryan

IEEE

Flam: Frame-wise Language-Audio Modeling

Yusong Wu, Christos Tsirigotis, Ke Chen, Cheng-Zhi Anna Huang, Aaron Courville, Oriol Nieto, Prem Seetharaman, Justin Salamon

ICML 2025

Live Music Models

Lyria Team, Antoine Caillon, Brian McWilliams, Cassie Tarakajian, Ian Simon, Ilaria Manco, Jesse Engel, Noah Constant, Yunpeng Li, Timo I Denk, Alberto Lalama, Andrea Agostinelli, Cheng-Zhi Anna Huang, Ethan Manilow, George Brower, Hakan Erdogan, Heidi Lei, Itai Rolnick, Ivan Grishchenko, Manu Orsini, Matej Kastelic, Mauricio Zuluaga, Mauro Verzetti, Michael Dooley, Ondrej Skopek, Rafael Ferrer, Savvas Petridis, Zalán Borsos, Äaron van den Oord, Douglas Eck, Eli Collins, Jason Baldridge, Tom Hume, Chris Donahue, Kehang Han, Adam Roberts

NeurIPS Creative AI Track 2025

MIDI-LLM: Adapting Large Language Models for Text-to-MIDI Music Generation

Shih-Lun Wu, Yoon Kim, Cheng-Zhi Anna Huang

arXiv preprint arXiv:2511.03942

MusicViz: Visualizing Decision Processes in Transformer-Based Music Models

Rachel Loh, Ashley Zhang, Heidi Lei, Lancelot Blanchard, Anna Huang, Eran Egozy

ReaLJam: Real-Time Human-AI Music Jamming with Reinforcement Learning-Tuned Transformers

Alexander Scarlatos, Yusong Wu, Ian Simon, Adam Roberts, Tim Cooijmans, Natasha Jaques, Cassie Tarakajian, Cheng-Zhi Anna Huang

CHI Late Breaking 2025

Streaming Generation for Music Accompaniment

Yusong Wu, Mason Wang, Heidi Lei, Stephen Brade, Lancelot Blanchard, Shih-Lun Wu, Aaron Courville, Anna Huang

arXiv preprint arXiv:2510.22105

The jam_bot, a Real-Time System for Collaborative Free Improvisation with Music Language Models

Lancelot Blanchard, Perry Naseck, Stephen Brade, Kimaya Lecamwasam, Jordan Rudess, Cheng-Zhi Anna Huang, Joseph Paradiso

Adaptive Accompaniment with ReaLchords

Yusong Wu, Tim Cooijmans, Kyle Kastner, Adam Roberts, Ian Simon, Alexander Scarlatos, Chris Donahue, Cassie Tarakajian, Shayegan Omidshafiei, Aaron Courville, Pablo Samuel Castro, Natasha Jaques, Cheng-Zhi Anna Huang

ICML 2024

Exploratory Study Of Human-AI Interaction For Hindustani Music

Nithya Shikarpur, Cheng-Zhi Anna Huang

NeurIPS Creative AI Track 2024

Hierarchical Generative Modeling of the Melodic Voice in Hindustani Classical Music

Nithya Shikarpur, Krishna-Maneesha Dendukuri, Yusong Wu, Antoine Caillon, Cheng-Zhi Anna Huang

ISMIR 2024

Expressive Communication: A Common Framework for Evaluating Developments in Generative Models and Steering Interfaces

Ryan Louie, Jesse Engel, Cheng-Zhi Anna Huang

MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modeling

Yusong Wu, Ethan Manilow, Yi Deng, Rigel Swavely, Kyle Kastner, Tim Cooijmans, Aaron Courville, Cheng-Zhi Anna Huang, Jesse Engel

Redefining relationships in music

Christian Detweiler, Beth Coleman, Fernando Diaz, Lieke Dom, Chris Donahue, Jesse Engel, Cheng-Zhi Anna Huang, Larry James, Ethan Manilow, Amanda McCroskery, Kyle Pedersen, Pamela Peter-Agbia, Negar Rostamzadeh, Robert Thomas, Marco Zamarato, Ben Zevenbergen

arXiv preprint arXiv:2212.08038

Compositional Steering of Music Transformers

Halley Young, Vincent Dumoulin, Pablo S Castro, Jesse Engel, Cheng-Zhi Anna Huang

Human-AI Co-Creation with Generative Models (HAI-GEN) Workshop

Editorial for TISMIR Special Collection: AI and Musical Creativity

Bob LT Sturm, Alexandra L Uitdenbogerd, Hendrik Vincent Koops, Anna Huang

Transactions of the International Society for Music Information Retrieval

Improving Source Separation by Explicitly Modeling Dependencies Between Sources

Ethan Manilow, Curtis Hawthorne, Cheng-Zhi Anna Huang, Bryan Pardo, Jesse Engel

ICASSP 2022

AI Song Contest: Human-AI Co-Creation in Songwriting

Cheng-Zhi Anna Huang, Hendrik Vincent Koops, Ed Newton-Rex, Monica Dinculescu, Carrie J Cai

Cococo: Novice-AI Music Co-Creation via AI-Steering Tools for Deep Generative Models

Ryan Louie, Andy Coenen, Cheng-Zhi Anna Huang, Michael Terry, Carrie J Cai

CHI 2020

Coucou: An Expanded Interface for Interactive Composition with Coconet, through Flexible Inpainting.(2019)

Monica Dinculescu, Cheng-Zhi Anna Huang

Deep Learning for Music Composition: Generation, Recommendation and Control

Cheng-Zhi Anna Huang

The Bach Doodle: Approachable music composition with machine learning at scale

Cheng-Zhi Anna Huang, Curtis Hawthorne, Adam Roberts, Monica Dinculescu, James Wexler, Leon Hong, Jacob Howcroft

ISMIR 2019

Enabling factorized piano music modeling and generation with the MAESTRO dataset

Curtis Hawthorne, Andriy Stasyuk, Adam Roberts, Ian Simon, Cheng-Zhi Anna Huang, Sander Dieleman, Erich Elsen, Jesse Engel, Douglas Eck

ICLR 2019

Infilling Piano Performances

Daphne Ippolito, Cheng-Zhi Anna Huang, Curtis Hawthorne, Douglas Eck

NeurIPS Workshop on Machine Learning for Creativity and Design

Music Transformer

Cheng-Zhi Anna Huang, Ashish Vaswani, Jakob Uszkoreit, Ian Simon, Curtis Hawthorne, Noam Shazeer, Andrew M Dai, Matthew D Hoffman, Monica Dinculescu, Douglas Eck

ICLR 2019

Towards Mixed-Initiative Generation of Multi-Channel Sequential Structure

Cheng-Zhi Anna Huang, Sherol Chen, Mark Nelson, Douglas Eck

ICLR 2018 Workshop

Transformer-NADE for Piano Performances

Curtis Hawthorne, Cheng-Zhi Anna Huang, Daphne Ippolito, Douglas Eck

NeurIPS Workshop on Machine Learning for Creativity and Design

Visualizing Music Transformer

Cheng-Zhi Anna Huang, Monica Dinculescu, Ashish Vaswani, Douglas Eck

NeurIPS 2018 Interpretability and Robustness for Audio, Speech and Language Workshop

Chordripple: Recommending chords to help novice composers go beyond the ordinary

Cheng-Zhi Anna Huang, David Duvenaud, Krzysztof Z Gajos

ACM

Counterpoint by convolution

Cheng-Zhi Anna Huang, Tim Cooijmans, Adam Roberts, Aaron Courville, Douglas Eck

ISMIR 2017

Active learning of intuitive control knobs for synthesizers using gaussian processes

Cheng-Zhi Anna Huang, David Duvenaud, Kenneth C Arnold, Brenton Partridge, Josiah W Oberholtzer, Krzysztof Z Gajos

ACM

Mathematics and Computation in Music 2009: John Clough Memorial Conference

Jonathan Bragg, Cheng-Zhi Anna Huang

The MIT Press

Melodic variations: toward cross-cultural transformation

Cheng-Zhi Anna Huang

Nightmarket workshops: art & science in action

Chia-Hsun Jackie Lee, Yi-Hsiang Daniel Chao, Edward Yu-Te Shen, Cheng-Zhi Anna Huang, Wu-Hsi Li, Marisa Jahn

ACM

Palestrina Pal: a grammar checker for music compositions in the style of Palestrina

Cheng Zhi Anna Huang, Elaine Chew

Conference on Understanding and Creating Music

Interactive Web-Based Chinese Poem Composer

Chin Shih Huang, Man Wai Liang, Cheng Zhi Huang, Hoi Lee Wong, Cheng Ran Huang

International Conference on Chinese Computing (ICCC)