Skip to content

Live Music Models

Authors
Antoine Caillon, Brian McWilliams, Cassie Tarakajian, Ian Simon, Ilaria Manco, Jesse Engel, Noah Constant, Yunpeng Li, Timo I. Denk, Alberto Lalama, Andrea Agostinelli, Cheng-Zhi Anna Huang, Ethan Manilow, George Brower, Hakan Erdogan, Heidi Lei, Itai Rolnick, Ivan Grishchenko, Manu Orsini, Matej Kastelic, Mauricio Zuluaga, Mauro Verzetti, Michael Dooley, Ondrej Skopek, Rafael Ferrer, Savvas Petridis, Zalan Borsos, Aaron van den Oord, Douglas Eck, Eli Collins, Jason Baldridge, Tom Hume, Chris Donahue, Kehang Han, Adam Roberts
Year
2025
Preprint
Identifiers
arXiv 2508.04651

Abstract

We introduce a new class of generative models for music called live music models that produce a continuous stream of music in real-time with synchronized user control. We release Magenta RealTime, an open-weights live music model that can be steered using text or audio prompts to control acoustic style. On automatic metrics of music quality, Magenta RealTime outperforms other open-weights music generation models, despite using fewer parameters and offering first-of-its-kind live generation capabilities. We also release Lyria RealTime, an API-based model with extended controls, offering access to our most powerful model with wide prompt coverage. These models demonstrate a new paradigm for AI-assisted music creation that emphasizes human-in-the-loop interaction for live music performance.

Knowledge Base

Map Tree Search

External

Document arXiv Abstract arXiv PDF arXiv HTML Google Scholar OpenAlex

Similar Papers

1
79%

Voxtral TTS

('Alexander H. Liu', 'Alexis Tacnet', 'Andy Ehrenberg', 'Andy Lo', 'Chen-Yo Sun', 'Guillaume Lample', 'Henry Lagarde', 'Jean-Malo Delignon', 'Jaeyoung Kim', 'John Harvill', 'Khyathi Raghavi Chandu', 'Lorenzo Signoretti', 'Margaret Jennings', 'Patrick von Platen', 'Pavankumar Reddy Muddireddy', 'Rohin Arora', 'Sanchit Gandhi', 'Samuel Humeau', 'Soham Ghosh', 'Srijan Mishra', 'Van Phung', 'Abdelaziz Bounhar', 'Abhinav Rastogi', 'Adrien Sade', 'Alan Jeffares', 'Albert Jiang', 'Alexandre Cahill', 'Alexandre Gavaudan', 'Alexandre Sablayrolles', 'Amelie Heliou', 'Amos You', 'Andrew Bai', 'Andrew Zhao', 'Angele Lenglemetz', 'Anmol Agarwal', 'Anton Eliseev', 'Antonia Calvi', 'Arjun Majumdar', 'Arthur Fournier', 'Artjom Joosen', 'Avi Sooriyarachchi', 'Aysenur Karaduman Utkur', 'Baptiste Bout', 'Baptiste Roziere', 'Baudouin De Monicault', 'Benjamin Tibi', 'Bowen Yang', 'Charlotte Cronjager', 'Clemence Lanfranchi', 'Connor Chen', 'Corentin Barreau', 'Corentin Sautier', 'Cyprien Courtot', 'Darius Dabert', 'Diego de las Casas', 'Elizaveta Demyanenko', 'Elliot Chane-Sane', 'Emmanuel Gottlob', 'Enguerrand Paquin', 'Etienne Goffinet', 'Fabien Niel', 'Faruk Ahmed', 'Federico Baldassarre', 'Gabrielle Berrada', 'Gaetan Ecrepont', 'Gauthier Guinet', 'Genevieve Hayes', 'Georgii Novikov', 'Giada Pistilli', 'Guillaume Kunsch', 'Guillaume Martin', 'Guillaume Raille', 'Gunjan Dhanuka', 'Gunshi Gupta', 'Han Zhou', 'Harshil Shah', 'Hope McGovern', 'Hugo Thimonier', 'Indraneel Mukherjee', 'Irene Zhang', 'Jacques Sun', 'Jan Ludziejewski', 'Jason Rute', 'Jeremie Dentan', 'Joachim Studnia', 'Jonas Amar', 'Josephine Delas', 'Josselin Somerville Roberts', 'Julien Tauran', 'Karmesh Yadav', 'Kartik Khandelwal', 'Kilian Tep', 'Kush Jain', 'Laurence Aitchison', 'Laurent Fainsin', 'Leonard Blier', 'Lingxiao Zhao', 'Louis Martin', 'Lucile Saulnier', 'Luyu Gao', 'Maarten Buyl', 'Manan Sharma', 'Marie Pellat', 'Mark Prins', 'Martin Alexandre', 'Mathieu Poiree', 'Mathieu Schmitt', 'Mathilde Guillaumin', 'Matthieu Dinot', 'Matthieu Futeral', 'Maxime Darrin', 'Maximilian Augustin', 'Mert Unsal', 'Mia Chiquier', 'Mikhail Biriuchinskii', 'Minh-Quang Pham', 'Mircea Lica', 'Morgane Riviere', 'Nathan Grinsztajn', 'Neha Gupta', 'Olivier Bousquet', 'Olivier Duchenne', 'Patricia Wang', 'Paul Jacob', 'Paul Wambergue', 'Paula Kurylowicz', 'Philippe Pinel', 'Philomene Chagniot', 'Pierre Stock', 'Piotr Milos', 'Prateek Gupta', 'Pravesh Agrawal', 'Quentin Torroba', 'Ram Ramrakhya', 'Randall Isenhour', 'Rishi Shah', 'Romain Sauvestre', 'Roman Soletskyi', 'Rosalie Millner', 'Rupert Menneer', 'Sagar Vaze', 'Samuel Barry', 'Samuel Belkadi', 'Sandeep Subramanian', 'Sean Cha', 'Shashwat Verma', 'Siddhant Waghjale', 'Siddharth Gandhi', 'Simon Lepage', 'Sumukh Aithal', 'Szymon Antoniak', 'Tarun Kumar Vangani', 'Teven Le Scao', 'Theo Cachet', 'Theo Simon Sorg', 'Thibaut Lavril', 'Thomas Chabal', 'Thomas Foubert', 'Thomas Robert', 'Thomas Wang', 'Tim Lawson', 'Tom Bewley', 'Tom Edwards', 'Tyler Wang', 'Umar Jamil', 'Umberto Tomasini', 'Valeriia Nemychnikova', 'Vedant Nanda', 'Victor Jouault', 'Vincent Maladiere', 'Vincent Pfister', 'Virgile Richard', 'Vladislav Bataev', 'Wassim Bouaziz', 'Wen-Ding Li', 'William Havard', 'William Marshall', 'Xinghui Li', 'Xingran Guo', 'Xinyu Yang', 'Yannic Neuhaus', 'Yassine El Ouahidi', 'Yassir Bendou', 'Yihan Wang', 'Yimu Pan', 'Zaccharie Ramzi', 'Zhenlin Xu') / 2026
Detail Map Tree Search
3
78%

Voxtral

('Alexander H. Liu', 'Andy Ehrenberg', 'Andy Lo', 'Clement Denoix', 'Corentin Barreau', 'Guillaume Lample', 'Jean-Malo Delignon', 'Khyathi Raghavi Chandu', 'Patrick von Platen', 'Pavankumar Reddy Muddireddy', 'Sanchit Gandhi', 'Soham Ghosh', 'Srijan Mishra', 'Thomas Foubert', 'Abhinav Rastogi', 'Adam Yang', 'Albert Q. Jiang', 'Alexandre Sablayrolles', 'Amelie Heliou', 'Amelie Martin', 'Anmol Agarwal', 'Antoine Roux', 'Arthur Darcet', 'Arthur Mensch', 'Baptiste Bout', 'Baptiste Roziere', 'Baudouin De Monicault', 'Chris Bamford', 'Christian Wallenwein', 'Christophe Renaudin', 'Clemence Lanfranchi', 'Darius Dabert', 'Devendra Singh Chaplot', 'Devon Mizelle', 'Diego de las Casas', 'Elliot Chane-Sane', 'Emilien Fugier', 'Emma Bou Hanna', 'Gabrielle Berrada', 'Gauthier Delerce', 'Gauthier Guinet', 'Georgii Novikov', 'Guillaume Martin', 'Himanshu Jaju', 'Jan Ludziejewski', 'Jason Rute', 'Jean-Hadrien Chabran', 'Jessica Chudnovsky', 'Joachim Studnia', 'Joep Barmentlo', 'Jonas Amar', 'Josselin Somerville Roberts', 'Julien Denize', 'Karan Saxena', 'Karmesh Yadav', 'Kartik Khandelwal', 'Kush Jain', 'Lelio Renard Lavaud', 'Leonard Blier', 'Lingxiao Zhao', 'Louis Martin', 'Lucile Saulnier', 'Luyu Gao', 'Marie Pellat', 'Mathilde Guillaumin', 'Mathis Felardos', 'Matthieu Dinot', 'Maxime Darrin', 'Maximilian Augustin', 'Mickael Seznec', 'Neha Gupta', 'Nikhil Raghuraman', 'Olivier Duchenne', 'Patricia Wang', 'Patryk Saffer', 'Paul Jacob', 'Paul Wambergue', 'Paula Kurylowicz', 'Philomene Chagniot', 'Pierre Stock', 'Pravesh Agrawal', 'Remi Delacourt', 'Romain Sauvestre', 'Roman Soletskyi', 'Sagar Vaze', 'Sandeep Subramanian', 'Saurabh Garg', 'Shashwat Dalal', 'Siddharth Gandhi', 'Sumukh Aithal', 'Szymon Antoniak', 'Teven Le Scao', 'Thibault Schueller', 'Thibaut Lavril', 'Thomas Robert', 'Thomas Wang', 'Timothee Lacroix', 'Tom Bewley', 'Valeriia Nemychnikova', 'Victor Paltz', 'Virgile Richard', 'Wen-Ding Li', 'William Marshall', 'Xuanyu Zhang', 'Yihan Wan', 'Yunhao Tang') / 2025
Detail Map Tree Search