Skip to content

Voxtral

Authors
Alexander H. Liu, Andy Ehrenberg, Andy Lo, Clement Denoix, Corentin Barreau, Guillaume Lample, Jean-Malo Delignon, Khyathi Raghavi Chandu, Patrick von Platen, Pavankumar Reddy Muddireddy, Sanchit Gandhi, Soham Ghosh, Srijan Mishra, Thomas Foubert, Abhinav Rastogi, Adam Yang, Albert Q. Jiang, Alexandre Sablayrolles, Amelie Heliou, Amelie Martin, Anmol Agarwal, Antoine Roux, Arthur Darcet, Arthur Mensch, Baptiste Bout, Baptiste Roziere, Baudouin De Monicault, Chris Bamford, Christian Wallenwein, Christophe Renaudin, Clemence Lanfranchi, Darius Dabert, Devendra Singh Chaplot, Devon Mizelle, Diego de las Casas, Elliot Chane-Sane, Emilien Fugier, Emma Bou Hanna, Gabrielle Berrada, Gauthier Delerce, Gauthier Guinet, Georgii Novikov, Guillaume Martin, Himanshu Jaju, Jan Ludziejewski, Jason Rute, Jean-Hadrien Chabran, Jessica Chudnovsky, Joachim Studnia, Joep Barmentlo, Jonas Amar, Josselin Somerville Roberts, Julien Denize, Karan Saxena, Karmesh Yadav, Kartik Khandelwal, Kush Jain, Lelio Renard Lavaud, Leonard Blier, Lingxiao Zhao, Louis Martin, Lucile Saulnier, Luyu Gao, Marie Pellat, Mathilde Guillaumin, Mathis Felardos, Matthieu Dinot, Maxime Darrin, Maximilian Augustin, Mickael Seznec, Neha Gupta, Nikhil Raghuraman, Olivier Duchenne, Patricia Wang, Patryk Saffer, Paul Jacob, Paul Wambergue, Paula Kurylowicz, Philomene Chagniot, Pierre Stock, Pravesh Agrawal, Remi Delacourt, Romain Sauvestre, Roman Soletskyi, Sagar Vaze, Sandeep Subramanian, Saurabh Garg, Shashwat Dalal, Siddharth Gandhi, Sumukh Aithal, Szymon Antoniak, Teven Le Scao, Thibault Schueller, Thibaut Lavril, Thomas Robert, Thomas Wang, Timothee Lacroix, Tom Bewley, Valeriia Nemychnikova, Victor Paltz, Virgile Richard, Wen-Ding Li, William Marshall, Xuanyu Zhang, Yihan Wan, Yunhao Tang
Year
Identifiers

Abstract

We present Voxtral Mini and Voxtral Small, two multimodal audio chat models. Voxtral is trained to comprehend both spoken audio and text documents, achieving state-of-the-art performance across a diverse range of audio benchmarks, while preserving strong text capabilities. Voxtral Small outperforms a number of closed-source models, while being small enough to run locally. A 32K context window enables the model to handle audio files up to 40 minutes in duration and long multi-turn conversations. We also contribute three benchmarks for evaluating speech understanding models on knowledge and trivia. Both Voxtral models are released under Apache 2.0 license.

Similar Papers

1
90%

Voxtral TTS

('Alexander H. Liu', 'Alexis Tacnet', 'Andy Ehrenberg', 'Andy Lo', 'Chen-Yo Sun', 'Guillaume Lample', 'Henry Lagarde', 'Jean-Malo Delignon', 'Jaeyoung Kim', 'John Harvill', 'Khyathi Raghavi Chandu', 'Lorenzo Signoretti', 'Margaret Jennings', 'Patrick von Platen', 'Pavankumar Reddy Muddireddy', 'Rohin Arora', 'Sanchit Gandhi', 'Samuel Humeau', 'Soham Ghosh', 'Srijan Mishra', 'Van Phung', 'Abdelaziz Bounhar', 'Abhinav Rastogi', 'Adrien Sade', 'Alan Jeffares', 'Albert Jiang', 'Alexandre Cahill', 'Alexandre Gavaudan', 'Alexandre Sablayrolles', 'Amelie Heliou', 'Amos You', 'Andrew Bai', 'Andrew Zhao', 'Angele Lenglemetz', 'Anmol Agarwal', 'Anton Eliseev', 'Antonia Calvi', 'Arjun Majumdar', 'Arthur Fournier', 'Artjom Joosen', 'Avi Sooriyarachchi', 'Aysenur Karaduman Utkur', 'Baptiste Bout', 'Baptiste Roziere', 'Baudouin De Monicault', 'Benjamin Tibi', 'Bowen Yang', 'Charlotte Cronjager', 'Clemence Lanfranchi', 'Connor Chen', 'Corentin Barreau', 'Corentin Sautier', 'Cyprien Courtot', 'Darius Dabert', 'Diego de las Casas', 'Elizaveta Demyanenko', 'Elliot Chane-Sane', 'Emmanuel Gottlob', 'Enguerrand Paquin', 'Etienne Goffinet', 'Fabien Niel', 'Faruk Ahmed', 'Federico Baldassarre', 'Gabrielle Berrada', 'Gaetan Ecrepont', 'Gauthier Guinet', 'Genevieve Hayes', 'Georgii Novikov', 'Giada Pistilli', 'Guillaume Kunsch', 'Guillaume Martin', 'Guillaume Raille', 'Gunjan Dhanuka', 'Gunshi Gupta', 'Han Zhou', 'Harshil Shah', 'Hope McGovern', 'Hugo Thimonier', 'Indraneel Mukherjee', 'Irene Zhang', 'Jacques Sun', 'Jan Ludziejewski', 'Jason Rute', 'Jeremie Dentan', 'Joachim Studnia', 'Jonas Amar', 'Josephine Delas', 'Josselin Somerville Roberts', 'Julien Tauran', 'Karmesh Yadav', 'Kartik Khandelwal', 'Kilian Tep', 'Kush Jain', 'Laurence Aitchison', 'Laurent Fainsin', 'Leonard Blier', 'Lingxiao Zhao', 'Louis Martin', 'Lucile Saulnier', 'Luyu Gao', 'Maarten Buyl', 'Manan Sharma', 'Marie Pellat', 'Mark Prins', 'Martin Alexandre', 'Mathieu Poiree', 'Mathieu Schmitt', 'Mathilde Guillaumin', 'Matthieu Dinot', 'Matthieu Futeral', 'Maxime Darrin', 'Maximilian Augustin', 'Mert Unsal', 'Mia Chiquier', 'Mikhail Biriuchinskii', 'Minh-Quang Pham', 'Mircea Lica', 'Morgane Riviere', 'Nathan Grinsztajn', 'Neha Gupta', 'Olivier Bousquet', 'Olivier Duchenne', 'Patricia Wang', 'Paul Jacob', 'Paul Wambergue', 'Paula Kurylowicz', 'Philippe Pinel', 'Philomene Chagniot', 'Pierre Stock', 'Piotr Milos', 'Prateek Gupta', 'Pravesh Agrawal', 'Quentin Torroba', 'Ram Ramrakhya', 'Randall Isenhour', 'Rishi Shah', 'Romain Sauvestre', 'Roman Soletskyi', 'Rosalie Millner', 'Rupert Menneer', 'Sagar Vaze', 'Samuel Barry', 'Samuel Belkadi', 'Sandeep Subramanian', 'Sean Cha', 'Shashwat Verma', 'Siddhant Waghjale', 'Siddharth Gandhi', 'Simon Lepage', 'Sumukh Aithal', 'Szymon Antoniak', 'Tarun Kumar Vangani', 'Teven Le Scao', 'Theo Cachet', 'Theo Simon Sorg', 'Thibaut Lavril', 'Thomas Chabal', 'Thomas Foubert', 'Thomas Robert', 'Thomas Wang', 'Tim Lawson', 'Tom Bewley', 'Tom Edwards', 'Tyler Wang', 'Umar Jamil', 'Umberto Tomasini', 'Valeriia Nemychnikova', 'Vedant Nanda', 'Victor Jouault', 'Vincent Maladiere', 'Vincent Pfister', 'Virgile Richard', 'Vladislav Bataev', 'Wassim Bouaziz', 'Wen-Ding Li', 'William Havard', 'William Marshall', 'Xinghui Li', 'Xingran Guo', 'Xinyu Yang', 'Yannic Neuhaus', 'Yassine El Ouahidi', 'Yassir Bendou', 'Yihan Wang', 'Yimu Pan', 'Zaccharie Ramzi', 'Zhenlin Xu') / 2026
2
78%

Live Music Models

('Antoine Caillon', 'Brian McWilliams', 'Cassie Tarakajian', 'Ian Simon', 'Ilaria Manco', 'Jesse Engel', 'Noah Constant', 'Yunpeng Li', 'Timo I. Denk', 'Alberto Lalama', 'Andrea Agostinelli', 'Cheng-Zhi Anna Huang', 'Ethan Manilow', 'George Brower', 'Hakan Erdogan', 'Heidi Lei', 'Itai Rolnick', 'Ivan Grishchenko', 'Manu Orsini', 'Matej Kastelic', 'Mauricio Zuluaga', 'Mauro Verzetti', 'Michael Dooley', 'Ondrej Skopek', 'Rafael Ferrer', 'Savvas Petridis', 'Zalan Borsos', 'Aaron van den Oord', 'Douglas Eck', 'Eli Collins', 'Jason Baldridge', 'Tom Hume', 'Chris Donahue', 'Kehang Han', 'Adam Roberts') / 2025
5
68%

GPT-4o System Card

('Aaron Hurst', 'Adam Lerer', 'Adam P. Goucher', 'Adam Perelman', 'Aditya Ramesh', 'Aidan Clark', 'AJ Ostrow', 'Akila Welihinda', 'Alan Hayes', 'Alec Radford', 'Aleksander Madry', 'Alex Baker-Whitcomb', 'Alex Beutel', 'Alex Borzunov', 'Alex Carney', 'Alex Chow', 'Alex Kirillov', 'Alex Nichol', 'Alex Paino', 'Alex Renzin', 'Alex Tachard Passos', 'Alexander Kirillov', 'Alexi Christakis', 'Alexis Conneau', 'Ali Kamali', 'Allan Jabri', 'Allison Moyer', 'Allison Tam', 'Amadou Crookes', 'Amin Tootoochian', 'Amin Tootoonchian', 'Ananya Kumar', 'Andrea Vallone', 'Andrej Karpathy', 'Andrew Braunstein', 'Andrew Cann', 'Andrew Codispoti', 'Andrew Galu', 'Andrew Kondrich', 'Andrew Tulloch', 'Andrey Mishchenko', 'Angela Baek', 'Angela Jiang', 'Antoine Pelisse', 'Antonia Woodford', 'Anuj Gosalia', 'Arka Dhar', 'Ashley Pantuliano', 'Avi Nayak', 'Avital Oliver', 'Barret Zoph', 'Behrooz Ghorbani', 'Ben Leimberger', 'Ben Rossen', 'Ben Sokolowsky', 'Ben Wang', 'Benjamin Zweig', 'Beth Hoover', 'Blake Samic', 'Bob McGrew', 'Bobby Spero', 'Bogo Giertler', 'Bowen Cheng', 'Brad Lightcap', 'Brandon Walkin', 'Brendan Quinn', 'Brian Guarraci', 'Brian Hsu', 'Bright Kellogg', 'Brydon Eastman', 'Camillo Lugaresi', 'Carroll Wainwright', 'Cary Bassin', 'Cary Hudson', 'Casey Chu', 'Chad Nelson', 'Chak Li', 'Chan Jun Shern', 'Channing Conger', 'Charlotte Barette', 'Chelsea Voss', 'Chen Ding', 'Cheng Lu', 'Chong Zhang', 'Chris Beaumont', 'Chris Hallacy', 'Chris Koch', 'Christian Gibson', 'Christina Kim', 'Christine Choi', 'Christine McLeavey', 'Christopher Hesse', 'Claudia Fischer', 'Clemens Winter', 'Coley Czarnecki', 'Colin Jarvis', 'Colin Wei', 'Constantin Koumouzelis', 'Dane Sherburn', 'Daniel Kappler', 'Daniel Levin', 'Daniel Levy', 'David Carr', 'David Farhi', 'David Mely', 'David Robinson', 'David Sasaki', 'Denny Jin', 'Dev Valladares', 'Dimitris Tsipras', 'Doug Li', 'Duc Phong Nguyen', 'Duncan Findlay', 'Edede Oiwoh', 'Edmund Wong', 'Ehsan Asdar', 'Elizabeth Proehl', 'Elizabeth Yang', 'Eric Antonow', 'Eric Kramer', 'Eric Peterson', 'Eric Sigler', 'Eric Wallace', 'Eugene Brevdo', 'Evan Mays', 'Farzad Khorasani', 'Felipe Petroski Such', 'Filippo Raso', 'Francis Zhang', 'Fred von Lohmann', 'Freddie Sulit', 'Gabriel Goh', 'Gene Oden', 'Geoff Salmon', 'Giulio Starace', 'Greg Brockman', 'Hadi Salman', 'Haiming Bao', 'Haitang Hu', 'Hannah Wong', 'Haoyu Wang', 'Heather Schmidt', 'Heather Whitney', 'Heewoo Jun', 'Hendrik Kirchner', 'Henrique Ponde de Oliveira Pinto', 'Hongyu Ren', 'Huiwen Chang', 'Hyung Won Chung', 'Ian Kivlichan', "Ian O'Connell", "Ian O'Connell", 'Ian Osband', 'Ian Silber', 'Ian Sohl', 'Ibrahim Okuyucu', 'Ikai Lan', 'Ilya Kostrikov', 'Ilya Sutskever', 'Ingmar Kanitscheider', 'Ishaan Gulrajani', 'Jacob Coxon', 'Jacob Menick', 'Jakub Pachocki', 'James Aung', 'James Betker', 'James Crooks', 'James Lennon', 'Jamie Kiros', 'Jan Leike', 'Jane Park', 'Jason Kwon', 'Jason Phang', 'Jason Teplitz', 'Jason Wei', 'Jason Wolfe', 'Jay Chen', 'Jeff Harris', 'Jenia Varavva', 'Jessica Gan Lee', 'Jessica Shieh', 'Ji Lin', 'Jiahui Yu', 'Jiayi Weng', 'Jie Tang', 'Jieqi Yu', 'Joanne Jang', 'Joaquin Quinonero Candela', 'Joe Beutler', 'Joe Landers', 'Joel Parish', 'Johannes Heidecke', 'John Schulman', 'Jonathan Lachman', 'Jonathan McKay', 'Jonathan Uesato', 'Jonathan Ward', 'Jong Wook Kim', 'Joost Huizinga', 'Jordan Sitkin', 'Jos Kraaijeveld', 'Josh Gross', 'Josh Kaplan', 'Josh Snyder', 'Joshua Achiam', 'Joy Jiao', 'Joyce Lee', 'Juntang Zhuang', 'Justyn Harriman', 'Kai Fricke', 'Kai Hayashi', 'Karan Singhal', 'Katy Shi', 'Kavin Karthik', 'Kayla Wood', 'Kendra Rimbach', 'Kenny Hsu', 'Kenny Nguyen', 'Keren Gu-Lemberg', 'Kevin Button', 'Kevin Liu', 'Kiel Howe', 'Krithika Muthukumar', 'Kyle Luther', 'Lama Ahmad', 'Larry Kai', 'Lauren Itow', 'Lauren Workman', 'Leher Pathak', 'Leo Chen', 'Li Jing', 'Lia Guy', 'Liam Fedus', 'Liang Zhou', 'Lien Mamitsuka', 'Lilian Weng', 'Lindsay McCallum', 'Lindsey Held', 'Long Ouyang', 'Louis Feuvrier', 'Lu Zhang', 'Lukas Kondraciuk', 'Lukasz Kaiser', 'Luke Hewitt', 'Luke Metz', 'Lyric Doshi', 'Mada Aflak', 'Maddie Simens', 'Madelaine Boyd', 'Madeleine Thompson', 'Marat Dukhan', 'Mark Chen', 'Mark Gray', 'Mark Hudnall', 'Marvin Zhang', 'Marwan Aljubeh', 'Mateusz Litwin', 'Matthew Zeng', 'Max Johnson', 'Maya Shetty', 'Mayank Gupta', 'Meghan Shah', 'Mehmet Yatbaz', 'Meng Jia Yang', 'Mengchao Zhong', 'Mia Glaese', 'Mianna Chen', 'Michael Janner', 'Michael Lampe', 'Michael Petrov', 'Michael Wu', 'Michele Wang', 'Michelle Fradin', 'Michelle Pokrass', 'Miguel Castro', 'Miguel Oom Temudo de Castro', 'Mikhail Pavlov', 'Miles Brundage', 'Miles Wang', 'Minal Khan', 'Mira Murati', 'Mo Bavarian', 'Molly Lin', 'Murat Yesildal', 'Nacho Soto', 'Natalia Gimelshein', 'Natalie Cone', 'Natalie Staudacher', 'Natalie Summers', 'Natan LaFontaine', 'Neil Chowdhury', 'Nick Ryder', 'Nick Stathas', 'Nick Turley', 'Nik Tezak', 'Niko Felix', 'Nithanth Kudige', 'Nitish Keskar', 'Noah Deutsch', 'Noel Bundick', 'Nora Puckett', 'Ofir Nachum', 'Ola Okelola', 'Oleg Boiko', 'Oleg Murk', 'Oliver Jaffe', 'Olivia Watkins', 'Olivier Godement', 'Owen Campbell-Moore', 'Patrick Chao', 'Paul McMillan', 'Pavel Belov', 'Peng Su', 'Peter Bak', 'Peter Bakkum', 'Peter Deng', 'Peter Dolan', 'Peter Hoeschele', 'Peter Welinder', 'Phil Tillet', 'Philip Pronin', 'Philippe Tillet', 'Prafulla Dhariwal', 'Qiming Yuan', 'Rachel Dias', 'Rachel Lim', 'Rahul Arora', 'Rajan Troll', 'Randall Lin', 'Rapha Gontijo Lopes', 'Raul Puri', 'Reah Miyara', 'Reimar Leike', 'Renaud Gaubert', 'Reza Zamani', 'Ricky Wang', 'Rob Donnelly', 'Rob Honsby', 'Rocky Smith', 'Rohan Sahai', 'Rohit Ramchandani', 'Romain Huet', 'Rory Carmichael', 'Rowan Zellers', 'Roy Chen', 'Ruby Chen', 'Ruslan Nigmatullin', 'Ryan Cheu', 'Saachi Jain', 'Sam Altman', 'Sam Schoenholz', 'Sam Toizer', 'Samuel Miserendino', 'Sandhini Agarwal', 'Sara Culver', 'Scott Ethersmith', 'Scott Gray', 'Sean Grove', 'Sean Metzger', 'Shamez Hermani', 'Shantanu Jain', 'Shengjia Zhao', 'Sherwin Wu', 'Shino Jomoto', 'Shirong Wu', 'Shuaiqi Xia', 'Sonia Phene', 'Spencer Papay', 'Srinivas Narayanan', 'Steve Coffey', 'Steve Lee', 'Stewart Hall', 'Suchir Balaji', 'Tal Broda', 'Tal Stramer', 'Tao Xu', 'Tarun Gogineni', 'Taya Christianson', 'Ted Sanders', 'Tejal Patwardhan', 'Thomas Cunninghman', 'Thomas Degry', 'Thomas Dimson', 'Thomas Raoux', 'Thomas Shadwell', 'Tianhao Zheng', 'Todd Underwood', 'Todor Markov', 'Toki Sherbakov', 'Tom Rubin', 'Tom Stasi', 'Tomer Kaftan', 'Tristan Heywood', 'Troy Peterson', 'Tyce Walters', 'Tyna Eloundou', 'Valerie Qi', 'Veit Moeller', 'Vinnie Monaco', 'Vishal Kuo', 'Vlad Fomenko', 'Wayne Chang', 'Weiyi Zheng', 'Wenda Zhou', 'Wesam Manassra', 'Will Sheu', 'Wojciech Zaremba', 'Yash Patil', 'Yilei Qian', 'Yongjik Kim', 'Youlong Cheng', 'Yu Zhang', 'Yuchen He', 'Yuchen Zhang', 'Yujia Jin', 'Yunxing Dai', 'Yury Malkov') / 2024