Nemotron 3 Super: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
Authors
Aakshita Chandiramani,
Aaron Blakeman,
Abdullahi Olaoye,
Abhibha Gupta,
Abhilash Somasamudramath,
Abhinav Khattar,
Adeola Adesoba,
Adi Renduchintala,
Adil Asif,
Aditya Agrawal,
Aditya Vavre,
Ahmad Kiswani,
Aishwarya Padmakumar,
Ajay Hotchandani,
Akanksha Shukla,
Akhiad Bercovich,
Aleksander Ficek,
Aleksandr Shaposhnikov,
Alex Gronskiy,
Alex Kondratenko,
Alex Neefus,
Alex Steiner,
Alex Yang,
Alexander Bukharin,
Alexander Young,
Ali Hatamizadeh,
Ali Taghibakhshi,
Alina Galiautdinova,
Alisa Liu,
Alok Kumar,
Ameya Sunil Mahabaleshwarkar,
Amir Klein,
Amit Zuker,
Amnon Geifman,
Anahita Bhiwandiwalla,
Ananth Subramaniam,
Andrew Tao,
Anjaney Shrivastava,
Anjulie Agrusa,
Ankur Srivastava,
Ankur Verma,
Ann Guan,
Anna Shors,
Annamalai Chockalingam,
Anubhav Mandarwal,
Aparnaa Ramani,
Arham Mehta,
Arti Jain,
Arun Venkatesan,
Asha Anoosheh,
Ashwath Aithal,
Ashwin Poojary,
Asif Ahamed,
Asit Mishra,
Asli Sabanci Demiroz,
Asma Kuriparambil Thekkumpate,
Atefeh Sohrabizadeh,
Avinash Kaur,
Ayush Dattagupta,
Barath Subramaniam Anandan,
Bardiya Sadeghi,
Barnaby Simkin,
Ben Lanir,
Benedikt Schifferer,
Benjamin Chislett,
Besmira Nushi,
Bilal Kartal,
Bill Thiede,
Bita Darvish Rouhani,
Bobby Chen,
Boris Ginsburg,
Brandon Norick,
Branislav Kisacanin,
Brian Yu,
Bryan Catanzaro,
Buvaneswari Mani,
Carlo del Mundo,
Chankyu Lee,
Chanran Kim,
Chantal Hwang,
Chao Ni,
Charles Wang,
Charlie Truong,
Cheng-Ping Hsieh,
Chenhan Yu,
Chenjie Luo,
Cherie Wang,
Chetan Mungekar,
Chintan Patel,
Chris Alexiuk,
Chris Holguin,
Chris Wing,
Christian Munley,
Christopher Parisien,
Chuck Desai,
Chunyang Sheng,
Collin Neale,
Cyril Meurillon,
Dakshi Kumar,
Dan Gil,
Dan Su,
Dane Corneil,
Daniel Afrimi,
Daniel Burkhardt Eliuth Triana,
Daniel Egert,
Daniel Fatade,
Daniel Lo,
Daniel Rohrer,
Daniel Serebrenik,
Daniil Sorokin,
Daria Gitman,
Daria Levy,
Darko Stosic,
David Edelsohn,
David Messina,
David Mosallanezhad,
David Tamok,
Deena Donia,
Deepak Narayanan,
Devin O'Kelly,
Dheeraj Peri,
Dhruv Nathawani,
Di Wu,
Dima Rekesh,
Dina Yared,
Divyanshu Kakwani,
Dmitry Konyagin Brandon Tuttle,
Dong Ahn,
Dongfu Jiang,
Dorrin Poorkay,
Douglas O'Flaherty,
Duncan Riach,
Dusan Stosic,
Dustin Van Stee,
Edgar Minasyan,
Edward Lin,
Eileen Peters Long,
Elad Segal,
Elena Lantz,
Elena Lewis,
Ellie Evans,
Elliott Ning,
Eric Chung,
Eric Harper,
Eric Pham-Hung,
Eric W. Tramel,
Erick Galinkin,
Erik Pounds,
Esti Etrog,
Evan Briones,
Evan Wu,
Evelina Bakhturina,
Evgeny Tsykunov,
Ewa Dobrowolska,
Farshad Saberi Movahed,
Farzan Memarian,
Fay Wang,
Fei Jia,
Felipe Soares,
Felipe Vieira Frujeri,
Feng Chen,
Fengguang Lin,
Ferenc Galko,
Fortuna Zhang,
Frankie Siino,
Frida Hou,
Gantavya Bhatt,
Gargi Prasad,
Geethapriya Venkataramani,
Geetika Gupta,
George Armstrong,
Gerald Shen,
Giulio Borghesi,
Gordana Neskovic,
Gorkem Batmaz,
Grace Lam,
Grace Wu,
Greg Pauloski,
Greyson Davis,
Grigor Nalbandyan,
Guoming Zhang,
Guy Farber,
Guyue Huang,
Haifeng Qian,
Haran Kumar Shiv Kumar,
Harry Kim,
Harsh Sharma,
Hayate Iso,
Hayley Ross,
Herbert Hum,
Herman Sahota,
Hexin Wang,
Himanshu Soni,
Hiren Upadhyay,
Huy Nguyen,
Iain Cunningham,
Ido Galil,
Ido Shahaf,
Igino Padovani,
Igor Gitman,
Igor Shovkun,
Ikroop Dhillon,
Ilya Loshchilov,
Ingrid Kelly,
Itamar Schen,
Itay Levy,
Ivan Moshkov,
Izik Golan,
Izzy Putterman,
Jain Tu,
Jan Baczek,
Jan Kautz,
Jane Polak Scowcroft,
Janica Rosenberg,
Jared Casper,
Jarrod Pflum,
Jason Grant,
Jason Sewall,
Jatin Mitra,
Jeffrey Glick,
Jenny Chen,
Jesse Oliver,
Jiacheng Xu,
Jiafan Zhu,
Jialin Song,
Jian Zhang,
Jiaqi Zeng,
Jie Lou,
Jill Milton,
Jim Chow,
Jimmy Zhang,
Jinhang Choi,
Jining Huang,
Jocelyn Huang,
Joel Caruso,
Joey Conway,
Joey Guman,
Johan Jatko,
John Kamalu,
Johnny Greco,
Jonathan Cohen,
Jonathan Raiman,
Joseph Jennings,
Joyjit Daw,
Juan Yu,
Julio Tapia,
Junkeun Yi,
Jupinder Parmar,
Jyothi Achar,
Kari Briski,
Kartik Mattoo,
Katherine Cheung,
Katherine Luna,
Keith Wyss,
Kevin Shih,
Kezhi Kong,
Khanh Nguyen,
Khushi Bhardwaj,
Kirill Buryak,
Kirthi Shankar Sivamani,
Konstantinos Krommydas,
Kris Murphy,
Krishna C. Puvvada,
Krzysztof Pawelec,
Kumar Anik,
Laikh Tewari,
Laya Sleiman,
Leo Du,
Leon Derczynski,
Li Ding,
Lilach Ilan,
Lingjie Wu,
Lizzie Wei,
Luis Vega,
Lun Su,
Maarten Van Segbroeck,
Maer Rodrigues de Melo,
Magaret Zhang,
Mahan Fathi,
Makesh Narsimhan Sreedhar,
Makesh Sreedhar,
Makesh Tarun Chandran,
Manuel Reyes Gomez,
Maor Ashkenazi,
Marc Cuevas,
Marc Romeijn,
Margaret Zhang,
Mark Cai,
Mark Gabel,
Markus Kliegl,
Martyna Patelka,
Maryam Moosaei,
Matthew Varacalli,
Matvei Novikov,
Mauricio Ferrato,
Mehrzad Samadi,
Melissa Corpuz,
Meng Xin,
Mengdi Wang,
Mengru Wang,
Meredith Price,
Micah Schaffer,
Michael Andersch,
Michael Boone,
Michael Evans,
Michael Z Wang,
Miguel Martinez,
Mikail Khona,
Mike Chrzanowski,
Mike Hollinger,
Mingyuan Ma,
Minseok Lee,
Mohammad Dabbah,
Mohammad Shoeybi,
Mostofa Patwary,
Nabin Mulepati,
Nader Khalil,
Najeeb Nabwani,
Nancy Agarwal,
Nanthini Balasubramaniam,
Narimane Hennouni,
Narsi Kodukula,
Natalie Hereth,
Nathaniel Pinckney,
Nave Assaf,
Negar Habibi,
Nestor Qin,
Neta Zmora,
Netanel Haber,
Nick Reamaroon,
Nickson Quak,
Nidhi Bhatia,
Nikhil Jukar,
Nikki Pope,
Nikolai Ludwig,
Nima Tajbakhsh,
Nir Ailon,
Nirmal Juluru,
Nirmalya De,
Nowel Pitt,
Oleg Rybakov,
Oleksii Hrinchuk,
Oleksii Kuchaiev,
Olivier Delalleau,
Oluwatobi Olabiyi,
Omer Ullman Argov,
Omri Almog,
Omri Puny,
Oren Tropp,
Otavio Padovani,
Ouye Xie,
Parth Chadha,
Pasha Shamis,
Paul Gibbons,
Pavlo Molchanov,
Peter Belcak,
Peter Jin,
Pinky Xu,
Piotr Januszewski,
Pooya Jannaty,
Prachi Shevate,
Pradeep Thalasta,
Pranav Prashant Thombre,
Prasoon Varshney,
Prerana Gambhir,
Pritam Gundecha,
Przemek Tredak,
Qing Miao,
Qiyu Wan,
Quan Tran Minh,
Rabeeh Karimi Mahabadi,
Rachel Oberman,
Rachit Garg,
Rahul Kandu,
Raina Zhong,
Ran El-Yaniv,
Ran Zilberstein,
Rasoul Shafipour,
Renee Yao,
Renjie Pi,
Richard Mazzarese,
Richard Wang,
Rick Izzo,
Ridhima Singla,
Rima Shahbazyan,
Rishabh Garg,
Ritika Borkar,
Ritu Gala,
Riyad Islam,
Robert Clark,
Robert Hesse,
Roger Waleffe,
Rohit Varma Kalidindi,
Rohit Watve,
Roi Koren,
Ron Fan,
Ruchika Kharwar,
Ruisi Cai,
Ruoxi Zhang,
Russell J. Hewett,
Ryan Prenger,
Ryan Timbrook,
Ryota Egashira,
Sadegh Mahdavi,
Sagar Singh Ashutosh Joshi,
Sahil Modi,
Samuel Kriman,
Sandeep Pombra,
Sanjay Kariyappa,
Sanjeev Satheesh,
Santiago Pombo,
Saori Kaji,
Satish Pasumarthi,
Saurav Mishra,
Saurav Muralidharan,
Scott Hara,
Sean Narenthiran,
Sebastian Rogawski,
Seonjin Na,
Seonmyeong Bak,
Sepehr Sameni,
Seth Poulos,
Shahar Mor,
Shantanu Acharya,
Shaona Ghosh Adam Lord,
Sharath Turuvekere Sreenivas,
Shaun Kotek,
Shaya Gharghabi,
Shelby Thomas,
Sheng-Chieh Lin,
Shibani Likhite,
Shiqing Fan,
Shiyang Chen,
Shreya Gopal,
Shrimai Prabhumoye,
Shubham Pachori,
Shubham Toshniwal,
Shuo Zhang,
Shuoyang Ding,
Shyam Renjith,
Shyamala Prayaga,
Siddhartha Jain,
Simeng Sun,
Sirisha Rella,
Sirshak Das,
Smita Ithape,
Sneha Harishchandra S,
Somshubra Majumdar,
Soumye Singhal,
Sri Harsha Singudasu,
Sriharsha Niverty,
Stas Sergienko,
Stefana Gloginic,
Stefania Alborghetti,
Stephen Ge,
Stephen McCullough,
Sugam Dipak Devare,
Suguna Varshini Velury,
Sukrit Rao,
Sumeet Kumar Barua,
Sunny Gai,
Suseella Panguluri,
Sushil Koundinyan,
Swathi Patnam,
Sweta Priyadarshi,
Swetha Bhendigeri,
Syeda Nahida Akter,
Sylendran Arunagiri,
Tailling Yuan,
Talor Abramovich,
Tan Bui,
Tan Yu,
Terry Kong,
Thanh Do,
Thomas Gburek,
Thorgane Marques,
Tiffany Moore,
Tijmen Blankevoort,
Tim Moon,
Timothy Ma,
Tiyasa Mitra,
Tomasz Grzegorzek,
Tomer Asida,
Tomer Bar Natan,
Tomer Keren,
Tomer Ronen,
Traian Rebedea,
Trenton Starkey,
Tugrul Konuk,
Twinkle Vashishth,
Tyler Condensa,
Udi Karpas,
Ushnish De,
Vahid Noorozi,
Vahid Noroozi,
Vanshil Atul Shah,
Veena Vaidyanathan,
Venkat Srinivasan,
Venmugil Elango,
Victor Cui,
Vijay Korthikanti,
Vikas Mehta,
Virginia Adams,
Virginia Wu,
Vitaly Kurin,
Vitaly Lavrukhin,
Vladimir Anisimov,
Wan Seo,
Wanli Jiang,
Wasi Uddin Ahmad,
Wei Du,
Wei Ping,
Wei-Ming Chen,
Wendy Quan,
Wenliang Dai,
Wenwen Gao,
Will Jennings,
William Zhang,
Xiaowei Ren,
Xiaowen Xin,
Xin Li,
Yang Yu,
Yangyi Chen,
Yaniv Galron,
Yashaswi Karnati,
Yejin Choi,
Yev Meyer,
Yi-Fu Wu,
Yian Zhang,
Ying Lin,
Yonatan Geifman,
Yonggan Fu,
Yoshi Suhara,
Youngeun Kwon,
Yuan Zhang,
Yuki Huang,
Zach Moshe,
Zhilin Wang,
Zhiyu Cheng,
Zhongbo Zhu,
Zhuolin Yang,
Zihan Liu,
Zijia Chen,
Zijie Yan,
Zuhair Ahmed
Identifiers
Abstract¶
We describe the pre-training, post-training, and quantization of Nemotron 3 Super, a 120 billion (active 12 billion) parameter hybrid Mamba-Attention Mixture-of-Experts model. Nemotron 3 Super is the first model in the Nemotron 3 family to 1) be pre-trained in NVFP4, 2) leverage LatentMoE, a new Mixture-of-Experts architecture that optimizes for both accuracy per FLOP and accuracy per parameter, and 3) include MTP layers for inference acceleration through native speculative decoding. We pre-trained Nemotron 3 Super on 25 trillion tokens followed by post-training using supervised fine tuning (SFT) and reinforcement learning (RL). The final model supports up to 1M context length and achieves comparable accuracy on common benchmarks, while also achieving up to 2.2x and 7.5x higher inference throughput compared to GPT-OSS-120B and Qwen3.5-122B, respectively. Nemotron 3 Super datasets, along with the base, post-trained, and quantized checkpoints, are open-sourced on HuggingFace.
Links¶
Knowledge Base
External
Similar Papers¶
1
86%
Kimi K2: Open Agentic Intelligence
Kimi K2
('Yifan Bai', 'Yiping Bao', 'Y. Charles', 'Cheng Chen', 'Guanduo Chen', 'Haiting Chen', 'Huarong Chen', 'Jiahao Chen', 'Ningxin Chen', 'Ruijue Chen', 'Yanru Chen', 'Yuankun Chen', 'Yutian Chen', 'Zhuofu Chen', 'Jialei Cui', 'Hao Ding', 'Mengnan Dong', 'Angang Du', 'Chenzhuang Du', 'Dikang Du', 'Yulun Du', 'Yu Fan', 'Yichen Feng', 'Kelin Fu', 'Bofei Gao', 'Chenxiao Gao', 'Hongcheng Gao', 'Peizhong Gao', 'Tong Gao', 'Yuyao Ge', 'Shangyi Geng', 'Qizheng Gu', 'Xinran Gu', 'Longyu Guan', 'Haiqing Guo', 'Jianhang Guo', 'Xiaoru Hao', 'Tianhong He', 'Weiran He', 'Wenyang He', 'Yunjia He', 'Chao Hong', 'Hao Hu', 'Yangyang Hu', 'Zhenxing Hu', 'Weixiao Huang', 'Zhiqi Huang', 'Zihao Huang', 'Tao Jiang', 'Zhejun Jiang', 'Xinyi Jin', 'Yongsheng Kang', 'Guokun Lai', 'Cheng Li', 'Fang Li', 'Haoyang Li', 'Ming Li', 'Wentao Li', 'Yang Li', 'Yanhao Li', 'Yiwei Li', 'Zhaowei Li', 'Zheming Li', 'Hongzhan Lin', 'Xiaohan Lin', 'Zongyu Lin', 'Chengyin Liu', 'Chenyu Liu', 'Hongzhang Liu', 'Jingyuan Liu', 'Junqi Liu', 'Liang Liu', 'Shaowei Liu', 'T. Y. Liu', 'Tianwei Liu', 'Weizhou Liu', 'Yangyang Liu', 'Yibo Liu', 'Yiping Liu', 'Yue Liu', 'Zhengying Liu', 'Enzhe Lu', 'Haoyu Lu', 'Lijun Lu', 'Yashuo Luo', 'Shengling Ma', 'Xinyu Ma', 'Yingwei Ma', 'Shaoguang Mao', 'Jie Mei', 'Xin Men', 'Yibo Miao', 'Siyuan Pan', 'Yebo Peng', 'Ruoyu Qin', 'Zeyu Qin', 'Bowen Qu', 'Zeyu Shang', 'Lidong Shi', 'Shengyuan Shi', 'Feifan Song', 'Jianlin Su', 'Zhengyuan Su', 'Lin Sui', 'Xinjie Sun', 'Flood Sung', 'Yunpeng Tai', 'Heyi Tang', 'Jiawen Tao', 'Qifeng Teng', 'Chaoran Tian', 'Chensi Wang', 'Dinglu Wang', 'Feng Wang', 'Hailong Wang', 'Haiming Wang', 'Jianzhou Wang', 'Jiaxing Wang', 'Jinhong Wang', 'Shengjie Wang', 'Shuyi Wang', 'Si Wang', 'Xinyuan Wang', 'Yao Wang', 'Yejie Wang', 'Yiqin Wang', 'Yuxin Wang', 'Yuzhi Wang', 'Zhaoji Wang', 'Zhengtao Wang', 'Zhengtao Wang', 'Zhexu Wang', 'Chu Wei', 'Qianqian Wei', 'Haoning Wu', 'Wenhao Wu', 'Xingzhe Wu', 'Yuxin Wu', 'Chenjun Xiao', 'Jin Xie', 'Xiaotong Xie', 'Weimin Xiong', 'Boyu Xu', 'Jinjing Xu', 'L. H. Xu', 'Lin Xu', 'Suting Xu', 'Weixin Xu', 'Xinran Xu', 'Yangchuan Xu', 'Ziyao Xu', 'Jing Xu', 'Jing Xu', 'Junjie Yan', 'Yuzi Yan', 'Hao Yang', 'Xiaofei Yang', 'Yi Yang', 'Ying Yang', 'Zhen Yang', 'Zhilin Yang', 'Zonghan Yang', 'Haotian Yao', 'Xingcheng Yao', 'Wenjie Ye', 'Zhuorui Ye', 'Bohong Yin', 'Longhui Yu', 'Enming Yuan', 'Hongbang Yuan', 'Mengjie Yuan', 'Siyu Yuan', 'Haobing Zhan', 'Dehao Zhang', 'Hao Zhang', 'Wanlu Zhang', 'Xiaobin Zhang', 'Yadong Zhang', 'Yangkun Zhang', 'Yichi Zhang', 'Yizhi Zhang', 'Yongting Zhang', 'Yu Zhang', 'Yutao Zhang', 'Yutong Zhang', 'Zheng Zhang', 'Haotian Zhao', 'Yikai Zhao', 'Zijia Zhao', 'Huabin Zheng', 'Shaojie Zheng', 'Longguang Zhong', 'Jianren Zhou', 'Xinyu Zhou', 'Zaida Zhou', 'Jinguo Zhu', 'Zhen Zhu', 'Weiyu Zhuang', 'Xinxing Zu') / 2025
2
85%
GLM-5: From Vibe Coding to Agentic Engineering
('Aohan Zeng', 'Xin Lv', 'Zhenyu Hou', 'Zhengxiao Du', 'Qinkai Zheng', 'Bin Chen', 'Da Yin', 'Chendi Ge', 'Chenghua Huang', 'Chengxing Xie', 'Chenzheng Zhu', 'Congfeng Yin', 'Cunxiang Wang', 'Gengzheng Pan', 'Hao Zeng', 'Haoke Zhang', 'Haoran Wang', 'Huilong Chen', 'Jiajie Zhang', 'Jian Jiao', 'Jiaqi Guo', 'Jingsen Wang', 'Jingzhao Du', 'Jinzhu Wu', 'Kedong Wang', 'Lei Li', 'Lin Fan', 'Lucen Zhong', 'Mingdao Liu', 'Mingming Zhao', 'Pengfan Du', 'Qian Dong', 'Rui Lu', 'Shuang Li', 'Shulin Cao', 'Song Liu', 'Ting Jiang', 'Xiaodong Chen', 'Xiaohan Zhang', 'Xuancheng Huang', 'Xuezhen Dong', 'Yabo Xu', 'Yao Wei', 'Yifan An', 'Yilin Niu', 'Yitong Zhu', 'Yuanhao Wen', 'Yukuo Cen', 'Yushi Bai', 'Zhongpei Qiao', 'Zihan Wang', 'Zikang Wang', 'Zilin Zhu', 'Ziqiang Liu', 'Zixuan Li', 'Bojie Wang', 'Bosi Wen', 'Can Huang', 'Changpeng Cai', 'Chao Yu', 'Chen Li', 'Chengwei Hu', 'Chenhui Zhang', 'Dan Zhang', 'Daoyan Lin', 'Dayong Yang', 'Di Wang', 'Ding Ai', 'Erle Zhu', 'Fangzhou Yi', 'Feiyu Chen', 'Guohong Wen', 'Hailong Sun', 'Haisha Zhao', 'Haiyi Hu', 'Hanchen Zhang', 'Hanrui Liu', 'Hanyu Zhang', 'Hao Peng', 'Hao Tai', 'Haobo Zhang', 'He Liu', 'Hongwei Wang', 'Hongxi Yan', 'Hongyu Ge', 'Huan Liu', 'Huanpeng Chu', "Jia'ni Zhao", 'Jiachen Wang', 'Jiajing Zhao', 'Jiamin Ren', 'Jiapeng Wang', 'Jiaxin Zhang', 'Jiayi Gui', 'Jiayue Zhao', 'Jijie Li', 'Jing An', 'Jing Li', 'Jingwei Yuan', 'Jinhua Du', 'Jinxin Liu', 'Junkai Zhi', 'Junwen Duan', 'Kaiyue Zhou', 'Kangjian Wei', 'Ke Wang', 'Keyun Luo', 'Laiqiang Zhang', 'Leigang Sha', 'Liang Xu', 'Lindong Wu', 'Lintao Ding', 'Lu Chen', 'Minghao Li', 'Nianyi Lin', 'Pan Ta', 'Qiang Zou', 'Rongjun Song', 'Ruiqi Yang', 'Shangqing Tu', 'Shangtong Yang', 'Shaoxiang Wu', 'Shengyan Zhang', 'Shijie Li', 'Shuang Li', 'Shuyi Fan', 'Wei Qin', 'Wei Tian', 'Weining Zhang', 'Wenbo Yu', 'Wenjie Liang', 'Xiang Kuang', 'Xiangmeng Cheng', 'Xiangyang Li', 'Xiaoquan Yan', 'Xiaowei Hu', 'Xiaoying Ling', 'Xing Fan', 'Xingye Xia', 'Xinyuan Zhang', 'Xinze Zhang', 'Xirui Pan', 'Xu Zou', 'Xunkai Zhang', 'Yadi Liu', 'Yandong Wu', 'Yanfu Li', 'Yidong Wang', 'Yifan Zhu', 'Yijun Tan', 'Yilin Zhou', 'Yiming Pan', 'Ying Zhang', 'Yinpei Su', 'Yipeng Geng', 'Yong Yan', 'Yonglin Tan', 'Yuean Bi', 'Yuhan Shen', 'Yuhao Yang', 'Yujiang Li', 'Yunan Liu', 'Yunqing Wang', 'Yuntao Li', 'Yurong Wu', 'Yutao Zhang', 'Yuxi Duan', 'Yuxuan Zhang', 'Zezhen Liu', 'Zhengtao Jiang', 'Zhenhe Yan', 'Zheyu Zhang', 'Zhixiang Wei', 'Zhuo Chen', 'Zhuoer Feng', 'Zijun Yao', 'Ziwei Chai', 'Ziyuan Wang', 'Zuzhou Zhang', 'Bin Xu', 'Minlie Huang', 'Hongning Wang', 'Juanzi Li', 'Yuxiao Dong', 'Jie Tang') / 2026
3
84%
DeepSeek-V3 Technical Report
('Aixin Liu', 'Bei Feng', 'Bing Xue', 'Bingxuan Wang', 'Bochao Wu', 'Chengda Lu', 'Chenggang Zhao', 'Chengqi Deng', 'Chenyu Zhang', 'Chong Ruan', 'Damai Dai', 'Daya Guo', 'Dejian Yang', 'Deli Chen', 'Dongjie Ji', 'Erhang Li', 'Fangyun Lin', 'Fucong Dai', 'Fuli Luo', 'Guangbo Hao', 'Guanting Chen', 'Guowei Li', 'H. Zhang', 'Han Bao', 'Hanwei Xu', 'Haocheng Wang', 'Haowei Zhang', 'Honghui Ding', 'Huajian Xin', 'Huazuo Gao', 'Hui Li', 'Hui Qu', 'J. L. Cai', 'Jian Liang', 'Jianzhong Guo', 'Jiaqi Ni', 'Jiashi Li', 'Jiawei Wang', 'Jin Chen', 'Jingchang Chen', 'Jingyang Yuan', 'Junjie Qiu', 'Junlong Li', 'Junxiao Song', 'Kai Dong', 'Kai Hu', 'Kaige Gao', 'Kang Guan', 'Kexin Huang', 'Kuai Yu', 'Lean Wang', 'Lecong Zhang', 'Lei Xu', 'Leyi Xia', 'Liang Zhao', 'Litong Wang', 'Liyue Zhang', 'Meng Li', 'Miaojun Wang', 'Mingchuan Zhang', 'Minghua Zhang', 'Minghui Tang', 'Mingming Li', 'Ning Tian', 'Panpan Huang', 'Peiyi Wang', 'Peng Zhang', 'Qiancheng Wang', 'Qihao Zhu', 'Qinyu Chen', 'Qiushi Du', 'R. J. Chen', 'R. L. Jin', 'Ruiqi Ge', 'Ruisong Zhang', 'Ruizhe Pan', 'Runji Wang', 'Runxin Xu', 'Ruoyu Zhang', 'Ruyi Chen', 'S. S. Li', 'Shanghao Lu', 'Shangyan Zhou', 'Shanhuang Chen', 'Shaoqing Wu', 'Shengfeng Ye', 'Shengfeng Ye', 'Shirong Ma', 'Shiyu Wang', 'Shuang Zhou', 'Shuiping Yu', 'Shunfeng Zhou', 'Shuting Pan', 'T. Wang', 'Tao Yun', 'Tian Pei', 'Tianyu Sun', 'W. L. Xiao', 'Wangding Zeng', 'Wanjia Zhao', 'Wei An', 'Wen Liu', 'Wenfeng Liang', 'Wenjun Gao', 'Wenqin Yu', 'Wentao Zhang', 'X. Q. Li', 'Xiangyue Jin', 'Xianzu Wang', 'Xiao Bi', 'Xiaodong Liu', 'Xiaohan Wang', 'Xiaojin Shen', 'Xiaokang Chen', 'Xiaokang Zhang', 'Xiaosha Chen', 'Xiaotao Nie', 'Xiaowen Sun', 'Xiaoxiang Wang', 'Xin Cheng', 'Xin Liu', 'Xin Xie', 'Xingchao Liu', 'Xingkai Yu', 'Xinnan Song', 'Xinxia Shan', 'Xinyi Zhou', 'Xinyu Yang', 'Xinyuan Li', 'Xuecheng Su', 'Xuheng Lin', 'Y. K. Li', 'Y. Q. Wang', 'Y. X. Wei', 'Y. X. Zhu', 'Yang Zhang', 'Yanhong Xu', 'Yanhong Xu', 'Yanping Huang', 'Yao Li', 'Yao Zhao', 'Yaofeng Sun', 'Yaohui Li', 'Yaohui Wang', 'Yi Yu', 'Yi Zheng', 'Yichao Zhang', 'Yifan Shi', 'Yiliang Xiong', 'Ying He', 'Ying Tang', 'Yishi Piao', 'Yisong Wang', 'Yixuan Tan', 'Yiyang Ma', 'Yiyuan Liu', 'Yongqiang Guo', 'Yu Wu', 'Yuan Ou', 'Yuchen Zhu', 'Yuduan Wang', 'Yue Gong', 'Yuheng Zou', 'Yujia He', 'Yukun Zha', 'Yunfan Xiong', 'Yunxian Ma', 'Yuting Yan', 'Yuxiang Luo', 'Yuxiang You', 'Yuxuan Liu', 'Yuyang Zhou', 'Z. F. Wu', 'Z. Z. Ren', 'Zehui Ren', 'Zhangli Sha', 'Zhe Fu', 'Zhean Xu', 'Zhen Huang', 'Zhen Zhang', 'Zhenda Xie', 'Zhengyan Zhang', 'Zhewen Hao', 'Zhibin Gou', 'Zhicheng Ma', 'Zhigang Yan', 'Zhihong Shao', 'Zhipeng Xu', 'Zhiyu Wu', 'Zhongyu Zhang', 'Zhuoshu Li', 'Zihui Gu', 'Zijia Zhu', 'Zijun Liu', 'Zilin Li', 'Ziwei Xie', 'Ziyang Song', 'Ziyi Gao', 'Zizheng Pan') / 2024
4
81%
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
DeepSeek-V2
('Aixin Liu', 'Bei Feng', 'Bin Wang', 'Bingxuan Wang', 'Bo Liu', 'Chenggang Zhao', 'Chengqi Dengr', 'Chong Ruan', 'Damai Dai', 'Daya Guo', 'Dejian Yang', 'Deli Chen', 'Dongjie Ji', 'Erhang Li', 'Fangyun Lin', 'Fuli Luo', 'Guangbo Hao', 'Guanting Chen', 'Guowei Li', 'H. Zhang', 'Hanwei Xu', 'Hao Yang', 'Haowei Zhang', 'Honghui Ding', 'Huajian Xin', 'Huazuo Gao', 'Hui Li', 'Hui Qu', 'J. L. Cai', 'Jian Liang', 'Jianzhong Guo', 'Jiaqi Ni', 'Jiashi Li', 'Jin Chen', 'Jingyang Yuan', 'Junjie Qiu', 'Junxiao Song', 'Kai Dong', 'Kaige Gao', 'Kang Guan', 'Lean Wang', 'Lecong Zhang', 'Lei Xu', 'Leyi Xia', 'Liang Zhao', 'Liyue Zhang', 'Meng Li', 'Miaojun Wang', 'Mingchuan Zhang', 'Minghua Zhang', 'Minghui Tang', 'Mingming Li', 'Ning Tian', 'Panpan Huang', 'Peiyi Wang', 'Peng Zhang', 'Qihao Zhu', 'Qinyu Chen', 'Qiushi Du', 'R. J. Chen', 'R. L. Jin', 'Ruiqi Ge', 'Ruizhe Pan', 'Runxin Xu', 'Ruyi Chen', 'S. S. Li', 'Shanghao Lu', 'Shangyan Zhou', 'Shanhuang Chen', 'Shaoqing Wu', 'Shengfeng Ye', 'Shirong Ma', 'Shiyu Wang', 'Shuang Zhou', 'Shuiping Yu', 'Shunfeng Zhou', 'Size Zheng', 'T. Wang', 'Tian Pei', 'Tian Yuan', 'Tianyu Sun', 'W. L. Xiao', 'Wangding Zeng', 'Wei An', 'Wen Liu', 'Wenfeng Liang', 'Wenjun Gao', 'Wentao Zhang', 'X. Q. Li', 'Xiangyue Jin', 'Xianzu Wang', 'Xiao Bi', 'Xiaodong Liu', 'Xiaohan Wang', 'Xiaojin Shen', 'Xiaokang Chen', 'Xiaosha Chen', 'Xiaotao Nie', 'Xiaowen Sun', 'Xiaoxiang Wang', 'Xin Liu', 'Xin Xie', 'Xingkai Yu', 'Xinnan Song', 'Xinyi Zhou', 'Xinyu Yang', 'Xuan Lu', 'Xuecheng Su', 'Y. Wu', 'Y. K. Li', 'Y. X. Wei', 'Y. X. Zhu', 'Yanhong Xu', 'Yanping Huang', 'Yao Li', 'Yao Zhao', 'Yaofeng Sun', 'Yaohui Li', 'Yaohui Wang', 'Yi Zheng', 'Yichao Zhang', 'Yiliang Xiong', 'Yilong Zhao', 'Ying He', 'Ying Tang', 'Yishi Piao', 'Yixin Dong', 'Yixuan Tan', 'Yiyuan Liu', 'Yongji Wang', 'Yongqiang Guo', 'Yuchen Zhu', 'Yuduan Wang', 'Yuheng Zou', 'Yukun Zha', 'Yunxian Ma', 'Yuting Yan', 'Yuxiang You', 'Yuxuan Liu', 'Z. Z. Ren', 'Zehui Ren', 'Zhangli Sha', 'Zhe Fu', 'Zhen Huang', 'Zhen Zhang', 'Zhenda Xie', 'Zhewen Hao', 'Zhihong Shao', 'Zhiniu Wen', 'Zhipeng Xu', 'Zhongyu Zhang', 'Zhuoshu Li', 'Zihan Wang', 'Zihui Gu', 'Zilin Li', 'Ziwei Xie') / 2024
5
80%
DeepSeek LLM: Scaling Open-Source Language Models with Longtermism
DeepSeek LLM
('Xiao Bi', 'Deli Chen', 'Guanting Chen', 'Shanhuang Chen', 'Damai Dai', 'Chengqi Deng', 'Honghui Ding', 'Kai Dong', 'Qiushi Du', 'Zhe Fu', 'Huazuo Gao', 'Kaige Gao', 'Wenjun Gao', 'Ruiqi Ge', 'Kang Guan', 'Daya Guo', 'Jianzhong Guo', 'Guangbo Hao', 'Zhewen Hao', 'Ying He', 'Wenjie Hu', 'Panpan Huang', 'Erhang Li', 'Guowei Li', 'Jiashi Li', 'Yao Li', 'Y. K. Li', 'Wenfeng Liang', 'Fangyun Lin', 'A. X. Liu', 'Bo Liu', 'Wen Liu', 'Xiaodong Liu', 'Xin Liu', 'Yiyuan Liu', 'Haoyu Lu', 'Shanghao Lu', 'Fuli Luo', 'Shirong Ma', 'Xiaotao Nie', 'Tian Pei', 'Yishi Piao', 'Junjie Qiu', 'Hui Qu', 'Tongzheng Ren', 'Zehui Ren', 'Chong Ruan', 'Zhangli Sha', 'Zhihong Shao', 'Junxiao Song', 'Xuecheng Su', 'Jingxiang Sun', 'Yaofeng Sun', 'Minghui Tang', 'Bingxuan Wang', 'Peiyi Wang', 'Shiyu Wang', 'Yaohui Wang', 'Yongji Wang', 'Tong Wu', 'Y. Wu', 'Xin Xie', 'Zhenda Xie', 'Ziwei Xie', 'Yiliang Xiong', 'Hanwei Xu', 'R. X. Xu', 'Yanhong Xu', 'Dejian Yang', 'Yuxiang You', 'Shuiping Yu', 'Xingkai Yu', 'B. Zhang', 'Haowei Zhang', 'Lecong Zhang', 'Liyue Zhang', 'Mingchuan Zhang', 'Minghua Zhang', 'Wentao Zhang', 'Yichao Zhang', 'Chenggang Zhao', 'Yao Zhao', 'Shangyan Zhou', 'Shunfeng Zhou', 'Qihao Zhu', 'Yuheng Zou') / 2024