Skip to content

Cosmos World Foundation Model Platform for Physical AI

Authors
Niket Agarwal, Arslan Ali, Maciej Bala, Yogesh Balaji, Erik Barker, Tiffany Cai, Prithvijit Chattopadhyay, Yongxin Chen, Yin Cui, Yifan Ding, Daniel Dworakowski, Jiaojiao Fan, Michele Fenzi, Francesco Ferroni, Sanja Fidler, Dieter Fox, Songwei Ge, Yunhao Ge, Jinwei Gu, Siddharth Gururani, Ethan He, Jiahui Huang, Jacob Huffman, Pooya Jannaty, Jingyi Jin, Seung Wook Kim, Gergely Klar, Grace Lam, Shiyi Lan, Laura Leal-Taixe, Anqi Li, Zhaoshuo Li, Chen-Hsuan Lin, Tsung-Yi Lin, Huan Ling, Ming-Yu Liu, Xian Liu, Alice Luo, Qianli Ma, Hanzi Mao, Kaichun Mo, Arsalan Mousavian, Seungjun Nah, Sriharsha Niverty, David Page, Despoina Paschalidou, Zeeshan Patel, Lindsey Pavao, Morteza Ramezanali, Fitsum Reda, Xiaowei Ren, Vasanth Rao Naik Sabavat, Ed Schmerling, Stella Shi, Bartosz Stefaniak, Shitao Tang, Lyne Tchapmi, Przemek Tredak, Wei-Cheng Tseng, Jibin Varghese, Hao Wang, Haoxiang Wang, Heng Wang, Ting-Chun Wang, Fangyin Wei, Xinyue Wei, Jay Zhangjie Wu, Jiashu Xu, Wei Yang, Lin Yen-Chen, Xiaohui Zeng, Yu Zeng, Jing Zhang, Qinsheng Zhang, Yuxuan Zhang, Qingqing Zhao, Artur Zolkowski
Year
2025
Preprint
Identifiers
arXiv 2501.03575

Abstract

Physical AI needs to be trained digitally first. It needs a digital twin of itself, the policy model, and a digital twin of the world, the world model. In this paper, we present the Cosmos World Foundation Model Platform to help developers build customized world models for their Physical AI setups. We position a world foundation model as a general-purpose world model that can be fine-tuned into customized world models for downstream applications. Our platform covers a video curation pipeline, pre-trained world foundation models, examples of post-training of pre-trained world foundation models, and video tokenizers. To help Physical AI builders solve the most critical problems of our society, we make Cosmos open-source and our models open-weight with permissive licenses available via https://github.com/nvidia-cosmos/cosmos-predict1.

Knowledge Base

Map Tree Search

External

Document arXiv Abstract arXiv PDF arXiv HTML Google Scholar OpenAlex

Similar Papers

1
92%

World Simulation with Video Foundation Models for Physical AI

('Arslan Ali', 'Junjie Bai', 'Maciej Bala', 'Yogesh Balaji', 'Aaron Blakeman', 'Tiffany Cai', 'Jiaxin Cao', 'Tianshi Cao', 'Elizabeth Cha', 'Yu-Wei Chao', 'Prithvijit Chattopadhyay', 'Mike Chen', 'Yongxin Chen', 'Yu Chen', 'Shuai Cheng', 'Yin Cui', 'Jenna Diamond', 'Yifan Ding', 'Jiaojiao Fan', 'Linxi Fan', 'Liang Feng', 'Francesco Ferroni', 'Sanja Fidler', 'Xiao Fu', 'Ruiyuan Gao', 'Yunhao Ge', 'Jinwei Gu', 'Aryaman Gupta', 'Siddharth Gururani', 'Imad El Hanafi', 'Ali Hassani', 'Zekun Hao', 'Jacob Huffman', 'Joel Jang', 'Pooya Jannaty', 'Jan Kautz', 'Grace Lam', 'Xuan Li', 'Zhaoshuo Li', 'Maosheng Liao', 'Chen-Hsuan Lin', 'Tsung-Yi Lin', 'Yen-Chen Lin', 'Huan Ling', 'Ming-Yu Liu', 'Xian Liu', 'Yifan Lu', 'Alice Luo', 'Qianli Ma', 'Hanzi Mao', 'Kaichun Mo', 'Seungjun Nah', 'Yashraj Narang', 'Abhijeet Panaskar', 'Lindsey Pavao', 'Trung Pham', 'Morteza Ramezanali', 'Fitsum Reda', 'Scott Reed', 'Xuanchi Ren', 'Haonan Shao', 'Yue Shen', 'Stella Shi', 'Shuran Song', 'Bartosz Stefaniak', 'Shangkun Sun', 'Shitao Tang', 'Sameena Tasmeen', 'Lyne Tchapmi', 'Wei-Cheng Tseng', 'Jibin Varghese', 'Andrew Z. Wang', 'Hao Wang', 'Haoxiang Wang', 'Heng Wang', 'Ting-Chun Wang', 'Fangyin Wei', 'Jiashu Xu', 'Dinghao Yang', 'Xiaodong Yang', 'Haotian Ye', 'Seonghyeon Ye', 'Xiaohui Zeng', 'Jing Zhang', 'Qinsheng Zhang', 'Kaiwen Zheng', 'Andrew Zhu', 'Yuke Zhu') / 2025
Detail Map Tree Search
3
83%

Genie: Generative Interactive Environments

Genie

('Jake Bruce', 'Michael Dennis', 'Ashley Edwards', 'Jack Parker-Holder', 'Yuge Shi', 'Edward Hughes', 'Matthew Lai', 'Aditi Mavalankar', 'Richie Steigerwald', 'Chris Apps', 'Yusuf Aytar', 'Sarah Bechtle', 'Feryal Behbahani', 'Stephanie Chan', 'Nicolas Heess', 'Lucy Gonzalez', 'Simon Osindero', 'Sherjil Ozair', 'Scott Reed', 'Jingwei Zhang', 'Konrad Zolna', 'Jeff Clune', 'Nando de Freitas', 'Satinder Singh', 'Tim Rocktaschel') / 2024
Detail Map Tree Search