Skip to content

MolmoAct2: Action Reasoning Models for Real-world Deployment

Year
Algorithm
MolmoAct2
Source
Identifiers

Abstract

Vision-Language-Action (VLA) models aim to provide a single generalist controller for robots, but today's systems fall short on the criteria that matter for real-world deployment. Frontier models are closed, open-weight alternatives are tied to expensive hardware, reasoning-augmented policies pay prohibitive latency for their grounding, and fine-tuned success rates remain below the threshold for dependable use. We present MolmoAct2, a fully open action reasoning model built for practical deployment, advancing its predecessor along five axes. We introduce MolmoER, a VLM backbone specialized for spatial and embodied reasoning, trained on a 3.3M-sample corpus with a specialize-then-rehearse recipe. We release three new datasets spanning low-to-medium cost platforms, including MolmoAct2-BimanualYAM, 720 hours of teleoperated bimanual trajectories that constitute the largest open bimanual dataset to date, together with quality-filtered Franka (DROID) and SO100/101 subsets. We provide OpenFAST, an open-weight, open-data action tokenizer trained on millions of trajectories across five embodiments. We redesign the architecture to graft a flow-matching continuous-action expert onto a discrete-token VLM via per-layer KV-cache conditioning. Finally, we propose MolmoThink, an adaptive-depth reasoning variant that re-predicts depth tokens only for scene regions that change between timesteps, retaining geometric grounding at a fraction of prior latency. In the most extensive empirical study of any open VLA to date, spanning 7 simulation and real-world benchmarks, MolmoAct2 outperforms strong baselines including Pi-05, while MolmoER surpasses GPT-5 and Gemini Robotics ER-1.5 across 13 embodied-reasoning benchmarks. We release model weights, training code, and complete training data. Project page: https://allenai.org/blog/molmoact2

Tags

Similar Papers

1
88%

MolmoB0T: Large-Scale Simulation Enables Zero-Shot Manipulation

MolmoB0T

('Abhay Deshpande', 'Maya Guru', 'Rose Hendrix', 'Snehal Jauhri', 'Ainaz Eftekhar', 'Rohun Tripathi', 'Max Argus', 'Jordi Salvador', 'Haoquan Fang', 'Matthew Wallingford', 'Wilbert Pumacay', 'Yejin Kim', 'Quinn Pfeifer', 'Ying-Chun Lee', 'Piper Wolters', 'Omar Rayyan', 'Mingtong Zhang', 'Jiafei Duan', 'Karen Farley', 'Winson Han', 'Eli Vanderbilt', 'Dieter Fox', 'Ali Farhadi', 'Georgia Chalvatzaki', 'Dhruv Shah', 'Ranjay Krishna') / 2026
2
84%

Qwen-RobotWorld Technical Report: Unifying Embodied World Modeling through Language-Conditioned Video Generation

('Jie Zhang', 'Xiaoyue Chen', 'Anzhe Chen', 'Dayiheng Liu', 'Deqing Li', 'Gengze Zhou', 'Hale Yin', 'Haoqi Yuan', 'Haoyang Li', 'Jiahao Li', 'Jiazhao Zhang', 'Jingren Zhou', 'Kaiyuan Gao', 'Kun Yan', 'Lihan Jiang', 'Ningyuan Tang', 'Pei Lin', 'Qihang Peng', 'Shengming Yin', 'Tianhe Wu', 'Tianyi Yan', 'Xiao Xu', 'Yan Shu', 'Yanran Zhang', 'Ye Wang', 'Yi Wang', 'Yilei Chen', 'Yixian Xu', 'Yiyang Huang', 'Yuxiang Chen', 'Zekai Zhang', 'Zhendong Wang', 'Zixing Lei', 'Zhixuan Liang', 'Zihao Liu', 'Zikai Zhou', 'Chenxu Lv', 'Xiong-Hui Chen', 'Chenfei Wu') / 2026
3
83%

World Action Models Are Zero-shot Policies

DreamZero

('Seonghyeon Ye', 'Yunhao Ge', 'Kaiyuan Zheng', 'Shenyuan Gao', 'Sihyun Yu', 'George Kurian', 'Suneel Indupuru', 'You Liang Tan', 'Chuning Zhu', 'Jiannan Xiang', 'Ayaan Malik', 'Kyungmin Lee', 'William Liang', 'Nadun Ranawaka', 'Jiasheng Gu', 'Yinzhen Xu', 'Guanzhi Wang', 'Fengyuan Hu', 'Avnish Narayan', 'Johan Bjorck', 'Jing Wang', 'Gwanghyun Kim', 'Dantong Niu', 'Ruijie Zheng', 'Yuqi Xie', 'Jimmy Wu', 'Qi Wang', 'Ryan Julian', 'Danfei Xu', 'Yilun Du', 'Yevgen Chebotar', 'Scott Reed', 'Jan Kautz', 'Yuke Zhu', 'Linxi "Jim" Fan', 'Joel Jang') / 2026
4
83%

OpenVLA: An Open-Source Vision-Language-Action Model

OpenVLA

('Moo Jin Kim', 'Karl Pertsch', 'Siddharth Karamcheti', 'Ted Xiao', 'Ashwin Balakrishna', 'Suraj Nair', 'Rafael Rafailov', 'Ethan Foster', 'Grace Lam', 'Pannag Sanketi', 'Quan Vuong', 'Thomas Kollar', 'Benjamin Burchfiel', 'Russ Tedrake', 'Dorsa Sadigh', 'Sergey Levine', 'Percy Liang', 'Chelsea Finn') / 2024
5
82%

RLDX-1 Technical Report

RLDX-1

('Dongyoung Kim', 'Huiwon Jang', 'Myungkyu Koo', 'Suhyeok Jang', 'Taeyoung Kim', 'Beomjun Kim', 'Byungjun Yoon', 'Changsung Jang', 'Daewon Choi', 'Dongsu Han', 'Donguk Lee', 'Heeseung Kwon', 'Hojin Jeon', 'Jaehyun Kang', 'Jaekyoung Bae', 'Jihyuk Lee', 'Jimin Lee', 'John Won', 'Joonwoo Ahn', 'Junhyeong Park', 'Junyoung Sung', 'Kyungmin Lee', 'Minseong Han', 'Minsung Yoon', 'Sejune Joo', 'Seonil Son', 'Seungcheol Park', 'Seunggeun Cho', 'Seungjun Moon', 'Seungku Kim', 'Yonghoon Dong', 'Yongjin Cho', 'Youngchan Kim', 'Chang Hwan Kim', 'Dohyeon Kim', 'Heecheol Kim', 'Heewon Lee', 'Hensen Ahn', 'Hyungkyu Ryu', 'Hyunsoo Choi', 'Hyunsoo Shin', 'Jaeheon Jung', 'Jaewoo Kim', 'Jinwook Kim', 'Joochul Chang', 'Joonsoo Kim', 'Junghun Park', 'Jungwoo Park', 'Junho Cho', 'Junhyeok Park', 'Junwon Lee', 'Kangwook Lee', 'Kwanghoon Kim', 'Kyoungwhan Choe', 'Manoj Bhadu', 'Nayoung Oh', 'Sangjun Kim', 'Sangwoo Kim', 'Seunghoon Shim', 'Seunghyun Kim', 'Seungjun Lee', 'Seungyup Ka', 'Sungryol Yang', 'Wook Jung', 'Yashu Shukla', 'Yeonjae Lee', 'Yeonwoo Bae', 'Jinwoo Shin') / 2026