Skip to content

Theano: A Python Framework for Fast Computation of Mathematical Expressions

Authors
Rami Al-Rfou, Guillaume Alain, Amjad Almahairi, Christof Angermueller, Dzmitry Bahdanau, Nicolas Ballas, Frederic Bastien, Justin Bayer, Anatoly Belikov, Alexander Belopolsky, Yoshua Bengio, Arnaud Bergeron, James Bergstra, Valentin Bisson, Josh Bleecher Snyder, Nicolas Bouchard, Nicolas Boulanger-Lewandowski, Xavier Bouthillier, Alexandre de Brebisson, Olivier Breuleux, Pierre-Luc Carrier, Kyunghyun Cho, Jan Chorowski, Paul Christiano, Tim Cooijmans, Marc-Alexandre Cote, Myriam Cote, Aaron Courville, Yann N. Dauphin, Olivier Delalleau, Julien Demouth, Guillaume Desjardins, Sander Dieleman, Laurent Dinh, Melanie Ducoffe, Vincent Dumoulin, Samira Ebrahimi Kahou, Dumitru Erhan, Ziye Fan, Orhan Firat, Mathieu Germain, Xavier Glorot, Ian Goodfellow, Matt Graham, Caglar Gulcehre, Philippe Hamel, Iban Harlouchet, Jean-Philippe Heng, Balazs Hidasi, Sina Honari, Arjun Jain, Sebastien Jean, Kai Jia, Mikhail Korobov, Vivek Kulkarni, Alex Lamb, Pascal Lamblin, Eric Larsen, Cesar Laurent, Sean Lee, Simon Lefrancois, Simon Lemieux, Nicholas Leonard, Zhouhan Lin, Jesse A. Livezey, Cory Lorenz, Jeremiah Lowin, Qianli Ma, Pierre-Antoine Manzagol, Olivier Mastropietro, Robert T. McGibbon, Roland Memisevic, Bart van Merrienboer, Vincent Michalski, Mehdi Mirza, Alberto Orlandi, Christopher Pal, Razvan Pascanu, Mohammad Pezeshki, Colin Raffel, Daniel Renshaw, Matthew Rocklin, Adriana Romero, Markus Roth, Peter Sadowski, John Salvatier, Francois Savard, Jan Schluter, John Schulman, Gabriel Schwartz, Iulian Vlad Serban, Dmitriy Serdyuk, Samira Shabanian, Etienne Simon, Sigurd Spieckermann, S. Ramana Subramanyam, Jakub Sygnowski, Jeremie Tanguay, Gijs van Tulder, Joseph Turian, Sebastian Urban, Pascal Vincent, Francesco Visin, Harm de Vries, David Warde-Farley, Dustin J. Webb, Matthew Willson, Kelvin Xu, Lijun Xue, Li Yao, Saizheng Zhang, Ying Zhang
Year
Algorithm
Theano
Identifiers

Abstract

Theano is a Python library that allows to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently. Since its introduction, it has been one of the most used CPU and GPU mathematical compilers - especially in the machine learning community - and has shown steady performance improvements. Theano is being actively and continuously developed since 2008, multiple frameworks have been built on top of it and it has been used to produce many state-of-the-art machine learning models. The present article is structured as follows. Section I provides an overview of the Theano software and its community. Section II presents the principal features of Theano and how to use them, and compares them with other similar projects. Section III focuses on recently-introduced functionalities and improvements. Section IV compares the performance of Theano against Torch7 and TensorFlow on several machine learning models. Section V discusses current limitations of Theano and potential ways of improving it.

Similar Papers

3
67%

DeepSeek-V3 Technical Report

('Aixin Liu', 'Bei Feng', 'Bing Xue', 'Bingxuan Wang', 'Bochao Wu', 'Chengda Lu', 'Chenggang Zhao', 'Chengqi Deng', 'Chenyu Zhang', 'Chong Ruan', 'Damai Dai', 'Daya Guo', 'Dejian Yang', 'Deli Chen', 'Dongjie Ji', 'Erhang Li', 'Fangyun Lin', 'Fucong Dai', 'Fuli Luo', 'Guangbo Hao', 'Guanting Chen', 'Guowei Li', 'H. Zhang', 'Han Bao', 'Hanwei Xu', 'Haocheng Wang', 'Haowei Zhang', 'Honghui Ding', 'Huajian Xin', 'Huazuo Gao', 'Hui Li', 'Hui Qu', 'J. L. Cai', 'Jian Liang', 'Jianzhong Guo', 'Jiaqi Ni', 'Jiashi Li', 'Jiawei Wang', 'Jin Chen', 'Jingchang Chen', 'Jingyang Yuan', 'Junjie Qiu', 'Junlong Li', 'Junxiao Song', 'Kai Dong', 'Kai Hu', 'Kaige Gao', 'Kang Guan', 'Kexin Huang', 'Kuai Yu', 'Lean Wang', 'Lecong Zhang', 'Lei Xu', 'Leyi Xia', 'Liang Zhao', 'Litong Wang', 'Liyue Zhang', 'Meng Li', 'Miaojun Wang', 'Mingchuan Zhang', 'Minghua Zhang', 'Minghui Tang', 'Mingming Li', 'Ning Tian', 'Panpan Huang', 'Peiyi Wang', 'Peng Zhang', 'Qiancheng Wang', 'Qihao Zhu', 'Qinyu Chen', 'Qiushi Du', 'R. J. Chen', 'R. L. Jin', 'Ruiqi Ge', 'Ruisong Zhang', 'Ruizhe Pan', 'Runji Wang', 'Runxin Xu', 'Ruoyu Zhang', 'Ruyi Chen', 'S. S. Li', 'Shanghao Lu', 'Shangyan Zhou', 'Shanhuang Chen', 'Shaoqing Wu', 'Shengfeng Ye', 'Shengfeng Ye', 'Shirong Ma', 'Shiyu Wang', 'Shuang Zhou', 'Shuiping Yu', 'Shunfeng Zhou', 'Shuting Pan', 'T. Wang', 'Tao Yun', 'Tian Pei', 'Tianyu Sun', 'W. L. Xiao', 'Wangding Zeng', 'Wanjia Zhao', 'Wei An', 'Wen Liu', 'Wenfeng Liang', 'Wenjun Gao', 'Wenqin Yu', 'Wentao Zhang', 'X. Q. Li', 'Xiangyue Jin', 'Xianzu Wang', 'Xiao Bi', 'Xiaodong Liu', 'Xiaohan Wang', 'Xiaojin Shen', 'Xiaokang Chen', 'Xiaokang Zhang', 'Xiaosha Chen', 'Xiaotao Nie', 'Xiaowen Sun', 'Xiaoxiang Wang', 'Xin Cheng', 'Xin Liu', 'Xin Xie', 'Xingchao Liu', 'Xingkai Yu', 'Xinnan Song', 'Xinxia Shan', 'Xinyi Zhou', 'Xinyu Yang', 'Xinyuan Li', 'Xuecheng Su', 'Xuheng Lin', 'Y. K. Li', 'Y. Q. Wang', 'Y. X. Wei', 'Y. X. Zhu', 'Yang Zhang', 'Yanhong Xu', 'Yanhong Xu', 'Yanping Huang', 'Yao Li', 'Yao Zhao', 'Yaofeng Sun', 'Yaohui Li', 'Yaohui Wang', 'Yi Yu', 'Yi Zheng', 'Yichao Zhang', 'Yifan Shi', 'Yiliang Xiong', 'Ying He', 'Ying Tang', 'Yishi Piao', 'Yisong Wang', 'Yixuan Tan', 'Yiyang Ma', 'Yiyuan Liu', 'Yongqiang Guo', 'Yu Wu', 'Yuan Ou', 'Yuchen Zhu', 'Yuduan Wang', 'Yue Gong', 'Yuheng Zou', 'Yujia He', 'Yukun Zha', 'Yunfan Xiong', 'Yunxian Ma', 'Yuting Yan', 'Yuxiang Luo', 'Yuxiang You', 'Yuxuan Liu', 'Yuyang Zhou', 'Z. F. Wu', 'Z. Z. Ren', 'Zehui Ren', 'Zhangli Sha', 'Zhe Fu', 'Zhean Xu', 'Zhen Huang', 'Zhen Zhang', 'Zhenda Xie', 'Zhengyan Zhang', 'Zhewen Hao', 'Zhibin Gou', 'Zhicheng Ma', 'Zhigang Yan', 'Zhihong Shao', 'Zhipeng Xu', 'Zhiyu Wu', 'Zhongyu Zhang', 'Zhuoshu Li', 'Zihui Gu', 'Zijia Zhu', 'Zijun Liu', 'Zilin Li', 'Ziwei Xie', 'Ziyang Song', 'Ziyi Gao', 'Zizheng Pan') / 2024