The Llama 3 Herd of Models
Authors
Aaron Grattafiori,
Abhimanyu Dubey,
Abhinav Jauhri,
Abhinav Pandey,
Abhishek Kadian,
Ahmad Al-Dahle,
Aiesha Letman,
Akhil Mathur,
Alan Schelten,
Alex Vaughan,
Amy Yang,
Angela Fan,
Anirudh Goyal,
Anthony Hartshorn,
Aobo Yang,
Archi Mitra,
Archie Sravankumar,
Artem Korenev,
Arthur Hinsvark,
Arun Rao,
Aston Zhang,
Aurelien Rodriguez,
Austen Gregerson,
Ava Spataru,
Baptiste Roziere,
Bethany Biron,
Binh Tang,
Bobbie Chern,
Charlotte Caucheteux,
Chaya Nayak,
Chloe Bi,
Chris Marra,
Chris McConnell,
Christian Keller,
Christophe Touret,
Chunyang Wu,
Corinne Wong,
Cristian Canton Ferrer,
Cyrus Nikolaidis,
Damien Allonsius,
Daniel Song,
Danielle Pintz,
Danny Livshits,
Danny Wyatt,
David Esiobu,
Dhruv Choudhary,
Dhruv Mahajan,
Diego Garcia-Olano,
Diego Perino,
Dieuwke Hupkes,
Egor Lakomkin,
Ehab AlBadawy,
Elina Lobanova,
Emily Dinan,
Eric Michael Smith,
Filip Radenovic,
Francisco Guzman,
Frank Zhang,
Gabriel Synnaeve,
Gabrielle Lee,
Georgia Lewis Anderson,
Govind Thattai,
Graeme Nail,
Gregoire Mialon,
Guan Pang,
Guillem Cucurell,
Hailey Nguyen,
Hannah Korevaar,
Hu Xu,
Hugo Touvron,
Iliyan Zarov,
Imanol Arrieta Ibarra,
Isabel Kloumann,
Ishan Misra,
Ivan Evtimov,
Jack Zhang,
Jade Copet,
Jaewon Lee,
Jan Geffert,
Jana Vranes,
Jason Park,
Jay Mahadeokar,
Jeet Shah,
Jelmer van der Linde,
Jennifer Billock,
Jenny Hong,
Jenya Lee,
Jeremy Fu,
Jianfeng Chi,
Jianyu Huang,
Jiawen Liu,
Jie Wang,
Jiecao Yu,
Joanna Bitton,
Joe Spisak,
Jongsoo Park,
Joseph Rocca,
Joshua Johnstun,
Joshua Saxe,
Junteng Jia,
Kalyan Vasuden Alwala,
Karthik Prasad,
Kartikeya Upasani,
Kate Plawiak,
Ke Li,
Kenneth Heafield,
Kevin Stone,
Khalid El-Arini,
Krithika Iyer,
Kshitiz Malik,
Kuenley Chiu,
Kunal Bhalla,
Kushal Lakhotia,
Lauren Rantala-Yeary,
Laurens van der Maaten,
Lawrence Chen,
Liang Tan,
Liz Jenkins,
Louis Martin,
Lovish Madaan,
Lubo Malo,
Lukas Blecher,
Lukas Landzaat,
Luke de Oliveira,
Madeline Muzzi,
Mahesh Pasupuleti,
Mannat Singh,
Manohar Paluri,
Marcin Kardas,
Maria Tsimpoukelli,
Mathew Oldham,
Mathieu Rita,
Maya Pavlova,
Melanie Kambadur,
Mike Lewis,
Min Si,
Mitesh Kumar Singh,
Mona Hassan,
Naman Goyal,
Narjes Torabi,
Nikolay Bashlykov,
Nikolay Bogoychev,
Niladri Chatterji,
Ning Zhang,
Olivier Duchenne,
Onur Celebi,
Patrick Alrassy,
Pengchuan Zhang,
Pengwei Li,
Petar Vasic,
Peter Weng,
Prajjwal Bhargava,
Pratik Dubal,
Praveen Krishnan,
Punit Singh Koura,
Puxin Xu,
Qing He,
Qingxiao Dong,
Ragavan Srinivasan,
Raj Ganapathy,
Ramon Calderer,
Ricardo Silveira Cabral,
Robert Stojnic,
Roberta Raileanu,
Rohan Maheswari,
Rohit Girdhar,
Rohit Patel,
Romain Sauvestre,
Ronnie Polidoro,
Roshan Sumbaly,
Ross Taylor,
Ruan Silva,
Rui Hou,
Rui Wang,
Saghar Hosseini,
Sahana Chennabasappa,
Sanjay Singh,
Sean Bell,
Seohyun Sonia Kim,
Sergey Edunov,
Shaoliang Nie,
Sharan Narang,
Sharath Raparthy,
Sheng Shen,
Shengye Wan,
Shruti Bhosale,
Shun Zhang,
Simon Vandenhende,
Soumya Batra,
Spencer Whitman,
Sten Sootla,
Stephane Collot,
Suchin Gururangan,
Sydney Borodinsky,
Tamar Herman,
Tara Fowler,
Tarek Sheasha,
Thomas Georgiou,
Thomas Scialom,
Tobias Speckbacher,
Todor Mihaylov,
Tong Xiao,
Ujjwal Karn,
Vedanuj Goswami,
Vibhor Gupta,
Vignesh Ramanathan,
Viktor Kerkez,
Vincent Gonguet,
Virginie Do,
Vish Vogeti,
Vitor Albiero,
Vladan Petrovic,
Weiwei Chu,
Wenhan Xiong,
Wenyin Fu,
Whitney Meers,
Xavier Martinet,
Xiaodong Wang,
Xiaofang Wang,
Xiaoqing Ellen Tan,
Xide Xia,
Xinfeng Xie,
Xuchao Jia,
Xuewei Wang,
Yaelle Goldschlag,
Yashesh Gaur,
Yasmine Babaei,
Yi Wen,
Yiwen Song,
Yuchen Zhang,
Yue Li,
Yuning Mao,
Zacharie Delpierre Coudert,
Zheng Yan,
Zhengxing Chen,
Zoe Papakipos,
Aaditya Singh,
Aayushi Srivastava,
Abha Jain,
Adam Kelsey,
Adam Shajnfeld,
Adithya Gangidi,
Adolfo Victoria,
Ahuva Goldstand,
Ajay Menon,
Ajay Sharma,
Alex Boesenberg,
Alexei Baevski,
Allie Feinstein,
Amanda Kallet,
Amit Sangani,
Amos Teo,
Anam Yunus,
Andrei Lupu,
Andres Alvarado,
Andrew Caples,
Andrew Gu,
Andrew Ho,
Andrew Poulton,
Andrew Ryan,
Ankit Ramchandani,
Annie Dong,
Annie Franco,
Anuj Goyal,
Aparajita Saraf,
Arkabandhu Chowdhury,
Ashley Gabriel,
Ashwin Bharambe,
Assaf Eisenman,
Azadeh Yazdan,
Beau James,
Ben Maurer,
Benjamin Leonhardi,
Bernie Huang,
Beth Loyd,
Beto De Paola,
Bhargavi Paranjape,
Bing Liu,
Bo Wu,
Boyu Ni,
Braden Hancock,
Bram Wasti,
Brandon Spence,
Brani Stojkovic,
Brian Gamido,
Britt Montalvo,
Carl Parker,
Carly Burton,
Catalina Mejia,
Ce Liu,
Changhan Wang,
Changkyu Kim,
Chao Zhou,
Chester Hu,
Ching-Hsiang Chu,
Chris Cai,
Chris Tindal,
Christoph Feichtenhofer,
Cynthia Gao,
Damon Civin,
Dana Beaty,
Daniel Kreymer,
Daniel Li,
David Adkins,
David Xu,
Davide Testuggine,
Delia David,
Devi Parikh,
Diana Liskovich,
Didem Foss,
Dingkang Wang,
Duc Le,
Dustin Holland,
Edward Dowling,
Eissa Jamil,
Elaine Montgomery,
Eleonora Presani,
Emily Hahn,
Emily Wood,
Eric-Tuan Le,
Erik Brinkman,
Esteban Arcaute,
Evan Dunbar,
Evan Smothers,
Fei Sun,
Felix Kreuk,
Feng Tian,
Filippos Kokkinos,
Firat Ozgenel,
Francesco Caggioni,
Frank Kanayet,
Frank Seide,
Gabriela Medina Florez,
Gabriella Schwarz,
Gada Badeer,
Georgia Swee,
Gil Halpern,
Grant Herman,
Grigory Sizov,
Guangyi Zhang,
Guna Lakshminarayanan,
Hakan Inan,
Hamid Shojanazeri,
Han Zou,
Hannah Wang,
Hanwen Zha,
Haroun Habeeb,
Harrison Rudolph,
Helen Suk,
Henry Aspegren,
Hunter Goldman,
Hongyuan Zhan,
Ibrahim Damlaj,
Igor Molybog,
Igor Tufanov,
Ilias Leontiadis,
Irina-Elena Veliche,
Itai Gat,
Jake Weissman,
James Geboski,
James Kohli,
Janice Lam,
Japhet Asher,
Jean-Baptiste Gaya,
Jeff Marcus,
Jeff Tang,
Jennifer Chan,
Jenny Zhen,
Jeremy Reizenstein,
Jeremy Teboul,
Jessica Zhong,
Jian Jin,
Jingyi Yang,
Joe Cummings,
Jon Carvill,
Jon Shepard,
Jonathan McPhie,
Jonathan Torres,
Josh Ginsburg,
Junjie Wang,
Kai Wu,
Kam Hou U,
Karan Saxena,
Kartikay Khandelwal,
Katayoun Zand,
Kathy Matosich,
Kaushik Veeraraghavan,
Kelly Michelena,
Keqian Li,
Kiran Jagadeesh,
Kun Huang,
Kunal Chawla,
Kyle Huang,
Lailin Chen,
Lakshya Garg,
Lavender A,
Leandro Silva,
Lee Bell,
Lei Zhang,
Liangpeng Guo,
Licheng Yu,
Liron Moshkovich,
Luca Wehrstedt,
Madian Khabsa,
Manav Avalani,
Manish Bhatt,
Martynas Mankus,
Matan Hasson,
Matthew Lennie,
Matthias Reso,
Maxim Groshev,
Maxim Naumov,
Maya Lathi,
Meghan Keneally,
Miao Liu,
Michael L. Seltzer,
Michal Valko,
Michelle Restrepo,
Mihir Patel,
Mik Vyatskov,
Mikayel Samvelyan,
Mike Clark,
Mike Macey,
Mike Wang,
Miquel Jubert Hermoso,
Mo Metanat,
Mohammad Rastegari,
Munish Bansal,
Nandhini Santhanam,
Natascha Parks,
Natasha White,
Navyata Bawa,
Nayan Singhal,
Nick Egebo,
Nicolas Usunier,
Nikhil Mehta,
Nikolay Pavlovich Laptev,
Ning Dong,
Norman Cheng,
Oleg Chernoguz,
Olivia Hart,
Omkar Salpekar,
Ozlem Kalinli,
Parkin Kent,
Parth Parekh,
Paul Saab,
Pavan Balaji,
Pedro Rittner,
Philip Bontrager,
Pierre Roux,
Piotr Dollar,
Polina Zvyagina,
Prashant Ratanchandani,
Pritish Yuvraj,
Qian Liang,
Rachad Alao,
Rachel Rodriguez,
Rafi Ayub,
Raghotham Murthy,
Raghu Nayani,
Rahul Mitra,
Rangaprabhu Parthasarathy,
Raymond Li,
Rebekkah Hogan,
Robin Battey,
Rocky Wang,
Russ Howes,
Ruty Rinott,
Sachin Mehta,
Sachin Siby,
Sai Jayesh Bondu,
Samyak Datta,
Sara Chugh,
Sara Hunt,
Sargun Dhillon,
Sasha Sidorov,
Satadru Pan,
Saurabh Mahajan,
Saurabh Verma,
Seiji Yamamoto,
Sharadh Ramaswamy,
Shaun Lindsay,
Shaun Lindsay,
Sheng Feng,
Shenghao Lin,
Shengxin Cindy Zha,
Shishir Patil,
Shiva Shankar,
Shuqiang Zhang,
Shuqiang Zhang,
Sinong Wang,
Sneha Agarwal,
Soji Sajuyigbe,
Soumith Chintala,
Stephanie Max,
Stephen Chen,
Steve Kehoe,
Steve Satterfield,
Sudarshan Govindaprasad,
Sumit Gupta,
Summer Deng,
Sungmin Cho,
Sunny Virk,
Suraj Subramanian,
Sy Choudhury,
Sydney Goldman,
Tal Remez,
Tamar Glaser,
Tamara Best,
Thilo Koehler,
Thomas Robinson,
Tianhe Li,
Tianjun Zhang,
Tim Matthews,
Timothy Chou,
Tzook Shaked,
Varun Vontimitta,
Victoria Ajayi,
Victoria Montanez,
Vijai Mohan,
Vinay Satish Kumar,
Vishal Mangla,
Vlad Ionescu,
Vlad Poenaru,
Vlad Tiberiu Mihailescu,
Vladimir Ivanov,
Wei Li,
Wenchen Wang,
Wenwen Jiang,
Wes Bouaziz,
Will Constable,
Xiaocheng Tang,
Xiaojian Wu,
Xiaolan Wang,
Xilun Wu,
Xinbo Gao,
Yaniv Kleinman,
Yanjun Chen,
Ye Hu,
Ye Jia,
Ye Qi,
Yenda Li,
Yilin Zhang,
Ying Zhang,
Yossi Adi,
Youngjin Nam,
Yu Wang,
Yu Zhao,
Yuchen Hao,
Yundi Qian,
Yunlu Li,
Yuzi He,
Zach Rait,
Zachary DeVito,
Zef Rosnbrick,
Zhaoduo Wen,
Zhenyu Yang,
Zhiwei Zhao,
Zhiyu Ma
Identifiers
Abstract¶
Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. Our largest model is a dense Transformer with 405B parameters and a context window of up to 128K tokens. This paper presents an extensive empirical evaluation of Llama 3. We find that Llama 3 delivers comparable quality to leading language models such as GPT-4 on a plethora of tasks. We publicly release Llama 3, including pre-trained and post-trained versions of the 405B parameter language model and our Llama Guard 3 model for input and output safety. The paper also presents the results of experiments in which we integrate image, video, and speech capabilities into Llama 3 via a compositional approach. We observe this approach performs competitively with the state-of-the-art on image, video, and speech recognition tasks. The resulting models are not yet being broadly released as they are still under development.
Links¶
Knowledge Base
External
Similar Papers¶
1
89%
Llama 2: Open Foundation and Fine-Tuned Chat Models
Llama 2
('Hugo Touvron', 'Louis Martin', 'Kevin Stone', 'Peter Albert', 'Amjad Almahairi', 'Yasmine Babaei', 'Nikolay Bashlykov', 'Soumya Batra', 'Prajjwal Bhargava', 'Shruti Bhosale', 'Dan Bikel', 'Lukas Blecher', 'Cristian Canton Ferrer', 'Moya Chen', 'Guillem Cucurull', 'David Esiobu', 'Jude Fernandes', 'Jeremy Fu', 'Wenyin Fu', 'Brian Fuller', 'Cynthia Gao', 'Vedanuj Goswami', 'Naman Goyal', 'Anthony Hartshorn', 'Saghar Hosseini', 'Rui Hou', 'Hakan Inan', 'Marcin Kardas', 'Viktor Kerkez', 'Madian Khabsa', 'Isabel Kloumann', 'Artem Korenev', 'Punit Singh Koura', 'Marie-Anne Lachaux', 'Thibaut Lavril', 'Jenya Lee', 'Diana Liskovich', 'Yinghai Lu', 'Yuning Mao', 'Xavier Martinet', 'Todor Mihaylov', 'Pushkar Mishra', 'Igor Molybog', 'Yixin Nie', 'Andrew Poulton', 'Jeremy Reizenstein', 'Rashi Rungta', 'Kalyan Saladi', 'Alan Schelten', 'Ruan Silva', 'Eric Michael Smith', 'Ranjan Subramanian', 'Xiaoqing Ellen Tan', 'Binh Tang', 'Ross Taylor', 'Adina Williams', 'Jian Xiang Kuan', 'Puxin Xu', 'Zheng Yan', 'Iliyan Zarov', 'Yuchen Zhang', 'Angela Fan', 'Melanie Kambadur', 'Sharan Narang', 'Aurelien Rodriguez', 'Robert Stojnic', 'Sergey Edunov', 'Thomas Scialom') / 2023
2
88%
DeepSeek LLM: Scaling Open-Source Language Models with Longtermism
DeepSeek LLM
('Xiao Bi', 'Deli Chen', 'Guanting Chen', 'Shanhuang Chen', 'Damai Dai', 'Chengqi Deng', 'Honghui Ding', 'Kai Dong', 'Qiushi Du', 'Zhe Fu', 'Huazuo Gao', 'Kaige Gao', 'Wenjun Gao', 'Ruiqi Ge', 'Kang Guan', 'Daya Guo', 'Jianzhong Guo', 'Guangbo Hao', 'Zhewen Hao', 'Ying He', 'Wenjie Hu', 'Panpan Huang', 'Erhang Li', 'Guowei Li', 'Jiashi Li', 'Yao Li', 'Y. K. Li', 'Wenfeng Liang', 'Fangyun Lin', 'A. X. Liu', 'Bo Liu', 'Wen Liu', 'Xiaodong Liu', 'Xin Liu', 'Yiyuan Liu', 'Haoyu Lu', 'Shanghao Lu', 'Fuli Luo', 'Shirong Ma', 'Xiaotao Nie', 'Tian Pei', 'Yishi Piao', 'Junjie Qiu', 'Hui Qu', 'Tongzheng Ren', 'Zehui Ren', 'Chong Ruan', 'Zhangli Sha', 'Zhihong Shao', 'Junxiao Song', 'Xuecheng Su', 'Jingxiang Sun', 'Yaofeng Sun', 'Minghui Tang', 'Bingxuan Wang', 'Peiyi Wang', 'Shiyu Wang', 'Yaohui Wang', 'Yongji Wang', 'Tong Wu', 'Y. Wu', 'Xin Xie', 'Zhenda Xie', 'Ziwei Xie', 'Yiliang Xiong', 'Hanwei Xu', 'R. X. Xu', 'Yanhong Xu', 'Dejian Yang', 'Yuxiang You', 'Shuiping Yu', 'Xingkai Yu', 'B. Zhang', 'Haowei Zhang', 'Lecong Zhang', 'Liyue Zhang', 'Mingchuan Zhang', 'Minghua Zhang', 'Wentao Zhang', 'Yichao Zhang', 'Chenggang Zhao', 'Yao Zhao', 'Shangyan Zhou', 'Shunfeng Zhou', 'Qihao Zhu', 'Yuheng Zou') / 2024
3
84%
PaLM: Scaling Language Modeling with Pathways
PaLM
('Aakanksha Chowdhery', 'Sharan Narang', 'Jacob Devlin', 'Maarten Bosma', 'Gaurav Mishra', 'Adam Roberts', 'Paul Barham', 'Hyung Won Chung', 'Charles Sutton', 'Sebastian Gehrmann', 'Parker Schuh', 'Kensen Shi', 'Sasha Tsvyashchenko', 'Joshua Maynez', 'Abhishek Rao', 'Parker Barnes', 'Yi Tay', 'Noam Shazeer', 'Vinodkumar Prabhakaran', 'Emily Reif', 'Nan Du', 'Ben Hutchinson', 'Reiner Pope', 'James Bradbury', 'Jacob Austin', 'Michael Isard', 'Guy Gur-Ari', 'Pengcheng Yin', 'Toju Duke', 'Anselm Levskaya', 'Sanjay Ghemawat', 'Sunipa Dev', 'Henryk Michalewski', 'Xavier Garcia', 'Vedant Misra', 'Kevin Robinson', 'Liam Fedus', 'Denny Zhou', 'Daphne Ippolito', 'David Luan', 'Hyeontaek Lim', 'Barret Zoph', 'Alexander Spiridonov', 'Ryan Sepassi', 'David Dohan', 'Shivani Agrawal', 'Mark Omernick', 'Andrew M. Dai', 'Thanumalayan Sankaranarayana Pillai', 'Marie Pellat', 'Aitor Lewkowycz', 'Erica Moreira', 'Rewon Child', 'Oleksandr Polozov', 'Katherine Lee', 'Zongwei Zhou', 'Xuezhi Wang', 'Brennan Saeta', 'Mark Diaz', 'Orhan Firat', 'Michele Catasta', 'Jason Wei', 'Kathy Meier-Hellstern', 'Douglas Eck', 'Jeff Dean', 'Slav Petrov', 'Noah Fiedel') / 2022
4
83%
Gemma 2: Improving Open Language Models at a Practical Size
Gemma 2
('Morgane Riviere', 'Shreya Pathak', 'Pier Giuseppe Sessa', 'Cassidy Hardin', 'Surya Bhupatiraju', 'Leonard Hussenot', 'Thomas Mesnard', 'Bobak Shahriari', 'Alexandre Rame', 'Johan Ferret', 'Peter Liu', 'Pouya Tafti', 'Abe Friesen', 'Michelle Casbon', 'Sabela Ramos', 'Ravin Kumar', 'Charline Le Lan', 'Sammy Jerome', 'Anton Tsitsulin', 'Nino Vieillard', 'Piotr Stanczyk', 'Sertan Girgin', 'Nikola Momchev', 'Matt Hoffman', 'Shantanu Thakoor', 'Jean-Bastien Grill', 'Behnam Neyshabur', 'Olivier Bachem', 'Alanna Walton', 'Aliaksei Severyn', 'Alicia Parrish', 'Aliya Ahmad', 'Allen Hutchison', 'Alvin Abdagic', 'Amanda Carl', 'Amy Shen', 'Andy Brock', 'Andy Coenen', 'Anthony Laforge', 'Antonia Paterson', 'Ben Bastian', 'Bilal Piot', 'Bo Wu', 'Brandon Royal', 'Charlie Chen', 'Chintu Kumar', 'Chris Perry', 'Chris Welty', 'Christopher A. Choquette-Choo', 'Danila Sinopalnikov', 'David Weinberger', 'Dimple Vijaykumar', 'Dominika Rogozinska', 'Dustin Herbison', 'Elisa Bandy', 'Emma Wang', 'Eric Noland', 'Erica Moreira', 'Evan Senter', 'Evgenii Eltyshev', 'Francesco Visin', 'Gabriel Rasskin', 'Gary Wei', 'Glenn Cameron', 'Gus Martins', 'Hadi Hashemi', 'Hanna Klimczak-Plucinska', 'Harleen Batra', 'Harsh Dhand', 'Ivan Nardini', 'Jacinda Mein', 'Jack Zhou', 'James Svensson', 'Jeff Stanway', 'Jetha Chan', 'Jin Peng Zhou', 'Joana Carrasqueira', 'Joana Iljazi', 'Jocelyn Becker', 'Joe Fernandez', 'Joost van Amersfoort', 'Josh Gordon', 'Josh Lipschultz', 'Josh Newlan', 'Ju-yeong Ji', 'Kareem Mohamed', 'Kartikeya Badola', 'Kat Black', 'Katie Millican', 'Keelin McDonell', 'Kelvin Nguyen', 'Kiranbir Sodhia', 'Kish Greene', 'Lars Lowe Sjoesund', 'Lauren Usui', 'Laurent Sifre', 'Lena Heuermann', 'Leticia Lago', 'Lilly McNealus', 'Livio Baldini Soares', 'Logan Kilpatrick', 'Lucas Dixon', 'Luciano Martins', 'Machel Reid', 'Manvinder Singh', 'Mark Iverson', 'Martin Gorner', 'Mat Velloso', 'Mateo Wirth', 'Matt Davidow', 'Matt Miller', 'Matthew Rahtz', 'Matthew Watson', 'Meg Risdal', 'Mehran Kazemi', 'Michael Moynihan', 'Ming Zhang', 'Minsuk Kahng', 'Minwoo Park', 'Mofi Rahman', 'Mohit Khatwani', 'Natalie Dao', 'Nenshad Bardoliwalla', 'Nesh Devanathan', 'Neta Dumai', 'Nilay Chauhan', 'Oscar Wahltinez', 'Pankil Botarda', 'Parker Barnes', 'Paul Barham', 'Paul Michel', 'Pengchong Jin', 'Petko Georgiev', 'Phil Culliton', 'Pradeep Kuppala', 'Ramona Comanescu', 'Ramona Merhej', 'Reena Jana', 'Reza Ardeshir Rokni', 'Rishabh Agarwal', 'Ryan Mullins', 'Samaneh Saadat', 'Sara Mc Carthy', 'Sarah Cogan', 'Sarah Perrin', 'Sebastien M. R. Arnold', 'Sebastian Krause', 'Shengyang Dai', 'Shruti Garg', 'Shruti Sheth', 'Sue Ronstrom', 'Susan Chan', 'Timothy Jordan', 'Ting Yu', 'Tom Eccles', 'Tom Hennigan', 'Tomas Kocisky', 'Tulsee Doshi', 'Vihan Jain', 'Vikas Yadav', 'Vilobh Meshram', 'Vishal Dharmadhikari', 'Warren Barkley', 'Wei Wei', 'Wenming Ye', 'Woohyun Han', 'Woosuk Kwon', 'Xiang Xu', 'Zhe Shen', 'Zhitao Gong', 'Zichuan Wei', 'Victor Cotruta', 'Phoebe Kirk', 'Anand Rao', 'Minh Giang', 'Ludovic Peran', 'Tris Warkentin', 'Eli Collins', 'Joelle Barral', 'Zoubin Ghahramani', 'Raia Hadsell', 'D. Sculley', 'Jeanine Banks', 'Anca Dragan', 'Slav Petrov', 'Oriol Vinyals', 'Jeff Dean', 'Demis Hassabis', 'Koray Kavukcuoglu', 'Clement Farabet', 'Elena Buchatskaya', 'Sebastian Borgeaud', 'Noah Fiedel', 'Armand Joulin', 'Kathleen Kenealy', 'Robert Dadashi', 'Alek Andreev') / 2024
5
83%
PaLM 2 Technical Report
PaLM 2
('Rohan Anil', 'Andrew M. Dai', 'Orhan Firat', 'Melvin Johnson', 'Dmitry Lepikhin', 'Alexandre Passos', 'Siamak Shakeri', 'Emanuel Taropa', 'Paige Bailey', 'Zhifeng Chen', 'Eric Chu', 'Jonathan H. Clark', 'Laurent El Shafey', 'Yanping Huang', 'Kathy Meier-Hellstern', 'Gaurav Mishra', 'Erica Moreira', 'Mark Omernick', 'Kevin Robinson', 'Sebastian Ruder', 'Yi Tay', 'Kefan Xiao', 'Yuanzhong Xu', 'Yujing Zhang', 'Gustavo Hernandez Abrego', 'Junwhan Ahn', 'Jacob Austin', 'Paul Barham', 'Jan Botha', 'James Bradbury', 'Siddhartha Brahma', 'Kevin Brooks', 'Michele Catasta', 'Yong Cheng', 'Colin Cherry', 'Christopher A. Choquette-Choo', 'Aakanksha Chowdhery', 'Clement Crepy', 'Shachi Dave', 'Mostafa Dehghani', 'Sunipa Dev', 'Jacob Devlin', 'Mark Diaz', 'Nan Du', 'Ethan Dyer', 'Vlad Feinberg', 'Fangxiaoyu Feng', 'Vlad Fienber', 'Markus Freitag', 'Xavier Garcia', 'Sebastian Gehrmann', 'Lucas Gonzalez', 'Guy Gur-Ari', 'Steven Hand', 'Hadi Hashemi', 'Le Hou', 'Joshua Howland', 'Andrea Hu', 'Jeffrey Hui', 'Jeremy Hurwitz', 'Michael Isard', 'Abe Ittycheriah', 'Matthew Jagielski', 'Wenhao Jia', 'Kathleen Kenealy', 'Maxim Krikun', 'Sneha Kudugunta', 'Chang Lan', 'Katherine Lee', 'Benjamin Lee', 'Eric Li', 'Music Li', 'Wei Li', 'YaGuang Li', 'Jian Li', 'Hyeontaek Lim', 'Hanzhao Lin', 'Zhongtao Liu', 'Frederick Liu', 'Marcello Maggioni', 'Aroma Mahendru', 'Joshua Maynez', 'Vedant Misra', 'Maysam Moussalem', 'Zachary Nado', 'John Nham', 'Eric Ni', 'Andrew Nystrom', 'Alicia Parrish', 'Marie Pellat', 'Martin Polacek', 'Alex Polozov', 'Reiner Pope', 'Siyuan Qiao', 'Emily Reif', 'Bryan Richter', 'Parker Riley', 'Alex Castro Ros', 'Aurko Roy', 'Brennan Saeta', 'Rajkumar Samuel', 'Renee Shelby', 'Ambrose Slone', 'Daniel Smilkov', 'David R. So', 'Daniel Sohn', 'Simon Tokumine', 'Dasha Valter', 'Vijay Vasudevan', 'Kiran Vodrahalli', 'Xuezhi Wang', 'Pidong Wang', 'Zirui Wang', 'Tao Wang', 'John Wieting', 'Yuhuai Wu', 'Kelvin Xu', 'Yunhan Xu', 'Linting Xue', 'Pengcheng Yin', 'Jiahui Yu', 'Qiao Zhang', 'Steven Zheng', 'Ce Zheng', 'Weikang Zhou', 'Denny Zhou', 'Slav Petrov', 'Yonghui Wu') / 2023