2025
Command A: An Enterprise-Ready Large Language Model.
[DOI]
Aakanksha
,
Arash Ahmadian
,
Marwan Ahmed
,
Jay Alammar
,
Milad Alizadeh
,
Yazeed Alnumay
,
Sophia Althammer
,
Arkady Arkhangorodsky
,
Viraat Aryabumi
,
Dennis Aumiller
,
Raphaël Avalos
,
Zahara Aviv
,
Sammie Bae
,
Saurabh Baji
,
Alexandre Barbet
,
Max Bartolo
,
Björn Bebensee
,
Neeral Beladia
,
Walter Beller-Morales
,
Alexandre Bérard
,
Andrew Berneshawi
,
Anna Bialas
,
Phil Blunsom
,
Matt Bobkin
,
Adi Bongale
,
Sam Braun
,
Maxime Brunet
,
Samuel Cahyawijaya
,
David Cairuz
,
Jon Ander Campos
,
Cassie Cao
,
Kris Cao
,
Roman Castagné
,
Julián Cendrero
,
Leila Chan Currie
,
Yash Chandak
,
Diane Chang
,
Giannis Chatziveroglou
,
Hongyu Chen
,
Claire Cheng
,
Alexis Chevalier
,
Justin T. Chiu
,
Eugene Choi
,
Eujeong Choi
,
Tim Chung
,
Volkan Cirik
,
Ana Cismaru
,
Pierre Clavier
,
Henry Conklin
,
Lucas Crawhall-Stein
,
Devon Crouse
,
Felipe Cruz-Salinas
,
Ben Cyrus
,
Daniel D'souza
,
Hugo Dalla-Torre
,
John Dang
,
William Darling
,
Omar Darwiche Domingues
,
Saurabh Dash
,
Antoine Debugne
,
Théo Dehaze
,
Shaan Desai
,
Joan Devassy
,
Rishit Dholakia
,
Kyle Duffy
,
Ali Edalati
,
Ace Eldeib
,
Abdullah Elkady
,
Sarah Elsharkawy
,
Irem Ergün
,
Beyza Ermis
,
Marzieh Fadaee
,
Boyu Fan
,
Lucas Fayoux
,
Yannis Flet-Berliac
,
Nick Frosst
,
Matthias Gallé
,
Wojciech Galuba
,
Utsav Garg
,
Matthieu Geist
,
Mohammad Gheshlaghi Azar
,
Ellen Gilsenan-McMahon
,
Seraphina Goldfarb-Tarrant
,
Tomas Goldsack
,
Aidan N. Gomez
,
Victor Machado Gonzaga
,
Nithya Govindarajan
,
Manoj Govindassamy
,
Nathan Grinsztajn
,
Nikolas Gritsch
,
Patrick Gu
,
Shangmin Guo
,
Kilian Haefeli
,
Rod Hajjar
,
Tim Hawes
,
Jingyi He
,
Sebastian Hofstätter
,
Sungjin Hong
CoRR, April, 2025

Rope to Nope and Back Again: A New Hybrid Attention Strategy.
[DOI]
Bowen Yang
,
Bharat Venkitesh
,
Dwarak Talupuru
,
Hangyu Lin
,
David Cairuz
,
Phil Blunsom
,
Acyr Locatelli
CoRR, January, 2025

2024
Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier.
[DOI]
John Dang
,
Shivalika Singh
,
Daniel D'souza
,
Arash Ahmadian
,
Alejandro Salamanca
,
Madeline Smith
,
Aidan Peppin
,
Sungjin Hong
,
Manoj Govindassamy
,
Terrence Zhao
,
Sandra Kublik
,
Meor Amer
,
Viraat Aryabumi
,
Jon Ander Campos
,
Yi Chern Tan
,
Tom Kocmi
,
Florian Strub
,
Nathan Grinsztajn
,
Yannis Flet-Berliac
,
Acyr Locatelli
,
Hangyu Lin
,
Dwarak Talupuru
,
Bharat Venkitesh
,
David Cairuz
,
Bowen Yang
,
Tim Chung
,
Wei-Yin Ko
,
Sylvie Shang Shi
,
Amir Shukayev
,
Sammie Bae
,
Aleksandra Piktus
,
Roman Castagné
,
Felipe Cruz-Salinas
,
Eddie Kim
,
Lucas Crawhall-Stein
,
Adrien Morisot
,
Sudip Roy
,
Phil Blunsom
,
Ivan Zhang
,
Aidan N. Gomez
,
Nick Frosst
,
Marzieh Fadaee
,
Beyza Ermis
,
Ahmet Üstün
,
Sara Hooker
CoRR, 2024

Aya 23: Open Weight Releases to Further Multilingual Progress.
[DOI]
Viraat Aryabumi
,
John Dang
,
Dwarak Talupuru
,
Saurabh Dash
,
David Cairuz
,
Hangyu Lin
,
Bharat Venkitesh
,
Madeline Smith
,
Jon Ander Campos
,
Yi Chern Tan
,
Kelly Marchisio
,
Max Bartolo
,
Sebastian Ruder
,
Acyr Locatelli
,
Julia Kreutzer
,
Nick Frosst
,
Aidan N. Gomez
,
Phil Blunsom
,
Marzieh Fadaee
,
Ahmet Üstün
,
Sara Hooker
CoRR, 2024

BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts.
[DOI]
Qizhen (Irene) Zhang
,
Nikolas Gritsch
,
Dwaraknath Gnaneshwar
,
Simon Guo
,
David Cairuz
,
Bharat Venkitesh
,
Jakob N. Foerster
,
Phil Blunsom
,
Sebastian Ruder
,
Ahmet Üstün
,
Acyr Locatelli
Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, 2024