Aran Komatsuzaki

According to our database, Aran Komatsuzaki authored at least 7 papers between 2018 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Improving Foundation Models.

Aran Komatsuzaki

PhD thesis, 2024

2023

ARB: Advanced Reasoning Benchmark for Large Language Models.

Tomohiro Sawada, Daniel Paleka, Alexander Havrilla, Pranav Tadepalli, Paula Vidas, Alexander Kranias, John J. Nay, Kshitij Gupta, Aran Komatsuzaki

CoRR, 2023

Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints.

Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, Carlos Riquelme Ruiz, Basil Mustafa, Joshua Ainslie, Yi Tay, Mostafa Dehghani, Neil Houlsby

Proceedings of the Eleventh International Conference on Learning Representations, 2023

2021

LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs.

Christoph Schuhmann, Richard Vencu, Romain Beaumont, Robert Kaczmarczyk, Clayton Mullis, Aarush Katta, Theo Coombes, Jenia Jitsev, Aran Komatsuzaki

CoRR, 2021

2020

Current Limitations of Language Models: What You Need is Retrieval.

Aran Komatsuzaki

CoRR, 2020

2019

One Epoch Is All You Need.

Aran Komatsuzaki

CoRR, 2019

2018

Extractive Summary as Discrete Latent Variables.

Aran Komatsuzaki

CoRR, 2018