Jonathan Pilault

According to our database, Jonathan Pilault authored at least 16 papers between 2020 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

The Zamba2 Suite: Technical Report.

Paolo Glorioso, Quentin Anthony, Yury Tokpanov, Anna Golubeva, Vasudev Shyam, James Whittington, Jonathan Pilault, Beren Millidge

CoRR, 2024

Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters.

Vasudev Shyam, Jonathan Pilault, Emily Shepperd, Quentin Anthony, Beren Millidge

CoRR, 2024

Zyda: A 1.3T Dataset for Open Language Modeling.

Yury Tokpanov, Beren Millidge, Paolo Glorioso, Jonathan Pilault, Adam Ibrahim, James Whittington, Quentin Anthony

CoRR, 2024

Zamba: A Compact 7B SSM Hybrid Model.

Paolo Glorioso, Quentin Anthony, Yury Tokpanov, James Whittington, Jonathan Pilault, Adam Ibrahim, Beren Millidge

CoRR, 2024

Course Correcting Koopman Representations.

Mahan Fathi, Clement Gehring, Jonathan Pilault, David Kanaa, Pierre-Luc Bacon, Ross Goroshin

Proceedings of the Twelfth International Conference on Learning Representations, 2024

2023

Block-State Transformer.

Mahan Fathi, Jonathan Pilault, Pierre-Luc Bacon, Christopher Pal, Orhan Firat, Ross Goroshin

CoRR, 2023

JaxPruner: A concise library for sparsity research.

Joo Hyung Lee, Wonpyo Park, Nicole Mitchell, Jonathan Pilault, Johan S. Obando-Ceron, Han-Byul Kim, Namhoon Lee, Elias Frantar, Yun Long, Amir Yazdanbakhsh, Shivani Agrawal, Suvinay Subramanian, Xin Wang, Sheng-Chun Kao, Xingyao Zhang, Trevor Gale, Aart Bik, Woohyun Han, Milen Ferev, Zhonglin Han, Hong-Seok Kim, Yann N. Dauphin, Karolina Dziugaite, Pablo Samuel Castro, Utku Evci

CoRR, 2023

Block-State Transformers.

Jonathan Pilault, Mahan Fathi, Orhan Firat, Chris Pal, Pierre-Luc Bacon, Ross Goroshin

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction.

Jonathan Pilault, Xavier Garcia, Arthur Brazinskas, Orhan Firat

Proceedings of the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics, 2023

On Conditional and Compositional Language Model Differentiable Prompting.

Jonathan Pilault, Can Liu, Mohit Bansal, Markus Dreyer

Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, 2023

2022

Using Graph Algorithms to Pretrain Graph Completion Transformers.

Jonathan Pilault, Michael Galkin, Bahare Fatemi, Perouz Taslakian, David Vázquez, Christopher Pal

CoRR, 2022

2021

Towards Neural Functional Program Evaluation.

Torsten Scholak, Jonathan Pilault, Joey Velez-Ginorio

CoRR, 2021

Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data.

Jonathan Pilault, Amine Elhattami, Christopher J. Pal

Proceedings of the 9th International Conference on Learning Representations, 2021

2020

Learning to Summarize Long Texts with Memory Compression and Transfer.

Jaehong Park, Jonathan Pilault, Christopher Joseph Pal

CoRR, 2020

On the impressive performance of randomly weighted encoders in summarization tasks.

Jonathan Pilault, Jaehong Park, Christopher J. Pal

CoRR, 2020

On Extractive and Abstractive Neural Document Summarization with Transformer Language Models.

Jonathan Pilault, Raymond Li, Sandeep Subramanian, Chris Pal

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020