Piotr Nawrot

According to our database, Piotr Nawrot authored at least 5 papers between 2022 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Dynamic Memory Compression: Retrofitting LLMs for Accelerated Inference.

Piotr Nawrot, Adrian Lancucki, Marcin Chochowski, David Tarjan, Edoardo M. Ponti

Proceedings of the Forty-first International Conference on Machine Learning, 2024

2023

nanoT5: A PyTorch Framework for Pre-training and Fine-tuning T5-style Models with Limited Resources.

Piotr Nawrot

CoRR, 2023

No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models.

Jean Kaddour, Oscar Key, Piotr Nawrot, Pasquale Minervini, Matt J. Kusner

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Efficient Transformers with Dynamic Token Pooling.

Piotr Nawrot, Jan Chorowski, Adrian Lancucki, Edoardo Maria Ponti

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

Hierarchical Transformers Are More Efficient Language Models.

Piotr Nawrot, Szymon Tworkowski, Michal Tyrolski, Lukasz Kaiser, Yuhuai Wu, Christian Szegedy, Henryk Michalewski

Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2022, 2022