Matteo Pagliardini

According to our database, Matteo Pagliardini authored at least 17 papers between 2013 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

The AdEMAMix Optimizer: Better, Faster, Older.

Matteo Pagliardini, Pierre Ablin, David Grangier

CoRR, 2024

DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging.

Matteo Pagliardini, Amirkeivan Mohtashami, François Fleuret, Martin Jaggi

CoRR, 2024

DOGE: Domain Reweighting with Generalization Estimation.

Simin Fan, Matteo Pagliardini, Martin Jaggi

Proceedings of the Forty-first International Conference on Machine Learning, 2024

A Primal-Dual Approach to Solving Variational Inequalities with General Constraints.

Tatjana Chavdarova, Tong Yang, Matteo Pagliardini, Michael I. Jordan

Proceedings of the Twelfth International Conference on Learning Representations, 2024

2023

MEDITRON-70B: Scaling Medical Pretraining for Large Language Models.

Zeming Chen, Alejandro Hernández-Cano, Angelika Romanou, Antoine Bonnet, Kyle Matoba, Francesco Salvi, Matteo Pagliardini, Simin Fan, Andreas Köpf, Amirkeivan Mohtashami, Alexandre Sallinen, Alireza Sakhaeirad, Vinitra Swamy, Igor Krawczuk, Deniz Bayazit, Axel Marmet, Syrielle Montariol, Mary-Anne Hartley, Martin Jaggi, Antoine Bosselut

CoRR, 2023

CoTFormer: More Tokens With Attention Make Up For Less Depth.

Amirkeivan Mohtashami, Matteo Pagliardini, Martin Jaggi

CoRR, 2023

Faster Causal Attention Over Large Sequences Through Sparse Flash Attention.

Matteo Pagliardini, Daniele Paliotta, Martin Jaggi, François Fleuret

CoRR, 2023

Fast Attention Over Long Sequences With Dynamic Sparse Flash Attention.

Matteo Pagliardini, Daniele Paliotta, Martin Jaggi, François Fleuret

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Agree to Disagree: Diversity through Disagreement for Better Transferability.

Matteo Pagliardini, Martin Jaggi, François Fleuret, Sai Praneeth Karimireddy

Proceedings of the Eleventh International Conference on Learning Representations, 2023

2022

Revisiting the ACVI Method for Constrained Variational Inequalities.

Tatjana Chavdarova, Matteo Pagliardini, Tong Yang, Michael I. Jordan

CoRR, 2022

Improving Generalization via Uncertainty Driven Perturbations.

Matteo Pagliardini, Gilberto Manunza, Martin Jaggi, Michael I. Jordan, Tatjana Chavdarova

CoRR, 2022

2021

The Peril of Popular Deep Learning Uncertainty Estimation Methods.

Yehao Liu, Matteo Pagliardini, Tatjana Chavdarova, Sebastian U. Stich

CoRR, 2021

Taming GANs with Lookahead-Minmax.

Tatjana Chavdarova, Matteo Pagliardini, Sebastian U. Stich, François Fleuret, Martin Jaggi

Proceedings of the 9th International Conference on Learning Representations, 2021

2020

Taming GANs with Lookahead.

Tatjana Chavdarova, Matteo Pagliardini, Martin Jaggi, François Fleuret

CoRR, 2020

2019

Better Word Embeddings by Disentangling Contextual n-Gram Information.

Prakhar Gupta, Matteo Pagliardini, Martin Jaggi

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

2018

Unsupervised Learning of Sentence Embeddings Using Compositional n-Gram Features.

Matteo Pagliardini, Prakhar Gupta, Martin Jaggi

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

2013

Exemplar-Based Hole-Filling Technique for Multiple Dynamic Objects.

Matteo Pagliardini, Yasuhiro Akagi, Marcos Slomp, Ryo Furukawa, Ryusuke Sagawa, Hiroshi Kawasaki

Proceedings of the Image and Video Technology - 6th Pacific-Rim Symposium, 2013