Jean-Baptiste Cordonnier

According to our database, Jean-Baptiste Cordonnier authored at least 8 papers between 2018 and 2021.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2021

Attention is not all you need: pure attention loses rank doubly exponentially with depth.

Yihe Dong, Jean-Baptiste Cordonnier, Andreas Loukas

Proceedings of the 38th International Conference on Machine Learning, 2021

Group Equivariant Stand-Alone Self-Attention For Vision.

David W. Romero, Jean-Baptiste Cordonnier

Proceedings of the 9th International Conference on Learning Representations, 2021

Differentiable Patch Selection for Image Recognition.

Jean-Baptiste Cordonnier, Aravindh Mahendran, Alexey Dosovitskiy, Dirk Weissenborn, Jakob Uszkoreit, Thomas Unterthiner

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

2020

Multi-Head Attention: Collaborate Instead of Concatenate.

Jean-Baptiste Cordonnier, Andreas Loukas, Martin Jaggi

CoRR, 2020

On the Relationship between Self-Attention and Convolutional Layers.

Jean-Baptiste Cordonnier, Andreas Loukas, Martin Jaggi

Proceedings of the 8th International Conference on Learning Representations, 2020

2019

Robust Cross-lingual Embeddings from Parallel Sentences.

Ali Sabet, Prakhar Gupta, Jean-Baptiste Cordonnier, Robert West, Martin Jaggi

CoRR, 2019

Extrapolating Paths with Graph Neural Networks.

Jean-Baptiste Cordonnier, Andreas Loukas

Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, 2019

2018

Sparsified SGD with Memory.

Sebastian U. Stich, Jean-Baptiste Cordonnier, Martin Jaggi

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018