Pierre Ablin

CoRR, 2024

Theory, Analysis, and Best Practices for Sigmoid Self-Attention.

[BibT_eX]

[DOI]

Jason Ramapuram

Federico Danieli

Eeshan Gunesh Dhekane

CoRR, 2024

The AdEMAMix Optimizer: Better, Faster, Older.

[BibT_eX]

[DOI]

Matteo Pagliardini

CoRR, 2024

Specialized Language Models with Cheap Inference from Limited Domain Data.

[BibT_eX]

[DOI]

Angelos Katharopoulos

Awni Hannun

CoRR, 2024

Optimization without Retraction on the Random Generalized Stiefel Manifold.

[BibT_eX]

[DOI]

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Careful with that Scalpel: Improving Gradient Surgery with an EMA.

[BibT_eX]

[DOI]

Proceedings of the Forty-first International Conference on Machine Learning, 2024

How Smooth Is Attention?

[BibT_eX]

[DOI]

Valérie Castin

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Enhancing Hypergradients Estimation: A Study of Preconditioning and Reparameterization.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Artificial Intelligence and Statistics, 2024

A Lower Bound and a Near-Optimal Algorithm for Bilevel Empirical Risk Minimization.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Artificial Intelligence and Statistics, 2024

2023

Understanding the Regularity of Self-Attention with Optimal Transport.

[BibT_eX]

[DOI]

Valérie Castin

CoRR, 2023

Adaptive Training Distributions with Scalable Online Bilevel Optimization.

[BibT_eX]

[DOI]

Awni Hannun

CoRR, 2023

A Challenge in Reweighting Data with Bilevel Optimization.

[BibT_eX]

[DOI]

Anastasia Ivanova

CoRR, 2023

Learning Costs for Structured Monge Displacements.

[BibT_eX]

[DOI]

Michal Klein

Aram-Alexandre Pooladian

CoRR, 2023

Test like you Train in Implicit Deep Learning.

[BibT_eX]

[DOI]

CoRR, 2023

Infeasible Deterministic, Stochastic, and Variance-Reduction Algorithms for Optimization under Orthogonality Constraints.

[BibT_eX]

[DOI]

CoRR, 2023

A Near-Optimal Algorithm for Bilevel Empirical Risk Minimization.

[BibT_eX]

[DOI]

CoRR, 2023

How to Scale Your EMA.

[BibT_eX]

[DOI]

Eeshan Gunesh Dhekane

Xavier Suau Cuadros

Russell Webb

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Multiview Independent Component Analysis with Delays.

[BibT_eX]

[DOI]

Ambroise Heurtebise

Proceedings of the 33rd IEEE International Workshop on Machine Learning for Signal Processing, 2023

Monge, Bregman and Occam: Interpretable Optimal Transport in High-Dimensions with Feature-Sparse Maps.

[BibT_eX]

[DOI]

Marco Cuturi

Michal Klein

Proceedings of the International Conference on Machine Learning, 2023

2022

Do Residual Neural Networks discretize Neural Ordinary Differential Equations?

[BibT_eX]

[DOI]

Michael E. Sander

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

A framework for bilevel optimization that enables stochastic and global variance reduction algorithms.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Benchopt: Reproducible, efficient and collaborative optimization benchmarks.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Sinkformers: Transformers with Doubly Stochastic Attention.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Artificial Intelligence and Statistics, 2022

Fast and accurate optimization on the orthogonal manifold without retraction.

[BibT_eX]

[DOI]

Pierre-Cyril Aubin-Frankowski

Proceedings of the International Conference on Artificial Intelligence and Statistics, 2022

2021

mvlearn: Multiview Machine Learning in Python.

[BibT_eX]

[DOI]

J. Mach. Learn. Res., 2021

Adaptive Multi-View ICA: Estimation of noise levels for optimal inference.

[BibT_eX]

[DOI]

CoRR, 2021

Shared Independent Component Analysis for Multi-Subject Neuroimaging.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Momentum Residual Neural Networks.

[BibT_eX]

[DOI]

Proceedings of the 38th International Conference on Machine Learning, 2021

Kernel Stein Discrepancy Descent.

[BibT_eX]

[DOI]

Anna Korba

Szymon Majewski

Proceedings of the 38th International Conference on Machine Learning, 2021

2020

Predictive regression modeling with MEG/EEG: from source power to signals and cognitive states.

[BibT_eX]

[DOI]

NeuroImage, 2020

Deep orthogonal linear networks are shallow.

[BibT_eX]

[DOI]

CoRR, 2020

Modeling Shared responses in Neuroimaging Studies through MultiView ICA.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Super-efficiency of automatic differentiation for functions defined as a minimum.

[BibT_eX]

[DOI]

Thomas Moreau

Proceedings of the 37th International Conference on Machine Learning, 2020

2019

Manifold-regression to predict from MEG/EEG brain signals without source modeling.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Learning step sizes for unfolded sparse coding.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

A Quasi-Newton Algorithm on the Orthogonal Manifold for NMF with Transform Learning.

[BibT_eX]

[DOI]

Proceedings of the IEEE International Conference on Acoustics, 2019

Beyond Pham's algorithm for joint diagonalization.

[BibT_eX]

[DOI]

Proceedings of the 27th European Symposium on Artificial Neural Networks, 2019

Stochastic algorithms with descent guarantees for ICA.

[BibT_eX]

[DOI]

Francis R. Bach

Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics, 2019

2018

Faster Independent Component Analysis by Preconditioning With Hessian Approximations.

[BibT_eX]

[DOI]

IEEE Trans. Signal Process., 2018

Statistical Shape Modeling of the Left Ventricle: Myocardial Infarct Classification Challenge.

[BibT_eX]

[DOI]

IEEE J. Biomed. Health Informatics, 2018

EM algorithms for ICA.

[BibT_eX]

[DOI]

Francis R. Bach

CoRR, 2018

Faster ICA Under Orthogonal Constraint.

[BibT_eX]

[DOI]

Proceedings of the 2018 IEEE International Conference on Acoustics, 2018

Accelerating Likelihood Optimization for ICA on Real Signals.

[BibT_eX]

[DOI]

Proceedings of the Latent Variable Analysis and Signal Separation, 2018

2015

Detecting Myocardial Infarction Using Medial Surfaces - LV Statistical Modelling Challenge: Myocardial Infarction.

[BibT_eX]

[DOI]