Raphaël Berthier

According to our database, Raphaël Berthier authored at least 15 papers between 2017 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Attention layers provably solve single-location regression.

Pierre Marion, Raphaël Berthier, Gérard Biau, Claire Boyer

CoRR, 2024

On the Minimal Degree Bias in Generalization on the Unseen for non-Boolean Functions.

Denys Pushkin, Raphaël Berthier, Emmanuel Abbe

Proceedings of the Forty-first International Conference on Machine Learning, 2024

2023

Incremental Learning in Diagonal Linear Networks.

Raphaël Berthier

J. Mach. Learn. Res., 2023

Learning time-scales in two-layers neural networks.

Raphaël Berthier, Andrea Montanari, Kangjie Zhou

CoRR, 2023

Leveraging the two-timescale regime to demonstrate convergence of neural networks.

Pierre Marion, Raphaël Berthier

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

2022

Acceleration of Gossip Algorithms through the Euler-Poisson-Darboux Equation.

Raphaël Berthier, Mufan (Bill) Li

CoRR, 2022

2021

Analysis and Acceleration of Gradient Descents and Gossip Algorithms. (Analyse et Accélération des Descentes de Gradient et des Algorithmes de Gossip).

Raphaël Berthier

PhD thesis, 2021

Graph-based Approximate Message Passing Iterations.

Cédric Gerbelot, Raphaël Berthier

CoRR, 2021

A Continuized View on Nesterov Acceleration for Stochastic Gradient Descent and Randomized Gossip.

Mathieu Even, Raphaël Berthier, Francis R. Bach, Nicolas Flammarion, Pierre Gaillard, Hadrien Hendrikx, Laurent Massoulié, Adrien B. Taylor

CoRR, 2021

A Continuized View on Nesterov Acceleration.

Raphaël Berthier, Francis R. Bach, Nicolas Flammarion, Pierre Gaillard, Adrien B. Taylor

CoRR, 2021

Continuized Accelerations of Deterministic and Stochastic Gradient Descents, and of Gossip Algorithms.

Mathieu Even, Raphaël Berthier, Francis R. Bach, Nicolas Flammarion, Hadrien Hendrikx, Pierre Gaillard, Laurent Massoulié, Adrien B. Taylor

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

2020

Accelerated Gossip in Networks of Given Dimension Using Jacobi Polynomial Iterations.

Raphaël Berthier, Francis R. Bach, Pierre Gaillard

SIAM J. Math. Data Sci., 2020

Tight Nonparametric Convergence Rates for Stochastic Gradient Descent under the Noiseless Linear Model.

Raphaël Berthier, Francis R. Bach, Pierre Gaillard

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

2018

Gossip of Statistical Observations using Orthogonal Polynomials.

Raphaël Berthier, Francis R. Bach, Pierre Gaillard

CoRR, 2018

2017

State Evolution for Approximate Message Passing with Non-Separable Functions.

Raphaël Berthier, Andrea Montanari, Phan-Minh Nguyen

CoRR, 2017