Felix Dangel

According to our database, Felix Dangel authored at least 16 papers between 2019 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

What Does It Mean to Be a Transformer? Insights from a Theoretical Hessian Analysis.

Weronika Ormaniec, Felix Dangel, Sidak Pal Singh

CoRR, 2024

Kronecker-Factored Approximate Curvature for Physics-Informed Neural Networks.

Felix Dangel, Johannes Müller, Marius Zeinhofer

CoRR, 2024

Lowering PyTorch's Memory Consumption for Selective Differentiation.

Samarth Bhatia, Felix Dangel

CoRR, 2024

Structured Inverse-Free Natural Gradient Descent: Memory-Efficient & Numerically-Stable KFAC.

Wu Lin, Felix Dangel, Runa Eschenhagen, Kirill Neklyudov, Agustinus Kristiadi, Richard E. Turner, Alireza Makhzani

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Can We Remove the Square-Root in Adaptive Gradient Methods? A Second-Order Perspective.

Wu Lin, Felix Dangel, Runa Eschenhagen, Juhan Bae, Richard E. Turner, Alireza Makhzani

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Revisiting Scalable Hessian Diagonal Approximations for Applications in Reinforcement Learning.

Mohamed Elsayed, Homayoon Farrahi, Felix Dangel, A. Rupam Mahmood

Proceedings of the Forty-first International Conference on Machine Learning, 2024

2023

Backpropagation Beyond the Gradient.

Felix Dangel

PhD thesis, 2023

ViViT: Curvature Access Through The Generalized Gauss-Newton's Low-Rank Structure.

Felix Dangel, Lukas Tatzel, Philipp Hennig

Trans. Mach. Learn. Res., 2023

Structured Inverse-Free Natural Gradient: Memory-Efficient & Numerically-Stable KFAC for Large Neural Nets.

Wu Lin, Felix Dangel, Runa Eschenhagen, Kirill Neklyudov, Agustinus Kristiadi, Richard E. Turner, Alireza Makhzani

CoRR, 2023

On the Disconnect Between Theory and Practice of Overparametrized Neural Networks.

Jonathan Wenger, Felix Dangel, Agustinus Kristiadi

CoRR, 2023

Convolutions Through the Lens of Tensor Networks.

Felix Dangel

CoRR, 2023

The Geometry of Neural Nets' Parameter Spaces Under Reparametrization.

Agustinus Kristiadi, Felix Dangel, Philipp Hennig

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

2021

Cockpit: A Practical Debugging Tool for the Training of Deep Neural Networks.

Frank Schneider, Felix Dangel, Philipp Hennig

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

2020

BackPACK: Packing more into Backprop.

Felix Dangel, Frederik Kunstner, Philipp Hennig

Proceedings of the 8th International Conference on Learning Representations, 2020

Modular Block-diagonal Curvature Approximations for Feedforward Architectures.

Felix Dangel, Stefan Harmeling, Philipp Hennig

Proceedings of the 23rd International Conference on Artificial Intelligence and Statistics, 2020

2019

A Modular Approach to Block-diagonal Hessian Approximations for Second-order Optimization Methods.

Felix Dangel, Philipp Hennig

CoRR, 2019