Valerii Likhosherstov

CoRR, 2024

Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers.

[BibT_eX]

[DOI]

Shanda Li

Proceedings of the International Conference on Artificial Intelligence and Statistics, 2024

2023

PolyViT: Co-training Vision Transformers on Images, Videos and Audio.

[BibT_eX]

[DOI]

Anurag Arnab

Mario Lucic

Yi Tay

Mostafa Dehghani

Trans. Mach. Learn. Res., 2023

Scalable Neural Network Kernels.

[BibT_eX]

[DOI]

Arijit Sehanobish

Yunfan Zhao

Avinava Dubey

CoRR, 2023

Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers.

[BibT_eX]

[DOI]

Shanda Li

CoRR, 2023

FAVOR#: Sharp Attention Kernel Approximations via New Classes of Positive Random Features.

[BibT_eX]

[DOI]

CoRR, 2023

Dense-Exponential Random Features: Sharp Positive Estimators of the Gaussian Kernel.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Adaptive Computation with Elastic Input Sequence.

[BibT_eX]

[DOI]

Fuzhao Xue

Proceedings of the International Conference on Machine Learning, 2023

Simplex Random Features.

[BibT_eX]

[DOI]

Isaac Reid

Proceedings of the International Conference on Machine Learning, 2023

Efficient Graph Field Integrators Meet Point Clouds.

[BibT_eX]

[DOI]

Somnath Basu Roy Chowdhury

Proceedings of the International Conference on Machine Learning, 2023

On the Expressive Flexibility of Self-Attention Matrices.

[BibT_eX]

[DOI]

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

Automated Deep Aberration Detection from Chromosome Karyotype Images.

[BibT_eX]

[DOI]

Brian Williams

Michael Frumkin

Fred Appelbaum

Ali Bashir

Min Fang

CoRR, 2022

Chefs' Random Tables: Non-Trigonometric Random Features.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformers.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Machine Learning, 2022

Hybrid Random Features.

[BibT_eX]

[DOI]

Dmitry Kalashnikov

Vikas Sindhwani

Proceedings of the Tenth International Conference on Learning Representations, 2022

2021

PolyViT: Co-training Vision Transformers on Images, Videos and Audio.

[BibT_eX]

[DOI]

Anurag Arnab

CoRR, 2021

On the Expressive Power of Self-Attention Matrices.

[BibT_eX]

[DOI]

CoRR, 2021

Unlocking Pixels for Reinforcement Learning via Implicit Attention.

[BibT_eX]

[DOI]

Deepali Jain

Jack Parker-Holder

CoRR, 2021

Sub-Linear Memory: How to Make Performers SLiM.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Debiasing a First-order Heuristic for Approximate Bi-level Optimization.

[BibT_eX]

[DOI]

Proceedings of the 38th International Conference on Machine Learning, 2021

Rethinking Attention with Performers.

[BibT_eX]

[DOI]

David Benjamin Belanger

Lucy J. Colwell

Proceedings of the 9th International Conference on Learning Representations, 2021

CWY Parametrization: a Solution for Parallelized Optimization of Orthogonal and Stiefel Matrices.

[BibT_eX]

[DOI]

Proceedings of the 24th International Conference on Artificial Intelligence and Statistics, 2021

2020

An Ode to an ODE.

[BibT_eX]

[DOI]

Jean-Jacques E. Slotine

CoRR, 2020

UFO-BLO: Unbiased First-Order Bilevel Optimization.

[BibT_eX]

[DOI]

CoRR, 2020

Masked Language Modeling for Proteins via Linearly Scalable Long-Context Transformers.

[BibT_eX]

[DOI]

CoRR, 2020

CWY Parametrization for Scalable Learning of Orthogonal and Stiefel Matrices.

[BibT_eX]

[DOI]

CoRR, 2020

Ode to an ODE.

[BibT_eX]

[DOI]

Jean-Jacques E. Slotine

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Stochastic Flows and Geometric Optimization on the Orthogonal Group.

[BibT_eX]

[DOI]

David Cheikhi

Proceedings of the 37th International Conference on Machine Learning, 2020

2019

Tractable Minor-free Generalization of Planar Zero-field Ising Models.

[BibT_eX]

[DOI]

Michael Chertkov

CoRR, 2019

A New Family of Tractable Ising Models.

[BibT_eX]

[DOI]

Michael Chertkov

CoRR, 2019

Inference and Sampling of $K_33$-free Ising Models.

[BibT_eX]

[DOI]

Misha Chertkov

Proceedings of the 36th International Conference on Machine Learning, 2019

2018

Inference and Sampling of K<sub>33</sub>-free Ising Models.

[BibT_eX]

[DOI]