Yassir Akram

According to our database, Yassir Akram authored at least 7 papers between 2022 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Weight decay induces low-rank attention layers.

Seijin Kobayashi, Yassir Akram, Johannes von Oswald

CoRR, 2024

Learning Randomized Algorithms with Transformers.

Johannes von Oswald, Seijin Kobayashi, Yassir Akram, Angelika Steger

CoRR, 2024

When can transformers compositionally generalize in-context?

Seijin Kobayashi, Simon Schug, Yassir Akram, Florian Redhardt, Johannes von Oswald, Razvan Pascanu, Guillaume Lajoie, João Sacramento

CoRR, 2024

Attention as a Hypernetwork.

Simon Schug, Seijin Kobayashi, Yassir Akram, João Sacramento, Razvan Pascanu

CoRR, 2024

Discovering modular solutions that generalize compositionally.

Simon Schug, Seijin Kobayashi, Yassir Akram, Maciej Wolczyk, Alexandra Proca, Johannes von Oswald, Razvan Pascanu, João Sacramento, Angelika Steger

Proceedings of the Twelfth International Conference on Learning Representations, 2024

2023

Gated recurrent neural networks discover attention.

Nicolas Zucchet, Seijin Kobayashi, Yassir Akram, Johannes von Oswald, Maxime Larcher, Angelika Steger, João Sacramento

CoRR, 2023

2022

Random initialisations performing above chance and how to find them.

Frederik Benzing, Simon Schug, Robert Meier, Johannes von Oswald, Yassir Akram, Nicolas Zucchet, Laurence Aitchison, Angelika Steger

CoRR, 2022