Imanol Schlag

According to our database, Imanol Schlag authored at least 18 papers between 2017 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Understanding and Minimising Outlier Features in Neural Network Training.

Bobby He, Lorenzo Noci, Daniele Paliotta, Imanol Schlag, Thomas Hofmann

CoRR, 2024

Language Imbalance Can Boost Cross-lingual Generalisation.

Anton Schäfer, Shauli Ravfogel, Thomas Hofmann, Tiago Pimentel, Imanol Schlag

CoRR, 2024

Navigating Scaling Laws: Compute Optimality in Adaptive Model Training.

Sotiris Anagnostidis, Gregor Bachmann, Imanol Schlag, Thomas Hofmann

Proceedings of the Forty-first International Conference on Machine Learning, 2024

On the Effect of (Near) Duplicate Subwords in Language Modelling.

Anton Schäfer, Thomas Hofmann, Imanol Schlag, Tiago Pimentel

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

The Languini Kitchen: Enabling Language Modelling Research at Different Scales of Compute.

Aleksandar Stanic, Dylan R. Ashley, Oleg Serikov, Louis Kirsch, Francesco Faccio, Jürgen Schmidhuber, Thomas Hofmann, Imanol Schlag

CoRR, 2023

Mindstorms in Natural Language-Based Societies of Mind.

Mingchen Zhuge, Haozhe Liu, Francesco Faccio, Dylan R. Ashley, Róbert Csordás, Anand Gopalakrishnan, Abdullah Hamdi, Hasan Abed Al Kader Hammoud, Vincent Herrmann, Kazuki Irie, Louis Kirsch, Bing Li, Guohao Li, Shuming Liu, Jinjie Mai, Piotr Piekos, Aditya A. Ramesh, Imanol Schlag, Weimin Shi, Aleksandar Stanic, Wenyi Wang, Yuhui Wang, Mengmeng Xu, Deng-Ping Fan, Bernard Ghanem, Jürgen Schmidhuber

CoRR, 2023

Large Language Model Programs.

Imanol Schlag, Sainbayar Sukhbaatar, Asli Celikyilmaz, Wen-tau Yih, Jason Weston, Jürgen Schmidhuber, Xian Li

CoRR, 2023

2022

Solving Quantitative Reasoning Problems with Language Models.

Aitor Lewkowycz, Anders Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay V. Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, Yuhuai Wu, Behnam Neyshabur, Guy Gur-Ari, Vedant Misra

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Block-Recurrent Transformers.

DeLesley Hutchins, Imanol Schlag, Yuhuai Wu, Ethan Dyer, Behnam Neyshabur

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

A Modern Self-Referential Weight Matrix That Learns to Modify Itself.

Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

Proceedings of the International Conference on Machine Learning, 2022

2021

Improving Baselines in the Wild.

Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

CoRR, 2021

Linear Transformers Are Secretly Fast Weight Memory Systems.

Imanol Schlag, Kazuki Irie, Jürgen Schmidhuber

CoRR, 2021

Going Beyond Linear Transformers with Recurrent Fast Weight Programmers.

Kazuki Irie, Imanol Schlag, Róbert Csordás, Jürgen Schmidhuber

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Linear Transformers Are Secretly Fast Weight Programmers.

Imanol Schlag, Kazuki Irie, Jürgen Schmidhuber

Proceedings of the 38th International Conference on Machine Learning, 2021

Learning Associative Inference Using Fast Weight Memory.

Imanol Schlag, Tsendsuren Munkhdalai, Jürgen Schmidhuber

Proceedings of the 9th International Conference on Learning Representations, 2021

2019

Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving.

Imanol Schlag, Paul Smolensky, Roland Fernandez, Nebojsa Jojic, Jürgen Schmidhuber, Jianfeng Gao

CoRR, 2019

2018

Learning to Reason with Third Order Tensor Products.

Imanol Schlag, Jürgen Schmidhuber

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

2017

Ancient Roman Coin Recognition in the Wild Using Deep Learning Based Recognition of Artistically Depicted Face Profiles.

Imanol Schlag, Ognjen Arandjelovic

Proceedings of the 2017 IEEE International Conference on Computer Vision Workshops, 2017