Felix Hill

According to our database, Felix Hill authored at least 67 papers between 2012 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Why transformers are obviously good models of language.

Felix Hill

CoRR, 2024

Scaling Instructable Agents Across Many Simulated Worlds.

SIMA Team, Maria Abi Raad, Arun Ahuja, Catarina Barros, Frederic Besse, Andrew Bolt, Adrian Bolton, Bethanie Brownfield, Gavin Buttimore, Max Cant, Sarah Chakera, Stephanie C. Y. Chan, Jeff Clune, Adrian Collister, Vikki Copeman, Alex Cullum, Ishita Dasgupta, Dario de Cesare, Julia Di Trapani, Yani Donchev, Emma Dunleavy, Martin Engelcke, Ryan Faulkner, Frankie Garcia, Charles Gbadamosi, Zhitao Gong, Lucy Gonzalez, Kshitij Gupta, Karol Gregor, Arne Olav Hallingstad, Tim Harley, Sam Haves, Felix Hill, Ed Hirst, Drew A. Hudson, Jony Hudson, Steph Hughes-Fitt, Danilo J. Rezende, Mimi Jasarevic, Laura Kampis, Nan Rosemary Ke, Thomas Keck, Junkyung Kim, Oscar Knagg, Kavya Kopparapu, Andrew K. Lampinen, Shane Legg, Alexander Lerchner, Marjorie Limont, Yulan Liu, Maria Loks-Thompson, Joseph Marino, Kathryn Martin Cussons, Loic Matthey, Siobhan Mcloughlin, Piermaria Mendolicchio, Hamza Merzic, Anna Mitenkova, Alexandre Moufarek, Valéria Oliveira, Yanko Gitahy Oliveira, Hannah Openshaw, Renke Pan, Aneesh Pappu, Alex Platonov, Ollie Purkiss, David P. Reichert, John Reid, Pierre Harvey Richemond, Tyson Roberts, Giles Ruscoe, Jaume Sanchez Elias, Tasha Sandars, Daniel P. Sawyer, Tim Scholtes, Guy Simmons, Daniel Slater, Hubert Soyer, Heiko Strathmann, Peter Stys, Allison C. Tam, Denis Teplyashin, Tayfun Terzi, Davide Vercelli, Bojan Vujatovic, Marcus Wainwright, Jane X. Wang, Zhengdong Wang, Daan Wierstra, Duncan Williams, Nathaniel Wong, Sarah York, Nick Young

CoRR, 2024

What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation.

Aaditya K. Singh, Ted Moskovitz, Felix Hill, Stephanie C. Y. Chan, Andrew M. Saxe

Proceedings of the Forty-first International Conference on Machine Learning, 2024

SODA: Bottleneck Diffusion Models for Representation Learning.

Drew A. Hudson, Daniel Zoran, Mateusz Malinowski, Andrew K. Lampinen, Andrew Jaegle, James L. McClelland, Loic Matthey, Felix Hill, Alexander Lerchner

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

2023

Feature-Attending Recurrent Modules for Generalization in Reinforcement Learning.

Wilka Carvalho, Andrew Kyle Lampinen, Kyriacos Nikiforou, Felix Hill, Murray Shanahan

Trans. Mach. Learn. Res., 2023

Collaborating with language models for embodied reasoning.

Ishita Dasgupta, Christine Kaeser-Chen, Kenneth Marino, Arun Ahuja, Sheila Babayan, Felix Hill, Rob Fergus

CoRR, 2023

The Transient Nature of Emergent In-Context Learning in Transformers.

Aaditya K. Singh, Stephanie C. Y. Chan, Ted Moskovitz, Erin Grant, Andrew M. Saxe, Felix Hill

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

The Edge of Orthogonality: A Simple View of What Makes BYOL Tick.

Pierre Harvey Richemond, Allison C. Tam, Yunhao Tang, Florian Strub, Bilal Piot, Felix Hill

Proceedings of the International Conference on Machine Learning, 2023

SemPPL: Predicting Pseudo-Labels for Better Contrastive Representations.

Matko Bosnjak, Pierre Harvey Richemond, Nenad Tomasev, Florian Strub, Jacob C. Walker, Felix Hill, Lars Holger Buesing, Razvan Pascanu, Charles Blundell, Jovana Mitrovic

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Know your audience: specializing grounded language models with listener subtraction.

Aaditya K. Singh, David Ding, Andrew M. Saxe, Felix Hill, Andrew K. Lampinen

Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023

Vision-Language Models as Success Detectors.

Yuqing Du, Ksenia Konyushkova, Misha Denil, Akhil Raju, Jessica Landon, Felix Hill, Nando de Freitas, Serkan Cabi

Proceedings of the Conference on Lifelong Learning Agents, 2023

2022

Transformers generalize differently from information stored in context vs in weights.

Stephanie C. Y. Chan, Ishita Dasgupta, Junkyung Kim, Dharshan Kumaran, Andrew K. Lampinen, Felix Hill

CoRR, 2022

Meaning without reference in large language models.

Steven T. Piantadosi, Felix Hill

CoRR, 2022

Language models show human-like content effects on reasoning.

Ishita Dasgupta, Andrew K. Lampinen, Stephanie C. Y. Chan, Antonia Creswell, Dharshan Kumaran, James L. McClelland, Felix Hill

CoRR, 2022

Know your audience: specializing grounded language models with the game of Dixit.

Aaditya K. Singh, David Ding, Andrew M. Saxe, Felix Hill, Andrew K. Lampinen

CoRR, 2022

Semantic Exploration from Language Abstractions and Pretrained Representations.

Allison C. Tam, Neil C. Rabinowitz, Andrew K. Lampinen, Nicholas A. Roy, Stephanie C. Y. Chan, DJ Strouse, Jane Wang, Andrea Banino, Felix Hill

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Data Distributional Properties Drive Emergent In-Context Learning in Transformers.

Stephanie C. Y. Chan, Adam Santoro, Andrew K. Lampinen, Jane X. Wang, Aaditya K. Singh, Pierre H. Richemond, James L. McClelland, Felix Hill

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Tell me why! Explanations support learning relational and causal structure.

Andrew K. Lampinen, Nicholas A. Roy, Ishita Dasgupta, Stephanie C. Y. Chan, Allison C. Tam, James L. McClelland, Chen Yan, Adam Santoro, Neil C. Rabinowitz, Jane X. Wang, Felix Hill

Proceedings of the International Conference on Machine Learning, 2022

Can language models learn from explanations in context?

Andrew K. Lampinen, Ishita Dasgupta, Stephanie C. Y. Chan, Kory W. Mathewson, Michael Henry Tessler, Antonia Creswell, James L. McClelland, Jane Wang, Felix Hill

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Zipfian Environments for Reinforcement Learning.

Stephanie C. Y. Chan, Andrew Kyle Lampinen, Pierre Harvey Richemond, Felix Hill

Proceedings of the Conference on Lifelong Learning Agents, 2022

2021

Creating Multimodal Interactive Agents with Imitation and Self-Supervised Learning.

Josh Abramson, Arun Ahuja, Arthur Brussee, Federico Carnevale, Mary Cassin, Felix Fischer, Petko Georgiev, Alex Goldin, Tim Harley, Felix Hill, Peter Conway Humphreys, Alden Hung, Jessica Landon, Timothy P. Lillicrap, Hamza Merzic, Alistair Muldal, Adam Santoro, Guy Scully, Tamara von Glehn, Greg Wayne, Nathaniel Wong, Chen Yan, Rui Zhu

CoRR, 2021

BEAMetrics: A Benchmark for Language Generation Evaluation Evaluation.

Thomas Scialom, Felix Hill

CoRR, 2021

Multimodal Few-Shot Learning with Frozen Language Models.

Maria Tsimpoukelli, Jacob Menick, Serkan Cabi, S. M. Ali Eslami, Oriol Vinyals, Felix Hill

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Towards mental time travel: a hierarchical memory for reinforcement learning agents.

Andrew K. Lampinen, Stephanie C. Y. Chan, Andrea Banino, Felix Hill

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Attention over Learned Object Embeddings Enables Complex Visual Reasoning.

David Ding, Felix Hill, Adam Santoro, Malcolm Reynolds, Matt M. Botvinick

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Grounded Language Learning Fast and Slow.

Felix Hill, Olivier Tieleman, Tamara von Glehn, Nathaniel Wong, Hamza Merzic, Stephen Clark

Proceedings of the 9th International Conference on Learning Representations, 2021

2020

Object-based attention for spatio-temporal reasoning: Outperforming neuro-symbolic models with flexible distributed architectures.

David Ding, Felix Hill, Adam Santoro, Matt M. Botvinick

CoRR, 2020

Imitating Interactive Intelligence.

Josh Abramson, Arun Ahuja, Arthur Brussee, Federico Carnevale, Mary Cassin, Stephen Clark, Andrew Dudzik, Petko Georgiev, Aurelia Guy, Tim Harley, Felix Hill, Alden Hung, Zachary Kenton, Jessica Landon, Timothy P. Lillicrap, Kory W. Mathewson, Alistair Muldal, Adam Santoro, Nikolay Savinov, Vikrant Varma, Greg Wayne, Nathaniel Wong, Chen Yan, Rui Zhu

CoRR, 2020

Human Instruction-Following with Deep Reinforcement Learning via Transfer-Learning from Text.

Felix Hill, Sona Mokrá, Nathaniel Wong, Tim Harley

CoRR, 2020

Probing Emergent Semantics in Predictive Agents via Question Answering.

Abhishek Das, Federico Carnevale, Hamza Merzic, Laura Rimell, Rosalia Schneider, Josh Abramson, Alden Hung, Arun Ahuja, Stephen Clark, Greg Wayne, Felix Hill

Proceedings of the 37th International Conference on Machine Learning, 2020

Environmental drivers of systematicity and generalization in a situated agent.

Felix Hill, Andrew K. Lampinen, Rosalia Schneider, Stephen Clark, Matthew M. Botvinick, James L. McClelland, Adam Santoro

Proceedings of the 8th International Conference on Learning Representations, 2020

Simulating Early Word Learning in Situated Connectionist Agents.

Felix Hill, Stephen Clark, Phil Blunsom, Karl Moritz Hermann

Proceedings of the 42th Annual Meeting of the Cognitive Science Society, 2020

Cognitive consequences of structured education in a connectionist model of analogical reasoning.

David Barrett, Felix Hill, Adam Santoro, Jay McClelland

Proceedings of the 42th Annual Meeting of the Cognitive Science Society, 2020

2019

Extending Machine Language Models toward Human-Level Language Understanding.

James L. McClelland, Felix Hill, Maja Rudolph, Jason Baldridge, Hinrich Schütze

CoRR, 2019

Emergent Systematic Generalization in a Situated Agent.

Felix Hill, Andrew K. Lampinen, Rosalia Schneider, Stephen Clark, Matthew M. Botvinick, James L. McClelland, Adam Santoro

CoRR, 2019

Is coding a relevant metaphor for building AI? A commentary on "Is coding a relevant metaphor for the brain?", by Romain Brette.

Adam Santoro, Felix Hill, David G. T. Barrett, David Raposo, Matthew M. Botvinick, Timothy P. Lillicrap

CoRR, 2019

SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems.

Alex Wang, Yada Pruksachatkun, Nikita Nangia, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, Samuel R. Bowman

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Analysing Mathematical Reasoning Abilities of Neural Models.

David Saxton, Edward Grefenstette, Felix Hill, Pushmeet Kohli

Proceedings of the 7th International Conference on Learning Representations, 2019

Learning to Make Analogies by Contrasting Abstract Relational Structure.

Felix Hill, Adam Santoro, David G. T. Barrett, Ari S. Morcos, Timothy P. Lillicrap

Proceedings of the 7th International Conference on Learning Representations, 2019

Learning to Understand Goal Specifications by Modelling Reward.

Dzmitry Bahdanau, Felix Hill, Jan Leike, Edward Hughes, Seyed Arian Hosseini, Pushmeet Kohli, Edward Grefenstette

Proceedings of the 7th International Conference on Learning Representations, 2019

Higher-order Comparisons of Sentence Encoder Representations.

Mostafa Abdou, Artur Kulmizev, Felix Hill, Daniel M. Low, Anders Søgaard

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

2018

Generating Diverse Programs with Instruction Conditioned Reinforced Adversarial Learning.

Aishwarya Agrawal, Mateusz Malinowski, Felix Hill, S. M. Ali Eslami, Oriol Vinyals, Tejas Kulkarni

CoRR, 2018

Learning to Follow Language Instructions with Adversarial Reward Induction.

Dzmitry Bahdanau, Felix Hill, Jan Leike, Edward Hughes, Pushmeet Kohli, Edward Grefenstette

CoRR, 2018

Neural Arithmetic Logic Units.

Andrew Trask, Felix Hill, Scott E. Reed, Jack W. Rae, Chris Dyer, Phil Blunsom

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Measuring abstract reasoning in neural networks.

Adam Santoro, Felix Hill, David G. T. Barrett, Ari S. Morcos, Timothy P. Lillicrap

Proceedings of the 35th International Conference on Machine Learning, 2018

Jointly Learning "What" and "How" from Instructions and Goal-States.

Dzmitry Bahdanau, Felix Hill, Jan Leike, Edward Hughes, Pushmeet Kohli, Edward Grefenstette

Proceedings of the 6th International Conference on Learning Representations, 2018

GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding.

Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, Samuel R. Bowman

Proceedings of the Workshop: Analyzing and Interpreting Neural Networks for NLP, 2018

2017

The representational geometry of word meanings acquired by neural machine translation models.

Felix Hill, Kyunghyun Cho, Sébastien Jean, Yoshua Bengio

Mach. Transl., 2017

Understanding Grounded Language Learning Agents.

Felix Hill, Karl Moritz Hermann, Phil Blunsom, Stephen Clark

CoRR, 2017

Grounded Language Learning in a Simulated 3D World.

Karl Moritz Hermann, Felix Hill, Simon Green, Fumin Wang, Ryan Faulkner, Hubert Soyer, David Szepesvari, Wojciech Marian Czarnecki, Max Jaderberg, Denis Teplyashin, Marcus Wainwright, Chris Apps, Demis Hassabis, Phil Blunsom

CoRR, 2017

HyperLex: A Large-Scale Evaluation of Graded Lexical Entailment.

Ivan Vulic, Daniela Gerz, Douwe Kiela, Felix Hill, Anna Korhonen

Comput. Linguistics, 2017

2016

Learning to Understand Phrases by Embedding the Dictionary.

Felix Hill, KyungHyun Cho, Anna Korhonen, Yoshua Bengio

Trans. Assoc. Comput. Linguistics, 2016

The Goldilocks Principle: Reading Children's Books with Explicit Memory Representations.

Felix Hill, Antoine Bordes, Sumit Chopra, Jason Weston

Proceedings of the 4th International Conference on Learning Representations, 2016

Learning Distributed Representations of Sentences from Unlabelled Data.

Felix Hill, Kyunghyun Cho, Anna Korhonen

Proceedings of the NAACL HLT 2016, 2016

SimVerb-3500: A Large-Scale Evaluation Set of Verb Similarity.

Daniela Gerz, Ivan Vulic, Felix Hill, Roi Reichart, Anna Korhonen

Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016

2015

Embedding Word Similarity with Neural Machine Translation.

Felix Hill, Kyunghyun Cho, Sébastien Jean, Coline Devin, Yoshua Bengio

Proceedings of the 3rd International Conference on Learning Representations, 2015

SimLex-999: Evaluating Semantic Models With (Genuine) Similarity Estimation.

Felix Hill, Roi Reichart, Anna Korhonen

Comput. Linguistics, 2015

Specializing Word Embeddings for Similarity or Relatedness.

Douwe Kiela, Felix Hill, Stephen Clark

Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015

2014

Multi-Modal Models for Concrete and Abstract Concept Meaning.

Felix Hill, Roi Reichart, Anna Korhonen

Trans. Assoc. Comput. Linguistics, 2014

Not All Neural Embeddings are Born Equal.

Felix Hill, KyungHyun Cho, Sébastien Jean, Coline Devin, Yoshua Bengio

CoRR, 2014

A Quantitative Empirical Analysis of the Abstract/Concrete Distinction.

Felix Hill, Anna Korhonen, Christian Bentz

Cogn. Sci., 2014

Learning Abstract Concept Embeddings from Multi-Modal Data: Since You Probably Can't See What I Mean.

Felix Hill, Anna Korhonen

Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, 2014

Improving Multi-Modal Representations Using Image Dispersion: Why Less is Sometimes More.

Douwe Kiela, Felix Hill, Anna Korhonen, Stephen Clark

Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014

Concreteness and Subjectivity as Dimensions of Lexical Meaning.

Felix Hill, Anna Korhonen

Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014

2013

Large-Scale Empricial Analyses of the Abstract/Concrete Distinction.

Felix Hill, Anna Korhonen, Christian Bentz

Proceedings of the 35th Annual Meeting of the Cognitive Science Society, 2013

Concreteness and Corpora: A Theoretical and Practical Study.

Felix Hill, Douwe Kiela, Anna Korhonen

Proceedings of the Fourth Annual Workshop on Cognitive Modeling and Computational Linguistics, 2013

2012

Beauty Before Age? Applying Subjectivity to Automatic English Adjective Ordering.

Felix Hill

Proceedings of the Human Language Technologies: Conference of the North American Chapter of the Association of Computational Linguistics, 2012