Lucy Cheke

According to our database, Lucy Cheke authored at least 11 papers between 2017 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

A little less conversation, a little more action, please: Investigating the physical common-sense of LLMs in a 3D embodied environment.

Matteo G. Mecattaf, Ben Slater, Marko Tesic, Jonathan Prunty, Konstantinos Voudouris, Lucy G. Cheke

CoRR, 2024

Leaving the barn door open for Clever Hans: Simple features predict LLM benchmark answers.

Lorenzo Pacchiardi, Marko Tesic, Lucy G. Cheke, José Hernández-Orallo

CoRR, 2024

100 instances is all you need: predicting the success of a new LLM on unseen data by testing on a few instances.

Lorenzo Pacchiardi, Lucy G. Cheke, José Hernández-Orallo

CoRR, 2024

2023

Animal-AI 3: What's New & Why You Should Care.

Konstantinos Voudouris, Ibrahim Alhas, Wout Schellaert, Matthew Crosby, Joel Holmes, John Burden, Niharika Chaubey, Niall Donnelly, Matishalin Patel, Marta Halina, José Hernández-Orallo, Lucy G. Cheke

CoRR, 2023

Predictable Artificial Intelligence.

Lexin Zhou, Pablo Antonio Moreno Casares, Fernando Martínez-Plumed, John Burden, Ryan Burnell, Lucy Cheke, Cèsar Ferri, Alexandru Marcoci, Behzad Mehrbakhsh, Yael Moros-Daval, Seán Ó hÉigeartaigh, Danaja Rutar, Wout Schellaert, Konstantinos Voudouris, José Hernández-Orallo

CoRR, 2023

Inferring Capabilities from Task Performance with Bayesian Triangulation.

John Burden, Konstantinos Voudouris, Ryan Burnell, Danaja Rutar, Lucy Cheke, José Hernández-Orallo

CoRR, 2023

2022

Evaluating Object Permanence in Embodied Agents using the Animal-AI Environment.

Konstantinos Voudouris, Niall Donnelly, Danaja Rutar, Ryan Burnell, John Burden, José Hernández-Orallo, Lucy Cheke

Proceedings of the Workshop on AI Evaluation Beyond Metrics co-located with the 31st International Joint Conference on Artificial Intelligence (IJCAI-ECAI 2022), 2022

Not a Number: Identifying Instance Features for Capability-Oriented Evaluation.

Ryan Burnell, John Burden, Danaja Rutar, Konstantinos Voudouris, Lucy Cheke, José Hernández-Orallo

Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, 2022

2019

The Animal-AI Environment: Training and Testing Animal-Like Artificial Cognition.

Benjamin Beyret, José Hernández-Orallo, Lucy Cheke, Marta Halina, Murray Shanahan, Matthew Crosby

CoRR, 2019

The Animal-AI Testbed and Competition.

Matthew Crosby, Benjamin Beyret, Murray Shanahan, José Hernández-Orallo, Lucy Cheke, Marta Halina

Proceedings of the NeurIPS 2019 Competition and Demonstration Track, 2019

2017

Mapping Intelligence: Requirements and Possibilities.

Sankalp Bhatnagar, Anna Alexandrova, Shahar Avin, Stephen Cave, Lucy Cheke, Matthew Crosby, Jan Feyereisl, Marta Halina, Bao Sheng Loe, Seán Ó hÉigeartaigh, Fernando Martínez-Plumed, Huw Price, Henry Shevlin, Adrian Weller, Alan F. T. Winfield, José Hernández-Orallo

Proceedings of the Philosophy and Theory of Artificial Intelligence 2017, 2017