Francisco S. Melo

Orcid: 0000-0001-5705-7372

According to our database1, Francisco S. Melo authored at least 143 papers between 2006 and 2024.

Collaborative distances:
  • Dijkstra number2 of four.
  • Erdős number3 of four.

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Dataset
Other 

Links

Online presence:

On csauthors.net:

Bibliography

2024
The impact of data distribution on Q-learning with function approximation.
Mach. Learn., September, 2024

When a Robot Is Your Teammate.
Top. Cogn. Sci., July, 2024

The Number of Trials Matters in Infinite-Horizon General-Utility Markov Decision Processes.
CoRR, 2024

NeuralThink: Algorithm Synthesis that Extrapolates in General Tasks.
CoRR, 2024

"Guess what I'm doing": Extending legibility to sequential decision tasks.
Artif. Intell., 2024

Interactively Teaching an Inverse Reinforcement Learner with Limited Feedback.
Proceedings of the 16th International Conference on Agents and Artificial Intelligence, 2024

A Comparative Study of Continual Backpropagation.
Proceedings of the Progress in Artificial Intelligence, 2024

Centralized Training with Hybrid Execution in Multi-Agent Reinforcement Learning.
Proceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems, 2024

TEAMSTER: Model-Based Reinforcement Learning for Ad Hoc Teamwork (Abstract Reprint).
Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

2023
TEAMSTER: Model-based reinforcement learning for ad hoc teamwork.
Artif. Intell., November, 2023

Robotic Gaze Responsiveness in Multiparty Teamwork.
Int. J. Soc. Robotics, January, 2023

Multi-Bellman operator for convergence of Q-learning with linear function approximation.
CoRR, 2023

Pre-training with Augmentations for Efficient Transfer in Model-Based Reinforcement Learning.
Proceedings of the Progress in Artificial Intelligence, 2023

Making Friends in the Dark: Ad Hoc Teamwork Under Partial Observability.
Proceedings of the ECAI 2023 - 26th European Conference on Artificial Intelligence, September 30 - October 4, 2023, Kraków, Poland, 2023

Theoretical Remarks on Feudal Hierarchies and Reinforcement Learning.
Proceedings of the ECAI 2023 - 26th European Conference on Artificial Intelligence, September 30 - October 4, 2023, Kraków, Poland, 2023

Learning to Perceive in Deep Model-Free Reinforcement Learning.
Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems, 2023

2022
Leveraging hierarchy in multimodal generative models for effective cross-modality inference.
Neural Networks, 2022

Cooperation and Learning Dynamics under Wealth Inequality and Diversity in Individual Risk.
J. Artif. Intell. Res., 2022

"Sequencing Matters": Investigating Suitable Action Sequences in Robot-Assisted Autism Therapy.
Frontiers Robotics AI, 2022

GMC - Geometric Multimodal Contrastive Representation Learning.
CoRR, 2022

Learning Collective Action under Risk Diversity.
CoRR, 2022

Assisting Unknown Teammates in Unknown Tasks: Ad Hoc Teamwork under Partial Observability.
CoRR, 2022

Perceive, Represent, Generate: Translating Multimodal Information to Robotic Motion Trajectories.
Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 2022

Geometric Multimodal Contrastive Representation Learning.
Proceedings of the International Conference on Machine Learning, 2022

Socially Reactive Navigation Models for Mobile Robots.
Proceedings of the IEEE International Conference on Autonomous Robot Systems and Competitions, 2022

FIT: Using Feature Importance to Teach Classification Tasks to Unknown Learners.
Proceedings of the Progress in Artificial Intelligence, 2022

<i>How to Sense the World: </i> Leveraging Hierarchy in Multimodal Perception for Robust Reinforcement Learning Agents.
Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems, 2022

Cooperation and Learning Dynamics under Risk Diversity and Financial Incentives.
Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems, 2022

2021
A Game AI Competition to Foster Collaborative AI Research and Development.
IEEE Trans. Games, 2021

Teaching Multiple Inverse Reinforcement Learners.
Frontiers Artif. Intell., 2021

Understanding the Impact of Data Distribution on Q-learning with Function Approximation.
CoRR, 2021

How to Sense the World: Leveraging Hierarchy in Multimodal Perception for Robust Reinforcement Learning Agents.
CoRR, 2021

Limited depth bandit-based strategy for Monte Carlo planning in continuous action spaces.
CoRR, 2021

A Methodology for the Development of RL-Based Adaptive Traffic Signal Controllers.
CoRR, 2021

Understanding Robots: Making Robots More Legible in Multi-Party Interactions.
Proceedings of the 30th IEEE International Conference on Robot & Human Interactive Communication, 2021

Movement recognition and prediction using DMPs.
Proceedings of the IEEE International Conference on Robotics and Automation, 2021

Ad Hoc Teamwork in the Presence of Non-stationary Teammates.
Proceedings of the Progress in Artificial Intelligence, 2021

Helping People on the Fly: Ad Hoc Teamwork for Human-Robot Teams.
Proceedings of the Progress in Artificial Intelligence, 2021

Compound Movement Recognition Using Dynamic Movement Primitives.
Proceedings of the Progress in Artificial Intelligence, 2021

Exploiting Symmetry in Human Robot-Assisted Dressing Using Reinforcement Learning.
Proceedings of the Progress in Artificial Intelligence, 2021

Revisiting "Recurrent World Models Facilitate Policy Evolution".
Proceedings of the Progress in Artificial Intelligence, 2021

Cooperation between Independent Reinforcement Learners under Wealth Inequality and Collective Risks.
Proceedings of the AAMAS '21: 20th International Conference on Autonomous Agents and Multiagent Systems, 2021

Teaching Unknown Learners to Classify via Feature Importance.
Proceedings of the AAMAS '21: 20th International Conference on Autonomous Agents and Multiagent Systems, 2021

Interactive Teaching with Groups of Unknown Bayesian Learners.
Proceedings of the Artificial Intelligence in Education - 22nd International Conference, 2021

2020
MHVAE: a Human-Inspired Deep Hierarchical Generative Model for Multimodal Representation Learning.
CoRR, 2020

Optimal action sequence generation for assistive agents in fixed horizon tasks.
Auton. Agents Multi Agent Syst., 2020

Explainable Agency by Revealing Suboptimality in Child-Robot Learning Scenarios.
Proceedings of the Social Robotics - 12th International Conference, 2020

The Dark Side of Embodiment - Teaming Up With Robots VS Disembodied Agents.
Proceedings of the Robotics: Science and Systems XVI, 2020

Learning from Explanations and Demonstrations: A Pilot Study.
Proceedings of the 2nd Workshop on Interactive Natural Language Technology for Explainable Artificial Intelligence, 2020

A new convergent variant of Q-learning with linear function approximation.
Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

An End-to-end Approach for Learning and Generating Complex Robot Motions from Demonstration.
Proceedings of the 16th International Conference on Control, 2020

Playing Games in the Dark: An Approach for Cross-Modality Transfer in Reinforcement Learning.
Proceedings of the 19th International Conference on Autonomous Agents and Multiagent Systems, 2020

2019
Empathic Robot for Group Learning: A Field Study.
ACM Trans. Hum. Robot Interact., 2019

Interactive robots with model-based 'autism-like' behaviors.
Paladyn J. Behav. Robotics, 2019

Class Teaching for Inverse Reinforcement Learners.
CoRR, 2019

Project INSIDE: towards autonomous semi-unstructured human-robot social interaction in autism therapy.
Artif. Intell. Medicine, 2019

An ensemble inverse optimal control approach for robotic task learning and adaptation.
Auton. Robots, 2019

"I Choose... YOU!" Membership preferences in human-robot teams.
Auton. Robots, 2019

Walk the Talk! Exploring (Mis)Alignment of Words and Deeds by Robotic Teammates in a Public Goods Game.
Proceedings of the 28th IEEE International Conference on Robot and Human Interactive Communication, 2019

Learning Multimodal Representations for Sample-efficient Recognition of Human Actions.
Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2019

Group Intelligence on Social Robots.
Proceedings of the 14th ACM/IEEE International Conference on Human-Robot Interaction, 2019

Exploring Prosociality in Human-Robot Teams.
Proceedings of the 14th ACM/IEEE International Conference on Human-Robot Interaction, 2019

Multi-task Learning and Catastrophic Forgetting in Continual Reinforcement Learning.
Proceedings of the GCAI 2019. Proceedings of the 5th Global Conference on Artificial Intelligence, 2019

Solving Motion and Action Planning for a Cooperative Agent Problem Using Geometry Friends.
Proceedings of the Progress in Artificial Intelligence, 2019

Online Motion Concept Learning: A Novel Algorithm for Sample-Efficient Learning and Recognition of Human Actions.
Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems, 2019

Effects of Agents' Transparency on Teamwork.
Proceedings of the Explainable, Transparent Autonomous Agents and Multi-Agent Systems, 2019

For The Record - A Public Goods Game For Exploring Human-Robot Collaboration.
Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems, 2019

An Optimization Approach for Structured Agent-Based Provider/Receiver Tasks.
Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems, 2019

A Theoretical and Algorithmic Analysis of Configurable MDPs.
Proceedings of the Twenty-Ninth International Conference on Automated Planning and Scheduling, 2019

2018
A tutorial on machine learning for 
interactive pedagogical systems.
Int. J. Serious Games, 2018

Proceedings of the Workshop on Social Robots in Therapy: Focusing on Autonomy and Ethical Challenges.
CoRR, 2018

Flow adaptation in serious games for health.
Proceedings of the 6th IEEE International Conference on Serious Games and Applications for Health, 2018

Interactive Optimal Teaching with Unknown Learners.
Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, 2018

Towards Guidelines for Mental State Induction in First-Person Shooters.
Proceedings of the International Conference on Graphics and Interaction, 2018

Group-based Emotions in Teams of Humans and Robots.
Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, 2018

What if the World Were Different? Gradient-Based Exploration for New Optimal Policies.
Proceedings of the GCAI-2018, 2018

Exploring the Impact of Fault Justification in Human-Robot Trust.
Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems, 2018

2017
Autonomous Surveillance Robots: A Decision-Making Framework for Networked Muiltiagent Systems.
IEEE Robotics Autom. Mag., 2017

'Autistic Robots' for Embodied Emulation of Behaviors Typically Seen in Children with Different Autism Severities.
Proceedings of the Social Robotics - 9th International Conference, 2017

Groups of humans and robots: Understanding membership preferences and team formation.
Proceedings of the Robotics: Science and Systems XIII, 2017

Adaptive indirect control through communication in collaborative human-robot interaction.
Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2017

"Me and you together" movement impact in multi-user collaboration tasks.
Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2017

Learning and Teaching Biodiversity Through a Storyteller Robot.
Proceedings of the Interactive Storytelling, 2017

Data-driven generation of synthetic behavioral feature vectors modeling children with autism spectrum disorders.
Proceedings of the 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics, 2017

Online Learning for Conversational Agents.
Proceedings of the Progress in Artificial Intelligence, 2017

Simulating Behaviors of Children with Autism Spectrum Disorders Through Reversal of the Autism Diagnosis Process.
Proceedings of the Progress in Artificial Intelligence, 2017

Monte Carlo tree search experiments in hearthstone.
Proceedings of the IEEE Conference on Computational Intelligence and Games, 2017

A Conversational Agent Powered by Online Learning.
Proceedings of the 16th Conference on Autonomous Agents and MultiAgent Systems, 2017

A Social Robot as a Card Game Player.
Proceedings of the Thirteenth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE-17), 2017

Associate Latent Encodings in Learning from Demonstrations.
Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, 2017

2016
Ad hoc teamwork by learning teammates' task.
Auton. Agents Multi Agent Syst., 2016

Just follow the suit! Trust in human-robot interactions during card game playing.
Proceedings of the 25th IEEE International Symposium on Robot and Human Interactive Communication, 2016

An Interactive Tangram Game for Children with Autism.
Proceedings of the Intelligent Virtual Agents - 16th International Conference, 2016

Synthesizing Robotic Handwriting Motion by Learning from Human Demonstrations.
Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, 2016

Discovering Social Interaction Strategies for Robots from Restricted-Perception Wizard-of-Oz Studies.
Proceedings of the Eleventh ACM/IEEE International Conference on Human Robot Interation, 2016

Building a Social Robot as a Game Companion in a Card Game.
Proceedings of the Eleventh ACM/IEEE International Conference on Human Robot Interation, 2016

Adaptive Symbiotic Collaboration for Targeted Complex Manipulation Tasks.
Proceedings of the ECAI 2016 - 22nd European Conference on Artificial Intelligence, 29 August-2 September 2016, The Hague, The Netherlands, 2016

Rapidly-Exploring Random Tree approach for Geometry Friends.
Proceedings of the First Joint International Conference of Digital Games Research Association and Foundation of Digital Games, 2016

Dynamics of Fairness in Groups of Autonomous Learning Agents.
Proceedings of the Autonomous Agents and Multiagent Systems - AAMAS 2016 Workshops, - Best Papers, 2016

Learning to be Fair in Multiplayer Ultimatum Games: (Extended Abstract).
Proceedings of the 2016 International Conference on Autonomous Agents & Multiagent Systems, 2016

Me and You Together: A Study on Collaboration in Manipulation Tasks.
Proceedings of the 2016 AAAI Fall Symposia, Arlington, Virginia, USA, November 17-19, 2016, 2016

2015
Emergence of emotional appraisal signals in reinforcement learning agents.
Auton. Agents Multi Agent Syst., 2015

Personalized Assistance for Dressing Users.
Proceedings of the Social Robotics - 7th International Conference, 2015

An Empathic Robotic Tutor for School Classrooms: Considering Expectation and Satisfaction of Children as End-Users.
Proceedings of the Social Robotics - 7th International Conference, 2015

Towards table tennis with a quadrotor autonomous learning robot and onboard vision.
Proceedings of the 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2015

The development of cooperation in evolving populations through social importance.
Proceedings of the 2015 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics, 2015

"Let's save resources!": A dynamic, collaborative AI for a multiplayer environmental awareness game.
Proceedings of the 2015 IEEE Conference on Computational Intelligence and Games, 2015

A reinforcement learning approach for the circle agent of geometry friends.
Proceedings of the 2015 IEEE Conference on Computational Intelligence and Games, 2015

The geometry friends game AI competition.
Proceedings of the 2015 IEEE Conference on Computational Intelligence and Games, 2015

The "Favors Game": A Framework to Study the Emergence of Cooperation through Social Importance.
Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems, 2015

Modeling Students Self-Studies Behaviors.
Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems, 2015

"It's Amazing, We Are All Feeling It!" - Emotional Climate as a Group-Level Emotional Expression in HRI.
Proceedings of the 2015 AAAI Fall Symposia, Arlington, Virginia, USA, November 12-14, 2015, 2015

2014
Learning by appraising: an emotion-based approach to intrinsic reward design.
Adapt. Behav., 2014

The influence of social display in competitive multiagent learning.
Proceedings of the 4th International Conference on Development and Learning and on Epigenetic Robotics, 2014

A testbed for autonomous robot surveillance.
Proceedings of the International conference on Autonomous Agents and Multi-Agent Systems, 2014

2013
Multi-class Generalized Binary Search for Active Inverse Reinforcement Learning
CoRR, 2013

An Associative State-Space Metric for Learning in Factored MDPs.
Proceedings of the Progress in Artificial Intelligence, 2013

Towards agents with human-like decisions under uncertainty.
Proceedings of the 35th Annual Meeting of the Cognitive Science Society, 2013

A Flexible Approach to Modeling Unpredictable Events in MDPs.
Proceedings of the Twenty-Third International Conference on Automated Planning and Scheduling, 2013

2011
Decentralized MDPs with sparse interactions.
Artif. Intell., 2011

Emerging social awareness: Exploring intrinsic motivation in multiagent learning.
Proceedings of the 1st International Conference on Development and Learning and on Epigenetic Robotics, 2011

QueryPOMDP: POMDP-Based Communication in Multiagent Systems.
Proceedings of the Multi-Agent Systems - 9th European Workshop, 2011

Emotion-Based Intrinsic Motivation for Reinforcement Learning Agents.
Proceedings of the Affective Computing and Intelligent Interaction, 2011

Differential Eligibility Vectors for Advantage Updating and Gradient Methods.
Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence, 2011

2010
Abstraction Levels for Robotic Imitation: Overview and Computational Approaches.
Proceedings of the From Motor Learning to Interaction Learning in Robots, 2010

Coordinated learning in multiagent MDPs with infinite state-space.
Auton. Agents Multi Agent Syst., 2010

Learning from Demonstration Using MDP Induced Metrics.
Proceedings of the Machine Learning and Knowledge Discovery in Databases, 2010

Analysis of Inverse Reinforcement Learning with Perturbed Demonstrations.
Proceedings of the ECAI 2010, 2010

Heuristic Planning for Decentralized MDPs with Sparse Interactions.
Proceedings of the Distributed Autonomous Robotic Systems, 2010

Approximate planning for decentralized MDPs with sparse interactions.
Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2010), 2010

2009
A Computational Model of Social-Learning Mechanisms.
Adapt. Behav., 2009

Active Learning for Reward Estimation in Inverse Reinforcement Learning.
Proceedings of the Machine Learning and Knowledge Discovery in Databases, 2009

Learning of coordination: exploiting sparse interactions in multiagent systems.
Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2009), 2009

2008
Fitted Natural Actor-Critic: A New Algorithm for Continuous State-Action MDPs.
Proceedings of the Machine Learning and Knowledge Discovery in Databases, 2008

Reinforcement learning with function approximation for cooperative navigation tasks.
Proceedings of the 2008 IEEE International Conference on Robotics and Automation, 2008

An analysis of reinforcement learning with function approximation.
Proceedings of the Machine Learning, 2008

Exploiting locality of interactions using a policy-gradient approach in multiagent learning.
Proceedings of the ECAI 2008, 2008

Interaction-driven Markov games for decentralized multiagent planning under uncertainty.
Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS 2008), 2008

Emerging coordination in infinite team Markov games.
Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS 2008), 2008

2007
Affordance-based imitation learning in robots.
Proceedings of the 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, October 29, 2007

Convergence of Independent Adaptive Learners.
Proceedings of the Progress in Artificial Intelligence, 2007

<i>Q</i> -Learning with Linear Function Approximation.
Proceedings of the Learning Theory, 20th Annual Conference on Learning Theory, 2007

2006
Transition Entropy in Partially Observable Markov Decision Processes.
Proceedings of the Intelligent Autonomous Systems 9, 2006


  Loading...