Nikhil Krishnaswamy

Proceedings of the Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management, 2024

Multimodal Design for Interactive Collaborative Problem-Solving Support.

[BibT_eX]

[DOI]

Proceedings of the Human Interface and the Management of Information, 2024

Learning Foreign Language Vocabulary Through Task-Based Virtual Reality Immersion.

[BibT_eX]

[DOI]

Proceedings of the HCI International 2024 Posters, 2024

Combating Spatial Disorientation in a Dynamic Self-Stabilization Task Using AI Assistants.

[BibT_eX]

[DOI]

Sheikh Abdul Mannan

Paige Hansen

Vivekanand Pandey Vimal

Hannah N. Davies

Paul DiZio

Proceedings of the 12th International Conference on Human-Agent Interaction, 2024

"Any Other Thoughts, Hedgehog?" Linking Deliberation Chains in Collaborative Dialogues.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

Large Language Models Are Challenged by Habitat-Centered Reasoning.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

Propositional Extraction from Natural Speech in Small Group Collaborative Tasks.

[BibT_eX]

[DOI]

Proceedings of the 17th International Conference on Educational Data Mining, 2024

Multimodal Cross-Document Event Coreference Resolution Using Linear Semantic Transfer and Mixed-Modality Ensembles.

[BibT_eX]

[DOI]

Huma Jamil

Proceedings of the 2024 Joint International Conference on Computational Linguistics, 2024

Cross-Lingual Transfer Robustness to Lower-Resource Languages on Adversarial Datasets.

[BibT_eX]

[DOI]

Shadi Manafi

Proceedings of the 2024 Joint International Conference on Computational Linguistics, 2024

Common Ground Tracking in Multimodal Dialogue.

[BibT_eX]

[DOI]

Ibrahim Khalil Khebour

Proceedings of the 2024 Joint International Conference on Computational Linguistics, 2024

Embodying Human-Like Modes of Balance Control Through Human-In-the-Loop Dyadic Learning.

[BibT_eX]

[DOI]

Sheikh Mannan

Vivekanand Pandey Vimal

Paul DiZio

Proceedings of the AAAI 2024 Spring Symposium Series, 2024

Exploring Failure Cases in Multimodal Reasoning About Physical Dynamics.

[BibT_eX]

[DOI]

Proceedings of the AAAI 2024 Spring Symposium Series, 2024

2023

Grounding human-object interaction to affordance behavior in multimodal datasets.

[BibT_eX]

[DOI]

Frontiers Artif. Intell., February, 2023

How Good is the Model in Model-in-the-loop Event Coreference Resolution Annotation?

[BibT_eX]

[DOI]

CoRR, 2023

How Good is Automatic Segmentation as a Multimodal Discourse Annotation Aid?

[BibT_eX]

[DOI]

CoRR, 2023

Grounding and Distinguishing Conceptual Vocabulary Through Similarity Learning in Embodied Simulations.

[BibT_eX]

[DOI]

CoRR, 2023

An Abstract Specification of VoxML as an Annotation Language.

[BibT_eX]

[DOI]

Kiyong Lee

CoRR, 2023

2*n is better than n<sup>2</sup>: Decomposing Event Coreference Resolution into Two Tractable Problems.

[BibT_eX]

[DOI]

James H. Martin

CoRR, 2023

A Methodology for Evaluating Multimodal Referring Expression Generation for Embodied Virtual Agents.

[BibT_eX]

[DOI]

Nada Alalyani

Proceedings of the International Conference on Multimodal Interaction, 2023

Robust Motion Recognition Using Gesture Phase Annotation.

[BibT_eX]

[DOI]

Hannah VanderHoeven

Nathaniel Blanchard

Proceedings of the Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management, 2023

Intentional Microgesture Recognition for Extended Human-Computer Interaction.

[BibT_eX]

[DOI]

Proceedings of the Human-Computer Interaction, 2023

Automatic Detection of Collaborative States in Small Groups Using Multimodal Features.

[BibT_eX]

[DOI]

Proceedings of the Artificial Intelligence in Education - 24th International Conference, 2023

AxomiyaBERTa: A Phonologically-aware Transformer Model for Assamese.

[BibT_eX]

[DOI]

Sheikh Mannan

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

2*n is better than n²: Decomposing Event Coreference Resolution into Two Tractable Problems.

[BibT_eX]

[DOI]

James H. Martin

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

Hybrid Machine Learning/Knowledge Base Systems Learning through Natural Language Dialogue with Deep Learning Models.

[BibT_eX]

[DOI]

Sergei Nirenburg

Marjorie McShane

Proceedings of the AAAI 2023 Spring Symposium on Challenges Requiring the Combination of Machine Learning and Knowledge Engineering (AAAI-MAKE 2023), 2023

2022

Affordance embeddings for situated language understanding.

[BibT_eX]

[DOI]

Frontiers Artif. Intell., 2022

Detecting and Accommodating Novel Types and Concepts in an Embodied Simulation Environment.

[BibT_eX]

[DOI]

CoRR, 2022

The VoxWorld Platform for Multimodal Embodied Agents.

[BibT_eX]

[DOI]

Proceedings of the Thirteenth Language Resources and Evaluation Conference, 2022

Multimodal Semantics for Affordances and Actions.

[BibT_eX]

[DOI]

Proceedings of the Human-Computer Interaction. Theoretical Approaches and Design Methods, 2022

A deep dive into microphone hardware for recording collaborative group work.

[BibT_eX]

[DOI]

Proceedings of the 15th International Conference on Educational Data Mining, 2022

A Generalized Method for Automated Multilingual Loanword Detection.

[BibT_eX]

[DOI]

Sina Mahdipour Saravani

Proceedings of the 29th International Conference on Computational Linguistics, 2022

Exploiting Embodied Simulation to Detect Novel Object Classes Through Interaction.

[BibT_eX]

[DOI]

Proceedings of the 44th Annual Meeting of the Cognitive Science Society, 2022

2021

Embodied Human Computer Interaction.

[BibT_eX]

[DOI]

Künstliche Intell., 2021

The Role of Embodiment and Simulation in Evaluating HCI: Theory and Framework.

[BibT_eX]

[DOI]

Proceedings of the Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. Human Body, Motion and Behavior, 2021

The Role of Embodiment and Simulation in Evaluating HCI: Experiments and Evaluation.

[BibT_eX]

[DOI]

Proceedings of the Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. Human Body, Motion and Behavior, 2021

2020

Neurosymbolic AI for Situated Language Understanding.

[BibT_eX]

[DOI]

CoRR, 2020

Situated Multimodal Control of a Mobile Robot: Navigation through a Virtual Environment.

[BibT_eX]

[DOI]

CoRR, 2020

A Formal Analysis of Multimodal Referring Strategies Under Common Ground.

[BibT_eX]

[DOI]

Proceedings of The 12th Language Resources and Evaluation Conference, 2020

Embodied Human-Computer Interactions through Situated Grounding.

[BibT_eX]

[DOI]

Proceedings of the IVA '20: ACM International Conference on Intelligent Virtual Agents, 2020

Jarvis: A Multimodal Visualization Tool for Bioinformatic Data.

[BibT_eX]

[DOI]

Proceedings of the HCI International 2020 - Late Breaking Papers: Interaction, Knowledge and Social Media, 2020

Situational Awareness in Human Computer Interaction: Diana's World.

[BibT_eX]

[DOI]

David G. McNeely-White

Heting Wang

Francisco R. Ortega

Proceedings of the 30th International Conference on Artificial Reality and Telexistence, 2020

Diana's World: A Situated Multimodal Interactive Agent.

[BibT_eX]

[DOI]

David G. McNeely-White

Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence, 2020

2019

Multimodal Continuation-style Architectures for Human-Robot Interaction.

[BibT_eX]

[DOI]

CoRR, 2019

Situational Grounding within Multimodal Simulations.

[BibT_eX]

[DOI]

CoRR, 2019

Situated Grounding Facilitates Multimodal Concept Learning for AI.

[BibT_eX]

[DOI]

Proceedings of the Visually Grounded Interaction and Language (ViGIL), 2019

Generating a Novel Dataset of Multimodal Referring Expressions.

[BibT_eX]

[DOI]

Proceedings of the 13th International Conference on Computational Semantics, 2019

Combining Deep Learning and Qualitative Spatial Reasoning to Learn Complex Structures from Sparse Examples with Noise.

[BibT_eX]

[DOI]

Scott Friedman

Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, 2019

2018

Multimodal Interactive Learning of Primitive Actions.

[BibT_eX]

[DOI]

CoRR, 2018

Deictic Adaptation in a Virtual Environment.

[BibT_eX]

[DOI]

Proceedings of the Spatial Cognition XI, 2018

An Evaluation Framework for Multimodal Interaction.

[BibT_eX]

[DOI]

Proceedings of the Eleventh International Conference on Language Resources and Evaluation, 2018

Cooperating with Avatars Through Gesture, Language and Action.

[BibT_eX]

[DOI]

Proceedings of the Intelligent Systems and Applications, 2018

Every Object Tells a Story.

[BibT_eX]

[DOI]

Proceedings of the Workshop Events and Stories in the News, 2018

Teaching Virtual Agents to Perform Complex Spatial-Temporal Activities.

[BibT_eX]

[DOI]

Tuan Do

Proceedings of the 2018 AAAI Spring Symposia, 2018

2017

Communicating and Acting: Understanding Gesture in Simulation Semantics.

[BibT_eX]

[DOI]

Proceedings of the IWCS 2017 - 12th International Conference on Computational Semantics - Short papers, Montpellier, France, September 19, 2017

2016

ECAT: Event Capture Annotation Tool.

[BibT_eX]

[DOI]

Tuan Do

CoRR, 2016

Multimodal Semantic Simulations of Linguistically Underspecified Motion Events.

[BibT_eX]

[DOI]

Proceedings of the Spatial Cognition X, 2016

VoxML: A Visualization Modeling Language.

[BibT_eX]

[DOI]

Proceedings of the Tenth International Conference on Language Resources and Evaluation LREC 2016, 2016

VoxSim: A Visual Platform for Modeling Motion Language.

[BibT_eX]

[DOI]

Proceedings of the COLING 2016, 2016

Visualizing Events: Simulating Meaning in Language.

[BibT_eX]

[DOI]

Proceedings of the 38th Annual Meeting of the Cognitive Science Society, 2016

2014

Generating Simulations of Motion Events from Verbal Descriptions.

[BibT_eX]

[DOI]