Sharon L. Oviatt

Orcid: 0000-0003-4664-1412

Affiliations:
  • Monash University, Melbourne, VIC, Australia
  • Incaa Designs, Bainbridge Island, WA, USA (former)


According to our database1, Sharon L. Oviatt authored at least 117 papers between 1989 and 2022.

Collaborative distances:
  • Dijkstra number2 of four.
  • Erdős number3 of four.

Awards

ACM Fellow

ACM Fellow 2016, "For contributions to the empirical and theoretical foundations of multimodal systems, and to human-centered computer interfaces".

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Dataset
Other 

Links

Online presence:

On csauthors.net:

Bibliography

2022
A Critical Review of Multimodal-multisensor Analytics for Anxiety Assessment.
ACM Trans. Comput. Heal., 2022

Applied Affective Computing
ACM Books 41, ACM, ISBN: 978-1-4503-9593-9, 2022

2021
I Know What You Know: What Hand Movements Reveal about Domain Expertise.
ACM Trans. Interact. Intell. Syst., 2021

A Taxonomy of Social Errors in Human-Robot Interaction.
ACM Trans. Hum. Robot Interact., 2021

Therapist-Informed Design Directions for Mobile Assistive Technologies for Anxiety.
Proceedings of the Pervasive Computing Technologies for Healthcare, 2021

A Multimodal Dataset and Evaluation for Feature Estimators of Temporal Phases of Anxiety.
Proceedings of the ICMI '21: International Conference on Multimodal Interaction, 2021

Technology as Infrastructure for Dehumanization: : Three Hundred Million People with the Same Face.
Proceedings of the ICMI '21: International Conference on Multimodal Interaction, 2021

Advances in Multimodal Behavioral Analytics for Early Dementia Diagnosis: A Review.
Proceedings of the ICMI '21: International Conference on Multimodal Interaction, 2021

User Experience for Multi-Device Ecosystems: Challenges and Opportunities.
Proceedings of the CHI '21: CHI Conference on Human Factors in Computing Systems, 2021

2020
Conversational Search for Learning Technologies.
CoRR, 2020

Detecting and differentiating leg bouncing behaviour from everyday movements using tri-axial accelerometer data.
Proceedings of the UbiComp/ISWC '20: 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and 2020 ACM International Symposium on Wearable Computers, 2020

LSTM-DNN based Approach for Pain Intensity and Protective Behaviour Prediction.
Proceedings of the 15th IEEE International Conference on Automatic Face and Gesture Recognition, 2020

2019
Report of 2017 NSF Workshop on Multimedia Challenges, Opportunities and Research Roadmaps.
CoRR, 2019

Dynamic Adaptive Gesturing Predicts Domain Expertise in Mathematics.
Proceedings of the International Conference on Multimodal Interaction, 2019

An Explainable Deep Fusion Network for Affect Recognition Using Physiological Signals.
Proceedings of the 28th ACM International Conference on Information and Knowledge Management, 2019

Designing Efficacious Mobile Technologies for Anxiety Self-Regulation.
Proceedings of the Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, 2019

CHI 2019 Early Career Development Symposium.
Proceedings of the Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, 2019

2018
Dynamic Handwriting Signal Features Predict Domain Expertise.
ACM Trans. Interact. Intell. Syst., 2018

Ten Opportunities and Challenges for Advancing Student-Centered Multimodal Learning Analytics.
Proceedings of the 2018 on International Conference on Multimodal Interaction, 2018

Multimodal learning analytics: assessing learners' mental state during the process of learning.
Proceedings of the Handbook of Multimodal-Multisensor Interfaces: Foundations, User Modeling, and Common Modality Combinations, 2018

2017
Designing Speech, Acoustic and Multimodal Interactions.
Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2017

Theoretical foundations of multimodal interfaces and systems.
Proceedings of the Handbook of Multimodal-Multisensor Interfaces: Foundations, User Modeling, and Common Modality Combinations, 2017

Perspectives on learning with multimodal technology.
Proceedings of the Handbook of Multimodal-Multisensor Interfaces: Foundations, User Modeling, and Common Modality Combinations, 2017

Multimodal speech and pen interfaces.
Proceedings of the Handbook of Multimodal-Multisensor Interfaces: Foundations, User Modeling, and Common Modality Combinations, 2017

2016
Computer Interfaces Can Stimulate or Undermine Students' Ability to Think.
Proceedings of the Revolutionizing Education with Digital Ink, 2016

Multimodal learning analytics data challenges.
Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, 2016

Designing Speech and Multimodal Interactions for Mobile, Wearable, and Pervasive Applications.
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016

2015
The Paradigm Shift to Multimodality in Contemporary Computer Interfaces
Synthesis Lectures on Human-Centered Informatics, Morgan & Claypool Publishers, ISBN: 978-3-031-02213-5, 2015

Spoken Interruptions Signal Productive Problem Solving and Domain Expertise in Mathematics.
Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, Seattle, WA, USA, November 09, 2015

2014
Combining empirical and machine learning techniques to predict math expertise using pen signal features.
Proceedings of the 2014 ACM workshop on Multimodal Learning Analytics Workshop and Grand Challenge, 2014

Written Activity, Representations and Fluency as Predictors of Domain Expertise in Mathematics.
Proceedings of the 16th International Conference on Multimodal Interaction, 2014

Designing speech and language interactions.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2014

2013
3rd International workshop on intelligent user interfaces for developing regions: IUI4DR.
Proceedings of the 18th International Conference on Intelligent User Interfaces, 2013

Multimodal learning analytics: description of math data corpus for ICMI grand challenge workshop.
Proceedings of the 2013 International Conference on Multimodal Interaction, 2013

Written and multimodal representations as predictors of expertise and problem-solving success in mathematics.
Proceedings of the 2013 International Conference on Multimodal Interaction, 2013

Problem solving, domain expertise and learning: ground-truth performance results for math data corpus.
Proceedings of the 2013 International Conference on Multimodal Interaction, 2013

Interfaces for thinkers: computer input capabilities that support inferential reasoning.
Proceedings of the 2013 International Conference on Multimodal Interaction, 2013

ICMI 2013 grand challenge workshop on multimodal learning analytics.
Proceedings of the 2013 International Conference on Multimodal Interaction, 2013

We need to talk: HCI and the delicate topic of spoken language interaction.
Proceedings of the 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, 2013

2012
The impact of interface affordances on human ideation, problem solving, and inferential reasoning.
ACM Trans. Comput. Hum. Interact., 2012

Computer Input Capabilities that Stimulate Diagramming and Improved Inferential Reasoning in Low-performing Students.
Proceedings of the Future of Learning: Proceedings of the 10th International Conference of the Learning Sciences, 2012

2011
Designing Interfaces that Stimulate Ideational Fluency in Science.
Proceedings of the 33th Annual Meeting of the Cognitive Science Society, 2011

2009
Multimodal Interfaces: A Survey of Principles, Models and Frameworks.
Proceedings of the Human Machine Interaction, Research Results of the MMI Program, 2009

2008
A high-performance dual-wizard infrastructure for designing speech, pen, and multimodal interfaces.
Proceedings of the 10th International Conference on Multimodal Interfaces, 2008

Implicit user-adaptive system engagement in speech and pen interfaces.
Proceedings of the 2008 Conference on Human Factors in Computing Systems, 2008

2007
Expressive pen-based interfaces for math education.
Proceedings of the 7th Iternational Conference on Computer Supported Collaborative Learning, 2007

Implicit user-adaptive system engagement in speech, pen and multimodal interfaces.
Proceedings of the IEEE Workshop on Automatic Speech Recognition & Understanding, 2007

2006
Quiet interfaces that help students think.
Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology, 2006

Human-centered design meets cognitive load theory: designing interfaces that help people think.
Proceedings of the 14th ACM International Conference on Multimedia, 2006

Human-centered collaborative interaction.
Proceedings of the 1st ACM international workshop on Human-centered multimedia, 2006

Combining User Modeling and Machine Learning to Predict Users' Multimodal Integration Patterns.
Proceedings of the Machine Learning for Multimodal Interaction, 2006

Toward open-microphone engagement for multiparty interactions.
Proceedings of the 8th International Conference on Multimodal Interfaces, 2006

Human perception of intended addressee during computer-assisted meetings.
Proceedings of the 8th International Conference on Multimodal Interfaces, 2006

Prototyping novel collaborative multimodal systems: simulation, data collection and analysis tools for the next decade.
Proceedings of the 8th International Conference on Multimodal Interfaces, 2006

2005
Multimodal Interfaces for Cell Phones and Mobile Technology.
Int. J. Speech Technol., 2005

Just Do What I Tell You: The Limited Impact of Instructions on Multimodal Integration Patterns.
Proceedings of the User Modeling 2005, 2005

Toward Adaptive Information Fusion in Multimodal Systems.
Proceedings of the Machine Learning for Multimodal Interaction, 2005

Audio-visual cues distinguishing self- from system-directed speech in younger and older adults.
Proceedings of the 7th International Conference on Multimodal Interfaces, 2005

Individual differences in multimodal integration patterns: what are they and why do they exist?
Proceedings of the 2005 Conference on Human Factors in Computing Systems, 2005

2004
Introduction to mobile and adaptive conversational interfaces.
ACM Trans. Comput. Hum. Interact., 2004

Toward adaptive conversational interfaces: Modeling speech convergence with animated personas.
ACM Trans. Comput. Hum. Interact., 2004

Guidelines for multimodal user interface design.
Commun. ACM, 2004

Introduction.
Commun. ACM, 2004

When do we interact multimodally?: cognitive load and multimodal communication patterns.
Proceedings of the 6th International Conference on Multimodal Interfaces, 2004

Talking to Digital Fish.
Proceedings of the From Brows to Trust - Evaluating Embodied Conversational Agents, 2004

2003
Flexible and robust multimodal interfaces for universal access.
Univers. Access Inf. Soc., 2003

User-centered modeling and evaluation of multimodal interfaces.
Proc. IEEE, 2003

Advances in Robust Multimodal Interface Design.
IEEE Computer Graphics and Applications, 2003

Modeling multimodal integration patterns and performance in seniors: toward adaptive processing of individual differences.
Proceedings of the 5th International Conference on Multimodal Interfaces, 2003

Toward a theory of organized multimodal integration patterns during human-computer interaction.
Proceedings of the 5th International Conference on Multimodal Interfaces, 2003

Principles for mujltimodal user inteface desgin.
Proceedings of the Extended abstracts of the 2003 Conference on Human Factors in Computing Systems, 2003

2002
From members to teams to committee-a robust approach to gestural and multimodal recognition.
IEEE Trans. Neural Networks, 2002

Breaking the Robustness Barrier: Recent Progress on the Design of Robust Multimodal Systems.
Adv. Comput., 2002

Multimodal integration patterns in children.
Proceedings of the 7th International Conference on Spoken Language Processing, ICSLP2002, 2002

Adaptation of users² spoken dialogue patterns in a conversational interface.
Proceedings of the 7th International Conference on Spoken Language Processing, ICSLP2002, 2002

Amplitude convergence in children²s conversational speech with animated personas.
Proceedings of the 7th International Conference on Spoken Language Processing, ICSLP2002, 2002

2001
Designing robust multimodal systems for universal access.
Proceedings of the EC/NSF Workshop on Universal Accessibility of Ubiquitous Computing: Providing for the Elderly, 2001

Designing robust multimodal systems for diverse users and environments.
Proceedings of the Universal Access In HCI: Towards an Information Society for All, 2001

2000
Designing the User Interface for Multimodal Speech and Pen-Based Gesture Applications: State-of-the-Art Systems and Future Research Directions.
Hum. Comput. Interact., 2000

Multimodal Interfaces That Process What Comes Naturally.
Commun. ACM, 2000

Taming recognition errors with a multimodal interface.
Commun. ACM, 2000

Multimodal system processing in mobile environments.
Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology, 2000

Talking to thimble jellies: children²s conversational speech with animated characters.
Proceedings of the Sixth International Conference on Spoken Language Processing, 2000

Multimodal interface research: a science without borders.
Proceedings of the Sixth International Conference on Spoken Language Processing, 2000

Multimodal signal processing in naturalistic noisy environments.
Proceedings of the Sixth International Conference on Spoken Language Processing, 2000

1999
Multimodal Integration - A Statistical View.
IEEE Trans. Multim., 1999

Multimodal Interaction for 2D and 3D Environments.
IEEE Computer Graphics and Applications, 1999

Ten Myths of Multimodal Interaction.
Commun. ACM, 1999

Mutual Disambiguation of Recognition Errors in a Multimodel Architecture.
Proceedings of the Proceeding of the CHI '99 Conference on Human Factors in Computing Systems: The CHI is the Limit, 1999

Designing the user interface for pen and speech multimedia applications.
Proceedings of the CHI '99 Extended Abstracts on Human Factors in Computing Systems, 1999

1998
Predicting hyperarticulate speech during human-computer error resolution.
Speech Commun., 1998

Referential features and linguistic indirection in multimodal language.
Proceedings of the 5th International Conference on Spoken Language Processing, Incorporating The 7th Australian International Speech Science and Technology Conference, Sydney Convention Centre, Sydney, Australia, 30th November, 1998

The CHAM model of hyperarticulate adaptation during human-computer error resolution.
Proceedings of the 5th International Conference on Spoken Language Processing, Incorporating The 7th Australian International Speech Science and Technology Conference, Sydney Convention Centre, Sydney, Australia, 30th November, 1998

The efficiency of multimodal interaction: a case study.
Proceedings of the 5th International Conference on Spoken Language Processing, Incorporating The 7th Australian International Speech Science and Technology Conference, Sydney Convention Centre, Sydney, Australia, 30th November, 1998

STAMP: a suite of tools for analyzing multimodal system processing.
Proceedings of the 5th International Conference on Spoken Language Processing, Incorporating The 7th Australian International Speech Science and Technology Conference, Sydney Convention Centre, Sydney, Australia, 30th November, 1998

Confirmation in Multimodal Systems.
Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, 1998

1997
Introduction to This Special Issue on Multimodal Interfaces.
Hum. Comput. Interact., 1997

Mulitmodal Interactive Maps: Designing for Human Performance.
Hum. Comput. Interact., 1997

QuickSet: Multimodal Interaction for Distributed Applications.
Proceedings of the Fifth ACM International Conference on Multimedia '97, 1997

Integration and Synchronization of Input Modes during Multimodal Human-Computer Interaction.
Proceedings of the Human Factors in Computing Systems, 1997

QuickSet: Multimodal Interaction for Simulation Set-up and Control.
Proceedings of the 5th Applied Natural Language Processing Conference, 1997

Unification-based Multimodal Integration.
Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and 8th Conference of the European Chapter of the Association for Computational Linguistics, 1997

Mulitmodal Interaction for Distributed Interactive Simulation.
Proceedings of the Fourteenth National Conference on Artificial Intelligence and Ninth Innovative Applications of Artificial Intelligence Conference, 1997

1996
User-Centered Modeling for Spoken Language and Multimodal Interfaces.
IEEE Multim., 1996

Error resolution during multimodal human-computer interaction.
Proceedings of the 4th International Conference on Spoken Language Processing, 1996

Modeling hyperarticulate speech during human-computer error resolution.
Proceedings of the 4th International Conference on Spoken Language Processing, 1996

Multimodal Interfaces for Dynamic Interactive Maps.
Proceedings of the Conference on Human Factors in Computing Systems: Common Ground, 1996

1995
The challenge of spoken language systems: research directions for the nineties.
IEEE Trans. Speech Audio Process., 1995

Predicting spoken disfluencies during human-computer interaction.
Comput. Speech Lang., 1995

1994
Toward interface design for human language technology: Modality and structure as determinants of linguistic complexity.
Speech Communication, 1994

Predicting and Managing Spoken Disfluencies During Human-Computer Interaction.
Proceedings of the Human Language Technology, 1994

Integration themes in multimodal human-computer interaction.
Proceedings of the 3rd International Conference on Spoken Language Processing, 1994

Interface techniques for minimizing disfluent input to spoken language systems.
Proceedings of the Conference on Human Factors in Computing Systems, 1994

1993
A Simulation-Based Research Strategy for Designing Complex NL Systems.
Proceedings of the Human Language Technology: Proceedings of a Workshop Held at Plainsboro, 1993

1992
A rapid semi-automatic simulation technique for investigating interactive speech and handwriting.
Proceedings of the Second International Conference on Spoken Language Processing, 1992

1990
Spoken language in interpreted telephone dialogues.
Proceedings of the First International Conference on Spoken Language Processing, 1990

1989
The Effects of Interaction on Spoken Discourse.
Proceedings of the 27th Annual Meeting of the Association for Computational Linguistics, 1989


  Loading...