2022
One Agent To Rule Them All: Towards Multi-agent Conversational AI.
Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, 2022
2021
Overview of the Eighth Dialog System Technology Challenge: DSTC8.
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
IEEE ACM Trans. Audio Speech Lang. Process., 2021
Human-in-the-loop Pose Estimation via Shared Autonomy.
Proceedings of the IUI '21: 26th International Conference on Intelligent User Interfaces, 2021
Think-Aloud Computing: Supporting Rich and Low-Effort Knowledge Capture.
Proceedings of the CHI '21: CHI Conference on Human Factors in Computing Systems, 2021
2020
FourEyes: Leveraging Tool Diversity as a Means to Improve Aggregate Accuracy in Crowdsourcing.
ACM Trans. Interact. Intell. Syst., 2020
Workshop on AI fairness for people with disabilities.
ACM SIGACCESS Access. Comput., 2020
C-Reference: Improving 2D to 3D Object Pose Estimation Accuracy via Crowdsourced Joint Object Estimation.
Proc. ACM Hum. Comput. Interact., 2020
Towards Supporting Programming Education at Scale via Live Streaming.
Proc. ACM Hum. Comput. Interact., 2020
Towards Hybrid Human-AI Workflows for Unknown Unknown Detection.
Proceedings of the WWW '20: The Web Conference 2020, Taipei, Taiwan, April 20-24, 2020, 2020
EdCode: Towards Personalized Support at Scale for Remote Assistance in CS Education.
Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing, 2020
Bashon: A Hybrid Crowd-Machine Workflow for Shell Command Synthesis.
Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing, 2020
Sifter: A Hybrid Workflow for Theme-based Video Curation at Scale.
Proceedings of the ACM International Conference on Interactive Media Experiences. IMX 2020, 2020
Using affordances to improve AI support of social media posting decisions.
Proceedings of the IUI '20: 25th International Conference on Intelligent User Interfaces, 2020
A Novel Workflow for Accurately and Efficiently Crowdsourcing Predicate Senses and Argument Labels.
Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020
Artificial Intelligence for HCI: A Modern Approach.
Proceedings of the Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 2020
An Experimental Study of Bias in Platform Worker Ratings: The Role of Performance Quality and Gender.
Proceedings of the CHI '20: CHI Conference on Human Factors in Computing Systems, 2020
Crowdsourced Detection of Emotionally Manipulative Language.
Proceedings of the CHI '20: CHI Conference on Human Factors in Computing Systems, 2020
Improving Crowd-Supported GUI Testing with Structural Guidance.
Proceedings of the CHI '20: CHI Conference on Human Factors in Computing Systems, 2020
Yesterday's Reward is Today's Punishment: Contrast Effects in Human Feedback to Reinforcement Learning Agents.
Proceedings of the 19th International Conference on Autonomous Agents and Multiagent Systems, 2020
2019
Efficient Elicitation Approaches to Estimate Collective Crowd Answers.
Proc. ACM Hum. Comput. Interact., 2019
The Eighth Dialog System Technology Challenge.
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
CoRR, 2019
A Case for Backward Compatibility for Human-AI Teams.
CoRR, 2019
Dialog System Technology Challenge 7.
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
CoRR, 2019
Towards Universal Evaluation of Image Annotation Interfaces.
Proceedings of the Adjunct Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, 2019
Towards Instantaneous Recovery from Autonomous System Failures via Predictive Crowdsourcing.
Proceedings of the Adjunct Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, 2019
A Study on Interaction in Human-in-the-Loop Machine Learning for Text Analytics.
Proceedings of the Joint Proceedings of the ACM IUI 2019 Workshops co-located with the 24th ACM Conference on Intelligent User Interfaces (ACM IUI 2019), 2019
Popup: reconstructing 3D video using particle filtering to aggregate crowd responses.
Proceedings of the 24th International Conference on Intelligent User Interfaces, 2019
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance.
Proceedings of the Seventh AAAI Conference on Human Computation and Crowdsourcing, 2019
CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databases.
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019
Identifying Challenges and Opportunities in Human-AI Collaboration in Healthcare.
Proceedings of the Companion Publication of the 2019 ACM Conference on Computer Supported Cooperative Work and Social Computing, 2019
Opportunities for In-Home Augmented Reality Guidance.
Proceedings of the Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, 2019
The Effect of Social Interaction on Facilitating Audience Participation in a Live Music Performance.
Proceedings of the 2019 ACM SIGCHI Conference on Creativity and Cognition, 2019
HEIDL: Learning Linguistic Expressions with Deep Learning and Human-in-the-Loop.
Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019
A Large-Scale Corpus for Conversation Disentanglement.
Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff.
Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, 2019
2018
Creating Better Action Plans for Writing Tasks via Vocabulary-Based Planning.
Proc. ACM Hum. Comput. Interact., 2018
Exploring Real-Time Collaboration in Crowd-Powered Systems Through a UI Design Tool.
Proc. ACM Hum. Comput. Interact., 2018
Analyzing Assumptions in Conversation Disentanglement Research Through the Lens of a New Dataset and Model.
CoRR, 2018
Expresso: Building Responsive Interfaces with Keyframes.
Proceedings of the 2018 IEEE Symposium on Visual Languages and Human-Centric Computing, 2018
Arboretum and Arbility: Improving Web Accessibility Through a Shared Browsing Architecture.
Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, 2018
Effective Crowdsourcing for a New Type of Summarization Task.
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018
Two Tools are Better Than One: Tool Diversity as a Means of Improving Aggregate Crowd Performance.
Proceedings of the 23rd International Conference on Intelligent User Interfaces, 2018
Plexiglass: Multiplexing Passive and Active Tasks for More Efficient Crowdsourcing.
Proceedings of the Sixth AAAI Conference on Human Computation and Crowdsourcing, 2018
EURECA: Enhanced Understanding of Real Environments via Crowd Assistance.
Proceedings of the Sixth AAAI Conference on Human Computation and Crowdsourcing, 2018
Accessible Voice Interfaces.
Proceedings of the Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing, 2018
Enhancing Online Problems Through Instructor-Centered Tools for Randomized Experiments.
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 2018
Bolt: Instantaneous Crowdsourcing via Just-in-Time Training.
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 2018
Using Vocabularies to Collaboratively Create Better Plans for Writing Tasks.
Proceedings of the Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, 2018
Oh The Places You'll Share: An Affordances-Based Model of Social Media Posting Behaviors.
Proceedings of the Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, 2018
Towards More Robust Speech Interactions for Deaf and Hard of Hearing Users.
Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility, 2018
2017
Scribe: deep integration of human and machine intelligence to caption speech in real time.
Commun. ACM, 2017
WearMail: On-the-Go Access to Information in Your Email with a Privacy-Preserving Human Computation Workflow.
Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, 2017
SketchExpress: Remixing Animations for More Effective Crowd-Powered Prototyping of Interactive Interfaces.
Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, 2017
CrowdMask: Using Crowds to Preserve Privacy in Crowd-Powered Systems via Progressive Filtering.
Proceedings of the Fifth AAAI Conference on Human Computation and Crowdsourcing, 2017
Kurator: Using The Crowd to Help Families With Personal Curation Tasks.
Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, 2017
Connecting Instructors and Learning Scientists via Collaborative Dynamic Experimentation.
Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2017
Exploring Coordination Models for Ad Hoc Programming Teams.
Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2017
Codeon: On-Demand Software Development Assistance.
Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2017
Crowdsourcing and Crowd Work.
Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2017
Understanding Task Design Trade-offs in Crowdsourced Paraphrase Collection.
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, 2017
2016
Creating Interactive Behaviors in Early Sketch by Recording and Remixing Crowd Demonstrations.
CoRR, 2016
The effects of automatic speech recognition quality on human transcription latency.
Proceedings of the 13th Web for All Conference, 2016
AXIS: Generating Explanations at Scale with Learnersourcing and Machine Learning.
Proceedings of the Third ACM Conference on Learning @ Scale, 2016
"Is There Anything Else I Can Help You With?" Challenges in Deploying an On-Demand Crowd-Powered Conversational Agent.
Proceedings of the Fourth AAAI Conference on Human Computation and Crowdsourcing, 2016
Coding Varied Behavior Types Using the Crowd.
Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing, 2016
Towards Providing On-Demand Expert Support for Software Developers.
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016
2015
Target Acquisition and the Crowd Actor.
Hum. Comput., 2015
Measuring text simplification with the crowd.
Proceedings of the 12th Web for All Conference, 2015
LegionTools: A Toolkit + UI for Recruiting and Routing Crowds to Synchronous Real-Time Tasks.
Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, 2015
Towards Integrating Real-Time Crowd Advice with Reinforcement Learning.
Proceedings of the 20th International Conference on Intelligent User Interfaces Companion, 2015
Guardian: A Crowd-Powered Spoken Dialog System for Web APIs.
Proceedings of the Third AAAI Conference on Human Computation and Crowdsourcing, 2015
RegionSpeak: Quick Comprehensive Spatial Descriptions of Complex Images for Blind Users.
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2015
The Effects of Sequence and Delay on Crowd Work.
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2015
Apparition: Crowdsourced User Interfaces that Come to Life as You Sketch Them.
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2015
Exploring Privacy and Accuracy Trade-Offs in Crowdsourced Behavioral Video Coding.
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2015
Zensors: Adaptive, Rapidly Deployable, Human-Intelligent Sensor Feeds.
Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2015
Generating Real-Time Crowd Advice to Improve Reinforcement Learning Agents.
Proceedings of the Learning for General Competency in Video Games, 2015
2014
Accessibility Evaluation of Classroom Captions.
ACM Trans. Access. Comput., 2014
Real-time captioning with the crowd.
Interactions, 2014
Architecting Real-Time Crowd-Powered Systems.
Hum. Comput., 2014
Helping students keep up with real-time captions by pausing and highlighting.
Proceedings of the International Web for All Conference, 2014
Expert crowdsourcing with flash teams.
Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, 2014
Glance: rapidly coding behavioral video with the crowd.
Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, 2014
Powering interactive intelligent systems with the crowd.
Proceedings of the adjunct publication of the 27th annual ACM symposium on User interface software and technology, 2014
Tuning the Diversity of Open-Ended Responses From the Crowd.
Proceedings of the Seconf AAAI Conference on Human Computation and Crowdsourcing, 2014
Combining Non-Expert and Expert Crowd Work to Convert Web APIs to Dialog Systems.
Proceedings of the Seconf AAAI Conference on Human Computation and Crowdsourcing, 2014
Glance Privacy: Obfuscating Personal Identity While Coding Behavioral Video.
Proceedings of the Seconf AAAI Conference on Human Computation and Crowdsourcing, 2014
Introducing shared character control to existing video games.
Proceedings of the 9th International Conference on the Foundations of Digital Games, 2014
Information extraction and manipulation threats in crowd-powered systems.
Proceedings of the Computer Supported Cooperative Work, 2014
Selfsourcing personal tasks.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2014
Finding dependencies between actions using the crowd.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2014
Glance: enabling rapid interactions with data using the crowd.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2014
Crowd storage: storing information on existing memories.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2014
Increasing the bandwidth of crowdsourced visual question answering to better support blind users.
Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility, 2014
Legion scribe: real-time captioning by non-experts.
Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility, 2014
2013
Interactive Crowds: Real-Time Crowdsourcing and Crowd Agents.
Proceedings of the Handbook of Human Computation, 2013
Legion scribe: real-time captioning by the non-experts.
Proceedings of the International Cross-Disciplinary Conference on Web Accessibility, 2013
Captions versus transcripts for online video content.
Proceedings of the International Cross-Disciplinary Conference on Web Accessibility, 2013
Chorus: a crowd-powered conversational assistant.
Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, 2013
Text Alignment for Real-Time Crowd Captioning.
Proceedings of the Human Language Technologies: Conference of the North American Chapter of the Association of Computational Linguistics, 2013
Finding action dependencies using the crowd.
Proceedings of the 7th International Conference on Knowledge Capture, 2013
HiveMind: Tuning Crowd Response with a Single Value.
Proceedings of the Human Computation and Crowdsourcing: Works in Progress and Demonstration Abstracts, 2013
Automated Support for Collective Memory of Conversational Interactions.
Proceedings of the Human Computation and Crowdsourcing: Works in Progress and Demonstration Abstracts, 2013
Real-time crowd labeling for deployable activity recognition.
Proceedings of the Computer Supported Cooperative Work, 2013
Adaptive time windows for real-time crowd captioning.
Proceedings of the 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, 2013
Warping time for more effective real-time crowdsourcing.
Proceedings of the 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, 2013
Real-time conversational crowd assistants.
Proceedings of the 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, 2013
Answering visual questions with conversational crowd assistants.
Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, 2013
Real-time captioning by non-experts with legion scribe.
Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, 2013
Crowd Formalization of Action Conditions.
Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence, 2013
Crowdsourcing for Deployable Intelligent Systems.
Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence, 2013
2012
Crowd Memory: Learning in the Collective
CoRR, 2012
Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, 2012
Real-time captioning by groups of non-experts.
Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, 2012
Crowd-based recognition of web interaction patterns.
Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, 2012
Using real-time feedback to improve visual question answering.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2012
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2012
Online quality control for real-time crowd captioning.
Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility, 2012
A readability evaluation of real-time crowd captions in the classroom.
Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility, 2012
Online Sequence Alignment for Real-Time Audio Transcription by Non-Experts.
Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, 2012
Real-Time Collaborative Planning with the Crowd.
Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, 2012
2011
Real-time crowd control of existing interfaces.
Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, 2011