Stephen Roller

According to our database, Stephen Roller authored at least 41 papers between 2011 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Leveraging Implicit Feedback from Deployment Data in Dialogue.

Richard Yuanzhe Pang, Stephen Roller, Kyunghyun Cho, He He, Jason Weston

Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics, 2024

2023

A Theory on Adam Instability in Large-Scale Machine Learning.

Igor Molybog, Peter Albert, Moya Chen, Zachary DeVito, David Esiobu, Naman Goyal, Punit Singh Koura, Sharan Narang, Andrew Poulton, Ruan Silva, Binh Tang, Diana Liskovich, Puxin Xu, Yuchen Zhang, Melanie Kambadur, Stephen Roller, Susan Zhang

CoRR, 2023

Enhancing Performance on Seen and Unseen Dialogue Scenarios using Retrieval-Augmented End-to-End Task-Oriented System.

Jianguo Zhang, Stephen Roller, Kun Qian, Zhiwei Liu, Rui Meng, Shelby Heinecke, Huan Wang, Silvio Savarese, Caiming Xiong

Proceedings of the 24th Meeting of the Special Interest Group on Discourse and Dialogue, 2023

Scaling Laws for Generative Mixed-Modal Language Models.

Armen Aghajanyan, Lili Yu, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer

Proceedings of the International Conference on Machine Learning, 2023

2022

BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage.

Kurt Shuster, Jing Xu, Mojtaba Komeili, Da Ju, Eric Michael Smith, Stephen Roller, Megan Ung, Moya Chen, Kushal Arora, Joshua Lane, Morteza Behrooz, William Ngan, Spencer Poff, Naman Goyal, Arthur Szlam, Y-Lan Boureau, Melanie Kambadur, Jason Weston

CoRR, 2022

OPT: Open Pre-trained Transformer Language Models.

Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona T. Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, Luke Zettlemoyer

CoRR, 2022

Staircase Attention for Recurrent Processing of Sequences.

Da Ju, Stephen Roller, Sainbayar Sukhbaatar, Jason Weston

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Language Models that Seek for Knowledge: Modular Search & Generation for Dialogue and Prompt Completion.

Kurt Shuster, Mojtaba Komeili, Leonard Adolphs, Stephen Roller, Arthur Szlam, Jason Weston

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agents.

Eric Michael Smith, Orion Hsu, Rebecca Qian, Stephen Roller, Y-Lan Boureau, Jason Weston

Proceedings of the 4th Workshop on NLP for Conversational AI, 2022

2021

Teaching Models new APIs: Domain-Agnostic Simulators for Task Oriented Dialogue.

Moya Chen, Paul A. Crook, Stephen Roller

CoRR, 2021

Hash Layers For Large Sparse Models.

Stephen Roller, Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Adding Chit-Chat to Enhance Task-Oriented Dialogues.

Kai Sun, Seungwhan Moon, Paul A. Crook, Stephen Roller, Becka Silvert, Bing Liu, Zhiguang Wang, Honglei Liu, Eunjoon Cho, Claire Cardie

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Not All Memories are Created Equal: Learning to Forget by Expiring.

Sainbayar Sukhbaatar, Da Ju, Spencer Poff, Stephen Roller, Arthur Szlam, Jason Weston, Angela Fan

Proceedings of the 38th International Conference on Machine Learning, 2021

Recipes for Building an Open-Domain Chatbot.

Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Eric Michael Smith, Y-Lan Boureau, Jason Weston

Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021

2020

Adding Chit-Chats to Enhance Task-Oriented Dialogues.

Kai Sun, Seungwhan Moon, Paul A. Crook, Stephen Roller, Becka Silvert, Bing Liu, Zhiguang Wang, Honglei Liu, Eunjoon Cho, Claire Cardie

CoRR, 2020

Open-Domain Conversational Agents: Current Progress, Open Problems, and Future Directions.

Stephen Roller, Y-Lan Boureau, Jason Weston, Antoine Bordes, Emily Dinan, Angela Fan, David Gunning, Da Ju, Margaret Li, Spencer Poff, Pratik Ringshia, Kurt Shuster, Eric Michael Smith, Arthur Szlam, Jack Urbanek, Mary Williamson

CoRR, 2020

Recipes for building an open-domain chatbot.

Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Kurt Shuster, Eric Michael Smith, Y-Lan Boureau, Jason Weston

CoRR, 2020

Neural Text Generation With Unlikelihood Training.

Sean Welleck, Ilia Kulikov, Stephen Roller, Emily Dinan, Kyunghyun Cho, Jason Weston

Proceedings of the 8th International Conference on Learning Representations, 2020

The Dialogue Dodecathlon: Open-Domain Knowledge and Image Grounded Conversational Agents.

Kurt Shuster, Da Ju, Stephen Roller, Emily Dinan, Y-Lan Boureau, Jason Weston

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

Don't Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood Training.

Margaret Li, Stephen Roller, Ilia Kulikov, Sean Welleck, Y-Lan Boureau, Kyunghyun Cho, Jason Weston

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

ACUTE-EVAL: Improved Dialogue Evaluation with Optimized Questions and Multi-turn Comparisons.

Margaret Li, Jason Weston, Stephen Roller

CoRR, 2019

What makes a good conversation? How controllable attributes affect human judgments.

Abigail See, Stephen Roller, Douwe Kiela, Jason Weston

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Wizard of Wikipedia: Knowledge-Powered Conversational Agents.

Emily Dinan, Stephen Roller, Kurt Shuster, Angela Fan, Michael Auli, Jason Weston

Proceedings of the 7th International Conference on Learning Representations, 2019

Inferring Concept Hierarchies from Text Corpora via Hyperbolic Embeddings.

Matt Le, Stephen Roller, Laetitia Papaxanthos, Douwe Kiela, Maximilian Nickel

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

2018

Hearst Patterns Revisited: Automatic Hypernym Detection from Large Text Corpora.

Stephen Roller, Douwe Kiela, Maximilian Nickel

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

2017

Distributional model on a diet: One-shot word learning from text only.

Su Wang, Stephen Roller, Katrin Erk

CoRR, 2017

Distributional Modeling on a Diet: One-shot Word Learning from Text Only.

Su Wang, Stephen Roller, Katrin Erk

Proceedings of the Eighth International Joint Conference on Natural Language Processing, 2017

2016

Representing Meaning with a Combination of Logical and Distributional Models.

Islam Beltagy, Stephen Roller, Pengxiang Cheng, Katrin Erk, Raymond J. Mooney

Comput. Linguistics, 2016

MGNC-CNN: A Simple Approach to Exploiting Multiple Word Embeddings for Sentence Classification.

Ye Zhang, Stephen Roller, Byron C. Wallace

Proceedings of the NAACL HLT 2016, 2016

PIC a Different Word: A Simple Model for Lexical Substitution in Context.

Stephen Roller, Katrin Erk

Proceedings of the NAACL HLT 2016, 2016

Relations such as Hypernymy: Identifying and Exploiting Hearst Patterns in Distributional Vectors for Lexical Entailment.

Stephen Roller, Katrin Erk

Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016

2015

Representing Meaning with a Combination of Logical Form and Vectors.

Islam Beltagy, Stephen Roller, Pengxiang Cheng, Katrin Erk, Raymond J. Mooney

CoRR, 2015

2014

UTexas: Natural Language Semantics using Distributional Semantics and Probabilistic Logic.

Islam Beltagy, Stephen Roller, Gemma Boleda, Katrin Erk, Raymond J. Mooney

Proceedings of the 8th International Workshop on Semantic Evaluation, 2014

Feature Norms of German Noun Compounds.

Stephen Roller, Sabine Schulte im Walde

Proceedings of the 10th Workshop on Multiword Expressions, 2014

Inclusive yet Selective: Supervised Distributional Hypernymy Detection.

Stephen Roller, Katrin Erk, Gemma Boleda

Proceedings of the COLING 2014, 2014

2013

Exploring Vector Space Models to Predict the Compositionality of German Noun-Noun Compounds.

Sabine Schulte im Walde, Stefan Müller, Stephen Roller

Proceedings of the Second Joint Conference on Lexical and Computational Semantics, 2013

The (Un)expected Effects of Applying Standard Cleansing Models to Human Ratings on Compositionality.

Stephen Roller, Sabine Schulte im Walde, Silke Scheible

Proceedings of the 9th Workshop on Multiword Expressions, 2013

A Multimodal LDA Model integrating Textual, Cognitive and Visual Modalities.

Stephen Roller, Sabine Schulte im Walde

Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, 2013

2012

Supervised Text-based Geolocation Using Language Models on an Adaptive Grid.

Stephen Roller, Michael Speriosu, Sarat Rallapalli, Benjamin Wing, Jason Baldridge

Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, 2012

2011

Automatic identification and generation of highlight cinematics for 3D games.

Mike Dominguez, R. Michael Young, Stephen Roller

Proceedings of the Foundations of Digital Games, 2011

Design and Evaluation of Afterthought, A System that Automatically Creates Highlight Cinematics for 3D Games.

Mike Dominguez, R. Michael Young, Stephen Roller

Proceedings of the Seventh AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, 2011