Sean Welleck

According to our database, Sean Welleck authored at least 47 papers between 2017 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of two.

2024

ImProver: Agent-Based Automated Proof Optimization.

Riyaz Ahuja, Jeremy Avigad, Prasad Tetali, Sean Welleck

CoRR, 2024

miniCTX: Neural Theorem Proving with (Long-)Contexts.

Jiewen Hu, Thomas Zhu, Sean Welleck

CoRR, 2024

An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Models.

Yangzhen Wu, Zhiqing Sun, Shanda Li, Sean Welleck, Yiming Yang

CoRR, 2024

Lean-STaR: Learning to Interleave Thinking and Proving.

Haohan Lin, Zhiqing Sun, Yiming Yang, Sean Welleck

CoRR, 2024

From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models.

Sean Welleck, Amanda Bertsch, Matthew Finlayson, Hailey Schoelkopf, Alex Xie, Graham Neubig, Ilia Kulikov, Zaïd Harchaoui

CoRR, 2024

miniCodeProps: a Minimal Benchmark for Proving Code Properties.

Evan Lohn, Sean Welleck

CoRR, 2024

The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models.

Seungone Kim, Juyoung Suk, Ji Yong Cho, Shayne Longpre, Chaeeun Kim, Dongkeun Yoon, Guijin Son, Yejin Choi, Sheikh Shafayat, Jinheon Baek, Sue Hyun Park, Hyeonbin Hwang, Jinkyung Jo, Hyowon Cho, Haebin Shin, Seongyun Lee, Hanseok Oh, Noah Lee, Namgyu Ho, Se June Joo, Miyoung Ko, Yoonjoo Lee, Hyungjoo Chae, Jamin Shin, Joel Jang, Seonghyeon Ye, Bill Yuchen Lin, Sean Welleck, Graham Neubig, Moontae Lee, Kyungjae Lee, Minjoon Seo

CoRR, 2024

Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision.

Zhiqing Sun, Longhui Yu, Yikang Shen, Weiyang Liu, Yiming Yang, Sean Welleck, Chuang Gan

CoRR, 2024

Llemma: An Open Language Model for Mathematics.

Zhangir Azerbayev, Hailey Schoelkopf, Keiran Paster, Marco Dos Santos, Stephen Marcus McAleer, Albert Q. Jiang, Jia Deng, Stella Biderman, Sean Welleck

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models.

Seungone Kim, Juyoung Suk, Shayne Longpre, Bill Yuchen Lin, Jamin Shin, Sean Welleck, Graham Neubig, Moontae Lee, Kyungjae Lee, Minjoon Seo

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

2023

MAUVE Scores for Generative Models: Theory and Practice.

Krishna Pillutla, Lang Liu, John Thickstun, Sean Welleck, Swabha Swayamdipta, Rowan Zellers, Sewoong Oh, Yejin Choi, Zaïd Harchaoui

J. Mach. Learn. Res., 2023

LLMSTEP: LLM proofstep suggestions in Lean.

Sean Welleck, Rahul Saha

CoRR, 2023

Self-Refine: Iterative Refinement with Self-Feedback.

Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Sean Welleck, Bodhisattwa Prasad Majumder, Shashank Gupta, Amir Yazdanbakhsh, Peter Clark

CoRR, 2023

Self-Refine: Iterative Refinement with Self-Feedback.

Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa Prasad Majumder, Katherine Hermann, Sean Welleck, Amir Yazdanbakhsh, Peter Clark

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Faith and Fate: Limits of Transformers on Compositionality.

Nouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li, Liwei Jiang, Bill Yuchen Lin, Sean Welleck, Peter West, Chandra Bhagavatula, Ronan Le Bras, Jena D. Hwang, Soumya Sanyal, Xiang Ren, Allyson Ettinger, Zaïd Harchaoui, Yejin Choi

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Generating Sequences by Learning to Self-Correct.

Sean Welleck, Ximing Lu, Peter West, Faeze Brahman, Tianxiao Shen, Daniel Khashabi, Yejin Choi

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofs.

Albert Qiaochu Jiang, Sean Welleck, Jin Peng Zhou, Timothée Lacroix, Jiacheng Liu, Wenda Li, Mateja Jamnik, Guillaume Lample, Yuhuai Wu

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning.

Ximing Lu, Faeze Brahman, Peter West, Jaehun Jung, Khyathi Raghavi Chandu, Abhilasha Ravichander, Prithviraj Ammanabrolu, Liwei Jiang, Sahana Ramnath, Nouha Dziri, Jillian Fisher, Bill Y. Lin, Skyler Hallinan, Lianhui Qin, Xiang Ren, Sean Welleck, Yejin Choi

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

STEER: Unified Style Transfer with Expert Reinforcement.

Skyler Hallinan, Faeze Brahman, Ximing Lu, Jaehun Jung, Sean Welleck, Yejin Choi

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

A Survey of Deep Learning for Mathematical Reasoning.

Pan Lu, Liang Qiu, Wenhao Yu, Sean Welleck, Kai-Wei Chang

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

NaturalProver: Grounded Mathematical Proof Generation with Language Models.

Sean Welleck, Jiacheng Liu, Ximing Lu, Hannaneh Hajishirzi, Yejin Choi

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

COLD Decoding: Energy-based Constrained Text Generation with Langevin Dynamics.

Lianhui Qin, Sean Welleck, Daniel Khashabi, Yejin Choi

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

QUARK: Controllable Text Generation with Reinforced Unlearning.

Ximing Lu, Sean Welleck, Jack Hessel, Liwei Jiang, Lianhui Qin, Peter West, Prithviraj Ammanabrolu, Yejin Choi

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Symbolic Knowledge Distillation: from General Language Models to Commonsense Models.

Peter West, Chandra Bhagavatula, Jack Hessel, Jena D. Hwang, Liwei Jiang, Ronan Le Bras, Ximing Lu, Sean Welleck, Yejin Choi

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics.

Ximing Lu, Sean Welleck, Peter West, Liwei Jiang, Jungo Kasai, Daniel Khashabi, Ronan Le Bras, Lianhui Qin, Youngjae Yu, Rowan Zellers, Noah A. Smith, Yejin Choi

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Prompt Waywardness: The Curious Case of Discretized Interpretation of Continuous Prompts.

Daniel Khashabi, Xinxi Lyu, Sewon Min, Lianhui Qin, Kyle Richardson, Sean Welleck, Hannaneh Hajishirzi, Tushar Khot, Ashish Sabharwal, Sameer Singh, Yejin Choi

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

LILA: A Unified Benchmark for Mathematical Reasoning.

Swaroop Mishra, Matthew Finlayson, Pan Lu, Leonard Tang, Sean Welleck, Chitta Baral, Tanmay Rajpurohit, Oyvind Tafjord, Ashish Sabharwal, Peter Clark, Ashwin Kalyan

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanations.

Jaehun Jung, Lianhui Qin, Sean Welleck, Faeze Brahman, Chandra Bhagavatula, Ronan Le Bras, Yejin Choi

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Rainier: Reinforced Knowledge Introspector for Commonsense Question Answering.

Jiacheng Liu, Skyler Hallinan, Ximing Lu, Pengfei He, Sean Welleck, Hannaneh Hajishirzi, Yejin Choi

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Generated Knowledge Prompting for Commonsense Reasoning.

Jiacheng Liu, Alisa Liu, Ximing Lu, Sean Welleck, Peter West, Ronan Le Bras, Yejin Choi, Hannaneh Hajishirzi

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

Symbolic Brittleness in Sequence Models: On Systematic Generalization in Symbolic Mathematics.

Sean Welleck, Peter West, Jize Cao, Yejin Choi

Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022

2021

Order and Learning in Sequential Neural Structured Prediction.

Sean Welleck

PhD thesis, 2021

PROMPT WAYWARDNESS: The Curious Case of Discretized Interpretation of Continuous Prompts.

Daniel Khashabi, Shane Lyu, Sewon Min, Lianhui Qin, Kyle Richardson, Sameer Singh, Sean Welleck, Hannaneh Hajishirzi, Tushar Khot, Ashish Sabharwal, Yejin Choi

CoRR, 2021

Divergence Frontiers for Generative Models: Sample Complexity, Quantization Level, and Frontier Integral.

Lang Liu, Krishna Pillutla, Sean Welleck, Sewoong Oh, Yejin Choi, Zaïd Harchaoui

CoRR, 2021

NaturalProofs: Mathematical Theorem Proving in Natural Language.

Sean Welleck, Jiacheng Liu, Ronan Le Bras, Hanna Hajishirzi, Yejin Choi, Kyunghyun Cho

Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, 2021

MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers.

Krishna Pillutla, Swabha Swayamdipta, Rowan Zellers, John Thickstun, Sean Welleck, Yejin Choi, Zaïd Harchaoui

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Divergence Frontiers for Generative Models: Sample Complexity, Quantization Effects, and Frontier Integrals.

Lang Liu, Krishna Pillutla, Sean Welleck, Sewoong Oh, Yejin Choi, Zaïd Harchaoui

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Mode recovery in neural autoregressive sequence modeling.

Ilia Kulikov, Sean Welleck, Kyunghyun Cho

Proceedings of the 5th Workshop on Structured Prediction for NLP, 2021

MLE-Guided Parameter Search for Task Loss Minimization in Neural Sequence Modeling.

Sean Welleck, Kyunghyun Cho

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

Neural Text Generation With Unlikelihood Training.

Sean Welleck, Ilia Kulikov, Stephen Roller, Emily Dinan, Kyunghyun Cho, Jason Weston

Proceedings of the 8th International Conference on Learning Representations, 2020

Consistency of a Recurrent Language Model With Respect to Incomplete Decoding.

Sean Welleck, Ilia Kulikov, Jaedeok Kim, Richard Yuanzhe Pang, Kyunghyun Cho

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Don't Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood Training.

Margaret Li, Stephen Roller, Ilia Kulikov, Sean Welleck, Y-Lan Boureau, Kyunghyun Cho, Jason Weston

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

Sequential Graph Dependency Parser.

Sean Welleck, Kyunghyun Cho

Proceedings of the International Conference on Recent Advances in Natural Language Processing, 2019

Non-Monotonic Sequential Text Generation.

Sean Welleck, Kianté Brantley, Hal Daumé III, Kyunghyun Cho

Proceedings of the 36th International Conference on Machine Learning, 2019

Dialogue Natural Language Inference.

Sean Welleck, Jason Weston, Arthur Szlam, Kyunghyun Cho

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

2018

Loss Functions for Multiset Prediction.

Sean Welleck, Zixin Yao, Yu Gai, Jialin Mao, Zheng Zhang, Kyunghyun Cho

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

2017

Saliency-based Sequential Image Attention with Multiset Prediction.

Sean Welleck, Jialin Mao, Kyunghyun Cho, Zheng Zhang

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017