Esin Durmus

According to our database, Esin Durmus authored at least 45 papers between 2016 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Benchmarking Large Language Models for News Summarization.

Tianyi Zhang, Faisal Ladhak, Esin Durmus, Percy Liang, Kathleen R. McKeown, Tatsunori B. Hashimoto

Trans. Assoc. Comput. Linguistics, 2024

Sabotage Evaluations for Frontier Models.

Joe Benton, Misha Wagner, Eric Christiansen, Cem Anil, Ethan Perez, Jai Srivastav, Esin Durmus, Deep Ganguli, Shauna Kravec, Buck Shlegeris, Jared Kaplan, Holden Karnofsky, Evan Hubinger, Roger Grosse, Samuel R. Bowman, David Duvenaud

CoRR, 2024

How will advanced AI systems impact democracy?

Christopher Summerfield, Lisa Argyle, Michiel A. Bakker, Teddy Collins, Esin Durmus, Tyna Eloundou, Iason Gabriel, Deep Ganguli, Kobi Hackenburg, Gillian K. Hadfield, Luke Hewitt, Saffron Huang, Helene Landemore, Nahema Marchal, Aviv Ovadya, Ariel Procaccia, Mathias Risse, Bruce Schneier, Elizabeth Seger, Divya Siddarth, Henrik Skaug Sætra, MH Tessler, Matthew Botvinick

CoRR, 2024

NLP Systems That Can't Tell Use from Mention Censor Counterspeech, but Teaching the Distinction Helps.

Kristina Gligoric, Myra Cheng, Lucia Zheng, Esin Durmus, Dan Jurafsky

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

Towards Understanding Sycophancy in Language Models.

Mrinank Sharma, Meg Tong, Tomasz Korbak, David Duvenaud, Amanda Askell, Samuel R. Bowman, Esin Durmus, Zac Hatfield-Dodds, Scott R. Johnston, Shauna Kravec, Timothy Maxwell, Sam McCandlish, Kamal Ndousse, Oliver Rausch, Nicholas Schiefer, Da Yan, Miranda Zhang, Ethan Perez

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Collective Constitutional AI: Aligning a Language Model with Public Input.

Saffron Huang, Divya Siddarth, Liane Lovitt, Thomas I. Liao, Esin Durmus, Alex Tamkin, Deep Ganguli

Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency, 2024

2023

Holistic Evaluation of Language Models.

Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, Benjamin Newman, Binhang Yuan, Bobby Yan, Ce Zhang, Christian Cosgrove, Christopher D. Manning, Christopher Ré, Diana Acosta-Navas, Drew A. Hudson, Eric Zelikman, Esin Durmus, Faisal Ladhak, Frieda Rong, Hongyu Ren, Huaxiu Yao, Jue Wang, Keshav Santhanam, Laurel J. Orr, Lucia Zheng, Mert Yüksekgönül, Mirac Suzgun, Nathan Kim, Neel Guha, Niladri S. Chatterji, Omar Khattab, Peter Henderson, Qian Huang, Ryan Chi, Sang Michael Xie, Shibani Santurkar, Surya Ganguli, Tatsunori Hashimoto, Thomas Icard, Tianyi Zhang, Vishrav Chaudhary, William Wang, Xuechen Li, Yifan Mai, Yuhui Zhang, Yuta Koreeda

Trans. Mach. Learn. Res., 2023

Evaluating Human-Language Model Interaction.

Mina Lee, Megha Srivastava, Amelia Hardy, John Thickstun, Esin Durmus, Ashwin Paranjape, Ines Gerard-Ursin, Xiang Lisa Li, Faisal Ladhak, Frieda Rong, Rose E. Wang, Minae Kwon, Joon Sung Park, Hancheng Cao, Tony Lee, Rishi Bommasani, Michael S. Bernstein, Percy Liang

Trans. Mach. Learn. Res., 2023

Evaluating and Mitigating Discrimination in Language Model Decisions.

Alex Tamkin, Amanda Askell, Liane Lovitt, Esin Durmus, Nicholas Joseph, Shauna Kravec, Karina Nguyen, Jared Kaplan, Deep Ganguli

CoRR, 2023

Specific versus General Principles for Constitutional AI.

Sandipan Kundu, Yuntao Bai, Saurav Kadavath, Amanda Askell, Andrew Callahan, Anna Chen, Anna Goldie, Avital Balwit, Azalia Mirhoseini, Brayden McLean, Catherine Olsson, Cassie Evraets, Eli Tran-Johnson, Esin Durmus, Ethan Perez, Jackson Kernion, Jamie Kerr, Kamal Ndousse, Karina Nguyen, Nelson Elhage, Newton Cheng, Nicholas Schiefer, Nova DasSarma, Oliver Rausch, Robin Larson, Shannon Yang, Shauna Kravec, Timothy Telleen-Lawton, Thomas I. Liao, Tom Henighan, Tristan Hume, Zac Hatfield-Dodds, Sören Mindermann, Nicholas Joseph, Sam McCandlish, Jared Kaplan

CoRR, 2023

Towards Understanding Sycophancy in Language Models.

Mrinank Sharma, Meg Tong, Tomasz Korbak, David Duvenaud, Amanda Askell, Samuel R. Bowman, Newton Cheng, Esin Durmus, Zac Hatfield-Dodds, Scott R. Johnston, Shauna Kravec, Timothy Maxwell, Sam McCandlish, Kamal Ndousse, Oliver Rausch, Nicholas Schiefer, Da Yan, Miranda Zhang, Ethan Perez

CoRR, 2023

Studying Large Language Model Generalization with Influence Functions.

Roger B. Grosse, Juhan Bae, Cem Anil, Nelson Elhage, Alex Tamkin, Amirhossein Tajdini, Benoit Steiner, Dustin Li, Esin Durmus, Ethan Perez, Evan Hubinger, Kamile Lukosiute, Karina Nguyen, Nicholas Joseph, Sam McCandlish, Jared Kaplan, Samuel R. Bowman

CoRR, 2023

Measuring Faithfulness in Chain-of-Thought Reasoning.

Tamera Lanham, Anna Chen, Ansh Radhakrishnan, Benoit Steiner, Carson Denison, Danny Hernandez, Dustin Li, Esin Durmus, Evan Hubinger, Jackson Kernion, Kamile Lukosiute, Karina Nguyen, Newton Cheng, Nicholas Joseph, Nicholas Schiefer, Oliver Rausch, Robin Larson, Sam McCandlish, Sandipan Kundu, Saurav Kadavath, Shannon Yang, Thomas Henighan, Timothy Maxwell, Timothy Telleen-Lawton, Tristan Hume, Zac Hatfield-Dodds, Jared Kaplan, Jan Brauner, Samuel R. Bowman, Ethan Perez

CoRR, 2023

Question Decomposition Improves the Faithfulness of Model-Generated Reasoning.

Ansh Radhakrishnan, Karina Nguyen, Anna Chen, Carol Chen, Carson Denison, Danny Hernandez, Esin Durmus, Evan Hubinger, Jackson Kernion, Kamile Lukosiute, Newton Cheng, Nicholas Joseph, Nicholas Schiefer, Oliver Rausch, Sam McCandlish, Sheer El Showk, Tamera Lanham, Tim Maxwell, Venkatesa Chandrasekaran, Zac Hatfield-Dodds, Jared Kaplan, Jan Brauner, Samuel R. Bowman, Ethan Perez

CoRR, 2023

Towards Measuring the Representation of Subjective Global Opinions in Language Models.

Esin Durmus, Karina Nyugen, Thomas I. Liao, Nicholas Schiefer, Amanda Askell, Anton Bakhtin, Carol Chen, Zac Hatfield-Dodds, Danny Hernandez, Nicholas Joseph, Liane Lovitt, Sam McCandlish, Orowa Sikder, Alex Tamkin, Janel Thamkul, Jared Kaplan, Jack Clark, Deep Ganguli

CoRR, 2023

Opportunities and Risks of LLMs for Scalable Deliberation with Polis.

Christopher T. Small, Ivan Vendrov, Esin Durmus, Hadjar Homaei, Elizabeth Barry, Julien Cornebise, Ted Suzman, Deep Ganguli, Colin Megill

CoRR, 2023

Whose Opinions Do Language Models Reflect?

Shibani Santurkar, Esin Durmus, Faisal Ladhak, Cinoo Lee, Percy Liang, Tatsunori Hashimoto

Proceedings of the International Conference on Machine Learning, 2023

Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scale.

Federico Bianchi, Pratyusha Kalluri, Esin Durmus, Faisal Ladhak, Myra Cheng, Debora Nozza, Tatsunori Hashimoto, Dan Jurafsky, James Zou, Aylin Caliskan

Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency, 2023

When Do Pre-Training Biases Propagate to Downstream Tasks? A Case Study in Text Summarization.

Faisal Ladhak, Esin Durmus, Mirac Suzgun, Tianyi Zhang, Dan Jurafsky, Kathleen R. McKeown, Tatsunori Hashimoto

Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023

Towards Reference-free Text Simplification Evaluation with a BERT Siamese Network Architecture.

Xinran Zhao, Esin Durmus, Dit-Yan Yeung

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

Contrastive Error Attribution for Finetuned Language Models.

Faisal Ladhak, Esin Durmus, Tatsunori Hashimoto

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Models.

Myra Cheng, Esin Durmus, Dan Jurafsky

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

Tracing and Removing Data Errors in Natural Language Generation Datasets.

Faisal Ladhak, Esin Durmus, Tatsunori Hashimoto

CoRR, 2022

GEMv2: Multilingual NLG Benchmarking in a Single Line of Code.

Sebastian Gehrmann, Abhik Bhattacharjee, Abinaya Mahendiran, Alex Wang, Alexandros Papangelis, Aman Madaan, Angelina McMillan-Major, Anna Shvets, Ashish Upadhyay, Bingsheng Yao, Bryan Wilie, Chandra Bhagavatula, Chaobin You, Craig Thomson, Cristina Garbacea, Dakuo Wang, Daniel Deutsch, Deyi Xiong, Di Jin, Dimitra Gkatzia, Dragomir R. Radev, Elizabeth Clark, Esin Durmus, Faisal Ladhak, Filip Ginter, Genta Indra Winata, Hendrik Strobelt, Hiroaki Hayashi, Jekaterina Novikova, Jenna Kanerva, Jenny Chim, Jiawei Zhou, Jordan Clive, Joshua Maynez, João Sedoc, Juraj Juraska, Kaustubh D. Dhole, Khyathi Raghavi Chandu, Laura Perez-Beltrachini, Leonardo F. R. Ribeiro, Lewis Tunstall, Li Zhang, Mahima Pushkarna, Mathias Creutz, Michael White, Mihir Sanjay Kale, Moussa Kamal Eddine, Nico Daheim, Nishant Subramani, Ondrej Dusek, Paul Pu Liang, Pawan Sasanka Ammanamanchi, Qi Zhu, Ratish Puduppully, Reno Kriz, Rifat Shahriyar, Ronald Cardenas, Saad Mahamood, Salomey Osei, Samuel Cahyawijaya, Sanja Stajner, Sébastien Montella, Shailza Jolly, Simon Mille, Tahmid Hasan, Tianhao Shen, Tosin P. AMahidewumi, Vikas Raunak, Vipul Raheja, Vitaly Nikolaev, Vivian Tsai, Yacine Jernite, Ying Xu, Yisi Sang, Yixin Liu, Yufang Hou

CoRR, 2022

Language modeling via stochastic processes.

Rose E. Wang, Esin Durmus, Noah D. Goodman, Tatsunori Hashimoto

Proceedings of the Tenth International Conference on Learning Representations, 2022

Improving Faithfulness by Augmenting Negative Summaries from Fake Documents.

Tianshu Wang, Faisal Ladhak, Esin Durmus, He He

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarization.

Faisal Ladhak, Esin Durmus, He He, Claire Cardie, Kathleen R. McKeown

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

Spurious Correlations in Reference-Free Evaluation of Text Generation.

Esin Durmus, Faisal Ladhak, Tatsunori Hashimoto

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021

Towards Understanding Persuasion in Computational Argumentation.

Esin Durmus

PhD thesis, 2021

Towards Understanding Persuasion in Computational Argumentation.

Esin Durmus

CoRR, 2021

On the Opportunities and Risks of Foundation Models.

Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ B. Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, Erik Brynjolfsson, Shyamal Buch, Dallas Card, Rodrigo Castellon, Niladri S. Chatterji, Annie S. Chen, Kathleen Creel, Jared Quincy Davis, Dorottya Demszky, Chris Donahue, Moussa Doumbouya, Esin Durmus, Stefano Ermon, John Etchemendy, Kawin Ethayarajh, Li Fei-Fei, Chelsea Finn, Trevor Gale, Lauren E. Gillespie, Karan Goel, Noah D. Goodman, Shelby Grossman, Neel Guha, Tatsunori Hashimoto, Peter Henderson, John Hewitt, Daniel E. Ho, Jenny Hong, Kyle Hsu, Jing Huang, Thomas Icard, Saahil Jain, Dan Jurafsky, Pratyusha Kalluri, Siddharth Karamcheti, Geoff Keeling, Fereshte Khani, Omar Khattab, Pang Wei Koh, Mark S. Krass, Ranjay Krishna, Rohith Kuditipudi, et al.

CoRR, 2021

The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics.

Sebastian Gehrmann, Tosin P. Adewumi, Karmanya Aggarwal, Pawan Sasanka Ammanamanchi, Aremu Anuoluwapo, Antoine Bosselut, Khyathi Raghavi Chandu, Miruna-Adriana Clinciu, Dipanjan Das, Kaustubh D. Dhole, Wanyu Du, Esin Durmus, Ondrej Dusek, Chris Emezue, Varun Gangal, Cristina Garbacea, Tatsunori Hashimoto, Yufang Hou, Yacine Jernite, Harsh Jhamtani, Yangfeng Ji, Shailza Jolly, Dhruv Kumar, Faisal Ladhak, Aman Madaan, Mounica Maddela, Khyati Mahajan, Saad Mahamood, Bodhisattwa Prasad Majumder, Pedro Henrique Martins, Angelina McMillan-Major, Simon Mille, Emiel van Miltenburg, Moin Nadeem, Shashi Narayan, Vitaly Nikolaev, Rubungo Andre Niyongabo, Salomey Osei, Ankur P. Parikh, Laura Perez-Beltrachini, Niranjan Ramesh Rao, Vikas Raunak, Juan Diego Rodriguez, Sashank Santhanam, João Sedoc, Thibault Sellam, Samira Shaikh, Anastasia Shimorina, Marco Antonio Sobrevilla Cabezudo, Hendrik Strobelt, Nishant Subramani, Wei Xu, Diyi Yang, Akhila Yerukola, Jiawei Zhou

CoRR, 2021

Leveraging Topic Relatedness for Argument Persuasion.

Xinran Zhao, Esin Durmus, Hongming Zhang, Claire Cardie

Proceedings of the Findings of the Association for Computational Linguistics: ACL/IJCNLP 2021, 2021

2020

WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarization.

Faisal Ladhak, Esin Durmus, Claire Cardie, Kathleen R. McKeown

CoRR, 2020

Exploring the Role of Argument Structure in Online Debate Persuasion.

Jialu Li, Esin Durmus, Claire Cardie

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

WikiLingua: A New Benchmark Dataset for Multilingual Abstractive Summarization.

Faisal Ladhak, Esin Durmus, Claire Cardie, Kathleen R. McKeown

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020

FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization.

Esin Durmus, He He, Mona T. Diab

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

Modeling the Factors of User Success in Online Debate.

Esin Durmus, Claire Cardie

Proceedings of the World Wide Web Conference, 2019

The Role of Pragmatic and Discourse Context in Determining Argument Impact.

Esin Durmus, Faisal Ladhak, Claire Cardie

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

Persuasion of the Undecided: Language vs. the Listener.

Liane Longpre, Esin Durmus, Claire Cardie

Proceedings of the 6th Workshop on Argument Mining, ArgMining@ACL 2019, Florence, Italy, 2019

Determining Relative Argument Specificity and Stance for Complex Argumentative Structures.

Esin Durmus, Faisal Ladhak, Claire Cardie

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

A Corpus for Modeling User and Language Effects in Argumentation on Online Debating.

Esin Durmus, Claire Cardie

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

2018

Exploring the Role of Prior Beliefs for Argument Persuasion.

Esin Durmus, Claire Cardie

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

Understanding the Effect of Gender and Stance in Opinion Expression in Debates on "Abortion".

Esin Durmus, Claire Cardie

Proceedings of the Second Workshop on Computational Modeling of People's Opinions, 2018

2016

Cornell Belief and Sentiment System at TAC 2016.

Vlad Niculae, Kai Sun, Xilun Chen, Yao Cheng, Xinya Du, Esin Durmus, Arzoo Katiyar, Claire Cardie

Proceedings of the 2016 Text Analysis Conference, 2016