Adina Williams

According to our database, Adina Williams authored at least 70 papers between 2017 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

DIG In: Evaluating Disparities in Image Generations with Indicators for Geographic Diversity.

Melissa Hall, Candace Ross, Adina Williams, Nicolas Carion, Michal Drozdzal, Adriana Romero-Soriano

Trans. Mach. Learn. Res., 2024

Improving Model Evaluation using SMART Filtering of Benchmark Datasets.

Vipul Gupta, Candace Ross, David Pantoja, Rebecca J. Passonneau, Megan Ung, Adina Williams

CoRR, 2024

Are Female Carpenters like Blue Bananas? A Corpus Investigation of Occupation Gender Typicality.

Da Ju, Karen Ulrich, Adina Williams

CoRR, 2024

Changing Answer Order Can Decrease MMLU Accuracy.

Vipul Gupta, David Pantoja, Candace Ross, Adina Williams, Megan Ung

CoRR, 2024

Decomposed evaluations of geographic disparities in text-to-image models.

Abhishek Sureddy, Dishant Padalia, Nandhinee Periyakaruppa, Oindrila Saha, Adina Williams, Adriana Romero-Soriano, Megan Richards, Polina Kirichenko, Melissa Hall

CoRR, 2024

The Factorization Curse: Which Tokens You Predict Underlie the Reversal Curse and More.

Ouail Kitouni, Niklas Nolte, Diane Bouchacourt, Adina Williams, Mike Rabbat, Mark Ibrahim

CoRR, 2024

The PRISM Alignment Project: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models.

Hannah Rose Kirk, Alexander Whitefield, Paul Röttger, Andrew M. Bean, Katerina Margatina, Juan Ciro, Rafael Mosquera, Max Bartolo, Adina Williams, He He, Bertie Vidgen, Scott A. Hale

CoRR, 2024

Introducing v0.5 of the AI Safety Benchmark from MLCommons.

Bertie Vidgen, Adarsh Agrawal, Ahmed M. Ahmed, Victor Akinwande, Namir Al-Nuaimi, Najla Alfaraj, Elie Alhajjar, Lora Aroyo, Trupti Bavalatti, Borhane Blili-Hamelin, Kurt D. Bollacker, Rishi Bomassani, Marisa Ferrara Boston, Siméon Campos, Kal Chakra, Canyu Chen, Cody Coleman, Zacharie Delpierre Coudert, Leon Derczynski, Debojyoti Dutta, Ian Eisenberg, James Ezick, Heather Frase, Brian Fuller, Ram Gandikota, Agasthya Gangavarapu, Ananya Gangavarapu, James Gealy, Rajat Ghosh, James Goel, Usman Gohar, Subhra S. Goswami, Scott A. Hale, Wiebke Hutiri, Joseph Marvin Imperial, Surgan Jandial, Nick Judd, Felix Juefei-Xu, Foutse Khomh, Bhavya Kailkhura, Hannah Rose Kirk, Kevin Klyman, Chris Knotz, Michael Kuchnik, Shachi H. Kumar, Chris Lengerich, Bo Li, Zeyi Liao, Eileen Peters Long, Victor Lu, Yifan Mai, Priyanka Mary Mammen, Kelvin Manyeki, Sean McGregor, Virendra Mehta, Shafee Mohammed, Emanuel Moss, Lama Nachman, Dinesh Jinenhally Naganna, Amin Nikanjam, Besmira Nushi, Luis Oala, Iftach Orr, Alicia Parrish, Cigdem Patlak, William Pietri, Forough Poursabzi-Sangdeh, Eleonora Presani, Fabrizio Puletti, Paul Röttger, Saurav Sahay, Tim Santos, Nino Scherrer, Alice Schoenauer Sebag, Patrick Schramowski, Abolfazl Shahbazi, Vin Sharma, Xudong Shen, Vamsi Sistla, Leonard Tang, Davide Testuggine, Vithursan Thangarasa, Elizabeth Anne Watkins, Rebecca Weiss, Chris Welty, Tyler Wilbers, Adina Williams, Carole-Jean Wu, Poonam Yadav, Xianjun Yang, Yi Zeng, Wenhui Zhang, Fedor Zhdanov, Jiacheng Zhu, Percy Liang, Peter Mattson, Joaquin Vanschoren

CoRR, 2024

[Call for Papers] The 2nd BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus.

Leshem Choshen, Ryan Cotterell, Michael Y. Hu, Tal Linzen, Aaron Mueller, Candace Ross, Alex Warstadt, Ethan Wilcox, Adina Williams, Chengxu Zhuang

CoRR, 2024

Improving Text-to-Image Consistency via Automatic Prompt Optimization.

Oscar Mañas, Pietro Astolfi, Melissa Hall, Candace Ross, Jack Urbanek, Adina Williams, Aishwarya Agrawal, Adriana Romero-Soriano, Michal Drozdzal

CoRR, 2024

Compositional learning of functions in humans and machines.

Yanli Zhou, Brenden M. Lake, Adina Williams

CoRR, 2024

Towards Geographic Inclusion in the Evaluation of Text-to-Image Models.

Melissa Hall, Samuel J. Bell, Candace Ross, Adina Williams, Michal Drozdzal, Adriana Romero-Soriano

Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency, 2024

EmphAssess : a Prosodic Benchmark on Assessing Emphasis Transfer in Speech-to-Speech Models.

Maureen de Seyssel, Antony D'Avirro, Adina Williams, Emmanuel Dupoux

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Are Female Carpenters like Blue Bananas? A Corpus Investigation of Occupation Gender Typicality.

Da Ju, Karen Ullrich, Adina Williams

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

Grammatical Gender's Influence on Distributional Semantics: A Causal Perspective.

Karolina Stanczak, Kevin Du, Adina Williams, Isabelle Augenstein, Ryan Cotterell

CoRR, 2023

Llama 2: Open Foundation and Fine-Tuned Chat Models.

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton-Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurélien Rodriguez, Robert Stojnic, Sergey Edunov, Thomas Scialom

CoRR, 2023

Weisfeiler and Lehman Go Measurement Modeling: Probing the Validity of the WL Test.

Arjun Subramonian, Adina Williams, Maximilian Nickel, Yizhou Sun, Levent Sagun

CoRR, 2023

Call for Papers - The BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus.

Alex Warstadt, Leshem Choshen, Aaron Mueller, Adina Williams, Ethan Wilcox, Chengxu Zhuang

CoRR, 2023

The Gender-GAP Pipeline: A Gender-Aware Polyglot Pipeline for Gender Characterisation in 55 Languages.

Benjamin Muller, Belen Alastruey, Prangthip Hansanti, Elahe Kalbassi, Christophe Ropers, Eric Michael Smith, Adina Williams, Luke Zettlemoyer, Pierre Andrews, Marta R. Costa-jussà

Proceedings of the Eighth Conference on Machine Translation, 2023

DataPerf: Benchmarks for Data-Centric AI Development.

Mark Mazumder, Colby R. Banbury, Xiaozhe Yao, Bojan Karlas, William Gaviria Rojas, Sudnya Frederick Diamos, Greg Diamos, Lynn He, Alicia Parrish, Hannah Rose Kirk, Jessica Quaye, Charvi Rastogi, Douwe Kiela, David Jurado, David Kanter, Rafael Mosquera, Will Cukierski, Juan Ciro, Lora Aroyo, Bilge Acun, Lingjiao Chen, Mehul Raje, Max Bartolo, Evan Sabri Eyuboglu, Amirata Ghorbani, Emmett D. Goodman, Addison Howard, Oana Inel, Tariq Kane, Christine R. Kirkpatrick, D. Sculley, Tzu-Sheng Kuo, Jonas W. Mueller, Tristan Thrush, Joaquin Vanschoren, Margaret Warren, Adina Williams, Serena Yeung, Newsha Ardalani, Praveen K. Paritosh, Ce Zhang, James Y. Zou, Carole-Jean Wu, Cody Coleman, Andrew Y. Ng, Peter Mattson, Vijay Janapa Reddi

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Robustness of Named-Entity Replacements for In-Context Learning.

Saeed Goodarzi, Nikhil Kagita, Dennis Minn, Shufan Wang, Roberto Dessì, Shubham Toshniwal, Adina Williams, Jack Lanchantin, Koustuv Sinha

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

ROBBIE: Robust Bias Evaluation of Large Generative Language Models.

David Esiobu, Xiaoqing Ellen Tan, Saghar Hosseini, Megan Ung, Yuchen Zhang, Jude Fernandes, Jane Dwivedi-Yu, Eleonora Presani, Adina Williams, Eric Michael Smith

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

The Validity of Evaluation Results: Assessing Concurrence Across Compositionality Benchmarks.

Kaiser Sun, Adina Williams, Dieuwke Hupkes

Proceedings of the 27th Conference on Computational Natural Language Learning, 2023

Language model acceptability judgements are not always robust to context.

Koustuv Sinha, Jon Gauthier, Aaron Mueller, Kanishka Misra, Keren Fuentes, Roger Levy, Adina Williams

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

A Latent-Variable Model for Intrinsic Probing.

Karolina Stanczak, Lucas Torroba Hennigen, Adina Williams, Ryan Cotterell, Isabelle Augenstein

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

Learning Transductions to Test Systematic Compositionality.

Josef Valvoda, Naomi Saphra, Jonathan Rawski, Ryan Cotterell, Adina Williams

CoRR, 2022

DataPerf: Benchmarks for Data-Centric AI Development.

Mark Mazumder, Colby R. Banbury, Xiaozhe Yao, Bojan Karlas, William Gaviria Rojas, Sudnya Frederick Diamos, Greg Diamos, Lynn He, Douwe Kiela, David Jurado, David Kanter, Rafael Mosquera, Juan Ciro, Lora Aroyo, Bilge Acun, Sabri Eyuboglu, Amirata Ghorbani, Emmett D. Goodman, Tariq Kane, Christine R. Kirkpatrick, Tzu-Sheng Kuo, Jonas Mueller, Tristan Thrush, Joaquin Vanschoren, Margaret Warren, Adina Williams, Serena Yeung, Newsha Ardalani, Praveen K. Paritosh, Ce Zhang, James Zou, Carole-Jean Wu, Cody Coleman, Andrew Y. Ng, Peter Mattson, Vijay Janapa Reddi

CoRR, 2022

"I'm sorry to hear that": finding bias in language models with a holistic descriptor dataset.

Eric Michael Smith, Melissa Hall, Melanie Kambadur, Eleonora Presani, Adina Williams

CoRR, 2022

On the Machine Learning of Ethical Judgments from Natural Language.

Zeerak Talat, Hagen Blix, Josef Valvoda, Maya Indira Ganesh, Ryan Cotterell, Adina Williams

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Dataset.

Eric Michael Smith, Melissa Hall, Melanie Kambadur, Eleonora Presani, Adina Williams

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

The Curious Case of Absolute Position Embeddings.

Koustuv Sinha, Amirhossein Kazemnejad, Siva Reddy, Joelle Pineau, Dieuwke Hupkes, Adina Williams

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Perturbation Augmentation for Fairer NLP.

Rebecca Qian, Candace Ross, Jude Fernandes, Eric Michael Smith, Douwe Kiela, Adina Williams

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality.

Tristan Thrush, Ryan Jiang, Max Bartolo, Amanpreet Singh, Adina Williams, Douwe Kiela, Candace Ross

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Benchmarking Compositionality with Formal Languages.

Josef Valvoda, Naomi Saphra, Jonathan Rawski, Adina Williams, Ryan Cotterell

Proceedings of the 29th International Conference on Computational Linguistics, 2022

Evaluating locality in NMT models.

Itay Itzhak, Koustuv Sinha, Brenden M. Lake, Adina Williams, Dieuwke Hupkes

Proceedings of the 44th Annual Meeting of the Cognitive Science Society, 2022

Analyzing Dynamic Adversarial Training Data in the Limit.

Eric Wallace, Adina Williams, Robin Jia, Douwe Kiela

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, 2022

Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks.

Tristan Thrush, Kushal Tirumala, Anmol Gupta, Max Bartolo, Pedro Rodriguez, Tariq Kane, William Gaviria Rojas, Peter Mattson, Adina Williams, Douwe Kiela

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, 2022

Investigating Failures of Automatic Translationin the Case of Unambiguous Gender.

Adi Renduchintala, Adina Williams

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021

On the Relationships Between the Grammatical Genders of Inanimate Nouns and Their Co-Occurring Adjectives and Verbs.

Adina Williams, Lawrence Wolf-Sonkin, Damián E. Blasi, Hanna M. Wallach, Ryan Cotterell

Trans. Assoc. Comput. Linguistics, 2021

A Word on Machine Ethics: A Response to Jiang et al. (2021).

Zeerak Talat, Hagen Blix, Josef Valvoda, Maya Indira Ganesh, Ryan Cotterell, Adina Williams

CoRR, 2021

Hi, my name is Martha: Using names to measure and mitigate bias in generative dialogue models.

Eric Michael Smith, Adina Williams

CoRR, 2021

Investigating Failures of Automatic Translation in the Case of Unambiguous Gender.

Adithya Renduchintala, Adina Williams

CoRR, 2021

Sometimes We Want Translationese.

Prasanna Parthasarathi, Koustuv Sinha, Joelle Pineau, Adina Williams

CoRR, 2021

Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking.

Zhiyi Ma, Kawin Ethayarajh, Tristan Thrush, Somya Jain, Ledell Wu, Robin Jia, Christopher Potts, Adina Williams, Douwe Kiela

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Dynabench: Rethinking Benchmarking in NLP.

Douwe Kiela, Max Bartolo, Yixin Nie, Divyansh Kaushik, Atticus Geiger, Zhengxuan Wu, Bertie Vidgen, Grusha Prasad, Amanpreet Singh, Pratik Ringshia, Zhiyi Ma, Tristan Thrush, Sebastian Riedel, Zeerak Waseem, Pontus Stenetorp, Robin Jia, Mohit Bansal, Christopher Potts, Adina Williams

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little.

Koustuv Sinha, Robin Jia, Dieuwke Hupkes, Joelle Pineau, Adina Williams, Douwe Kiela

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Sometimes We Want Ungrammatical Translations.

Prasanna Parthasarathi, Koustuv Sinha, Joelle Pineau, Adina Williams

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

Generalising to German Plural Noun Classes, from the Perspective of a Recurrent Neural Network.

Verna Dankers, Anna Langedijk, Kate McCurdy, Adina Williams, Dieuwke Hupkes

Proceedings of the 25th Conference on Computational Natural Language Learning, 2021

To what extent do human explanations of model behavior align with actual model behavior?

Grusha Prasad, Yixin Nie, Mohit Bansal, Robin Jia, Douwe Kiela, Adina Williams

Proceedings of the Fourth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP, 2021

UnNatural Language Inference.

Koustuv Sinha, Prasanna Parthasarathi, Joelle Pineau, Adina Williams

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

ANLIzing the Adversarial Natural Language Inference Dataset.

Adina Williams, Tristan Thrush, Douwe Kiela

CoRR, 2020

SIGMORPHON 2020 Shared Task 0: Typologically Diverse Morphological Inflection.

Ekaterina Vylomova, Jennifer C. White, Elizabeth Salesky, Sabrina J. Mielke, Shijie Wu, Edoardo Maria Ponti, Rowan Hall Maudslay, Ran Zmigrod, Josef Valvoda, Svetlana Toldova, Francis M. Tyers, Elena Klyachko, Ilya Yegorov, Natalia Krizhanovsky, Paula Czarnowska, Irene Nikkarinen, Andrew Krizhanovsky, Tiago Pimentel, Lucas Torroba Hennigen, Christo Kirov, Garrett Nicolai, Adina Williams, Antonios Anastasopoulos, Hilaria Cruz, Eleanor Chodroff, Ryan Cotterell, Miikka Silfverberg, Mans Hulden

Proceedings of the 17th SIGMORPHON Workshop on Computational Research in Phonetics, 2020

Pareto Probing: Trading Off Accuracy for Complexity.

Tiago Pimentel, Naomi Saphra, Adina Williams, Ryan Cotterell

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Measuring the Similarity of Grammatical Gender Systems by Comparing Partitions.

Arya D. McCarthy, Adina Williams, Shijia Liu, David Yarowsky, Ryan Cotterell

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Intrinsic Probing through Dimension Selection.

Lucas Torroba Hennigen, Adina Williams, Ryan Cotterell

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Multi-Dimensional Gender Bias Classification.

Emily Dinan, Angela Fan, Ledell Wu, Jason Weston, Douwe Kiela, Adina Williams

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Queens are Powerful too: Mitigating Gender Bias in Dialogue Generation.

Emily Dinan, Angela Fan, Adina Williams, Jack Urbanek, Douwe Kiela, Jason Weston

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Predicting Declension Class from Form and Meaning.

Adina Williams, Tiago Pimentel, Hagen Blix, Arya D. McCarthy, Eleanor Chodroff, Ryan Cotterell

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

Information-Theoretic Probing for Linguistic Structure.

Tiago Pimentel, Josef Valvoda, Rowan Hall Maudslay, Ran Zmigrod, Adina Williams, Ryan Cotterell

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

Adversarial NLI: A New Benchmark for Natural Language Understanding.

Yixin Nie, Adina Williams, Emily Dinan, Mohit Bansal, Jason Weston, Douwe Kiela

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

A Tale of a Probe and a Parser.

Rowan Hall Maudslay, Josef Valvoda, Tiago Pimentel, Adina Williams, Ryan Cotterell

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESupposition.

Paloma Jeretic, Alex Warstadt, Suvrat Bhooshan, Adina Williams

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

On the Idiosyncrasies of the Mandarin Chinese Classifier System.

Shijia Liu, Hongyuan Mei, Adina Williams, Ryan Cotterell

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Quantifying the Semantic Core of Gender Systems.

Adina Williams, Damián E. Blasi, Lawrence Wolf-Sonkin, Hanna M. Wallach, Ryan Cotterell

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

2018

Do latent tree learning models identify meaningful structure in sentences?

Adina Williams, Andrew Drozdov, Samuel R. Bowman

Trans. Assoc. Comput. Linguistics, 2018

Verb Argument Structure Alternations in Word and Sentence Embeddings.

Katharina Kann, Alex Warstadt, Adina Williams, Samuel R. Bowman

CoRR, 2018

A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference.

Adina Williams, Nikita Nangia, Samuel R. Bowman

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

XNLI: Evaluating Cross-lingual Sentence Representations.

Alexis Conneau, Ruty Rinott, Guillaume Lample, Adina Williams, Samuel R. Bowman, Holger Schwenk, Veselin Stoyanov

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

2017

Learning to parse from a semantic objective: It works. Is it syntax?

Adina Williams, Andrew Drozdov, Samuel R. Bowman

CoRR, 2017

The RepEval 2017 Shared Task: Multi-Genre Natural Language Inference with Sentence Representations.

Nikita Nangia, Adina Williams, Angeliki Lazaridou, Samuel R. Bowman

Proceedings of the 2nd Workshop on Evaluating Vector Space Representations for NLP, 2017