Valentina Pyatkin

According to our database, Valentina Pyatkin authored at least 36 papers between 2017 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Hybrid Preferences: Learning to Route Instances for Human vs. AI Feedback.

Lester James V. Miranda, Yizhong Wang, Yanai Elazar, Sachin Kumar, Valentina Pyatkin, Faeze Brahman, Noah A. Smith, Hannaneh Hajishirzi, Pradeep Dasigi

CoRR, 2024

SafetyAnalyst: Interpretable, transparent, and steerable LLM safety moderation.

Jing-Jing Li, Valentina Pyatkin, Max Kleiman-Weiner, Liwei Jiang, Nouha Dziri, Anne G. E. Collins, Jana Schaich Borg, Maarten Sap, Yejin Choi, Sydney Levine

CoRR, 2024

Diverging Preferences: When do Annotators Disagree and do Models Know?

Michael J. Q. Zhang, Zhilin Wang, Jena D. Hwang, Yi Dong, Olivier Delalleau, Yejin Choi, Eunsol Choi, Xiang Ren, Valentina Pyatkin

CoRR, 2024

Self-Directed Synthetic Dialogues and Revisions Technical Report.

Nathan Lambert, Hailey Schoelkopf, Aaron Gokaslan, Luca Soldaini, Valentina Pyatkin, Louis Castricato

CoRR, 2024

The Art of Saying No: Contextual Noncompliance in Language Models.

Faeze Brahman, Sachin Kumar, Vidhisha Balachandran, Pradeep Dasigi, Valentina Pyatkin, Abhilasha Ravichander, Sarah Wiegreffe, Nouha Dziri, Khyathi Raghavi Chandu, Jack Hessel, Yulia Tsvetkov, Noah A. Smith, Yejin Choi, Hannaneh Hajishirzi

CoRR, 2024

Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback.

Hamish Ivison, Yizhong Wang, Jiacheng Liu, Zeqiu Wu, Valentina Pyatkin, Nathan Lambert, Noah A. Smith, Yejin Choi, Hannaneh Hajishirzi

CoRR, 2024

WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild.

Bill Yuchen Lin, Yuntian Deng, Khyathi Raghavi Chandu, Faeze Brahman, Abhilasha Ravichander, Valentina Pyatkin, Nouha Dziri, Ronan Le Bras, Yejin Choi

CoRR, 2024

Superlatives in Context: Explicit and Implicit Domain Restrictions for Superlative Frames.

Valentina Pyatkin, Bonnie Webber, Ido Dagan, Reut Tsarfaty

CoRR, 2024

RewardBench: Evaluating Reward Models for Language Modeling.

Nathan Lambert, Valentina Pyatkin, Jacob Morrison, LJ Miranda, Bill Yuchen Lin, Khyathi Raghavi Chandu, Nouha Dziri, Sachin Kumar, Tom Zick, Yejin Choi, Noah A. Smith, Hannaneh Hajishirzi

CoRR, 2024

OLMo: Accelerating the Science of Language Models.

Dirk Groeneveld, Iz Beltagy, Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi

CoRR, 2024

Promptly Predicting Structures: The Return of Inference.

Maitrey Mehta, Valentina Pyatkin, Vivek Srikumar

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

Phenomenal Yet Puzzling: Testing Inductive Reasoning Capabilities of Language Models with Hypothesis Refinement.

Linlu Qiu, Liwei Jiang, Ximing Lu, Melanie Sclar, Valentina Pyatkin, Chandra Bhagavatula, Bailin Wang, Yoon Kim, Yejin Choi, Nouha Dziri, Xiang Ren

Proceedings of the Twelfth International Conference on Learning Representations, 2024

PlaSma: Procedural Knowledge Models for Language-based Planning and Re-Planning.

Faeze Brahman, Chandra Bhagavatula, Valentina Pyatkin, Jena D. Hwang, Xiang Lorraine Li, Hirona Jacqueline Arai, Soumya Sanyal, Keisuke Sakaguchi, Xiang Ren, Yejin Choi

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models.

Paul Röttger, Valentin Hofmann, Valentina Pyatkin, Musashi Hinck, Hannah Kirk, Hinrich Schütze, Dirk Hovy

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

Explicating the Implicit: Argument Detection Beyond Sentence Boundaries.

Paul Roit, Aviv Slobodkin, Eran Hirsch, Arie Cattan, Ayal Klein, Valentina Pyatkin, Ido Dagan

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

OLMo: Accelerating the Science of Language Models.

Dirk Groeneveld, Iz Beltagy, Evan Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Duties.

Taylor Sorensen, Liwei Jiang, Jena D. Hwang, Sydney Levine, Valentina Pyatkin, Peter West, Nouha Dziri, Ximing Lu, Kavel Rao, Chandra Bhagavatula, Maarten Sap, John Tasioulas, Yejin Choi

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

2023

Design Choices for Crowdsourcing Implicit Discourse Relations: Revealing the Biases Introduced by Task Design.

Valentina Pyatkin, Frances Yung, Merel C. J. Scholman, Reut Tsarfaty, Ido Dagan, Vera Demberg

Trans. Assoc. Comput. Linguistics, 2023

Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2.

Hamish Ivison, Yizhong Wang, Valentina Pyatkin, Nathan Lambert, Matthew E. Peters, Pradeep Dasigi, Joel Jang, David Wadden, Noah A. Smith, Iz Beltagy, Hannaneh Hajishirzi

CoRR, 2023

PlaSma: Making Small Language Models Better Procedural Knowledge Models for (Counterfactual) Planning.

Faeze Brahman, Chandra Bhagavatula, Valentina Pyatkin, Jena D. Hwang, Xiang Lorraine Li, Hirona Jacqueline Arai, Soumya Sanyal, Keisuke Sakaguchi, Xiang Ren, Yejin Choi

CoRR, 2023

Retrieving Texts based on Abstract Descriptions.

Shauli Ravfogel, Valentina Pyatkin, Amir David Nissan Cohen, Avshalom Manevich, Yoav Goldberg

CoRR, 2023

What Makes it Ok to Set a Fire? Iterative Self-distillation of Contexts and Rationales for Disambiguating Defeasible Social and Moral Situations.

Kavel Rao, Liwei Jiang, Valentina Pyatkin, Yuling Gu, Niket Tandon, Nouha Dziri, Faeze Brahman, Yejin Choi

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

"You Are An Expert Linguistic Annotator": Limits of LLMs as Analyzers of Abstract Meaning Representation.

Allyson Ettinger, Jena D. Hwang, Valentina Pyatkin, Chandra Bhagavatula, Yejin Choi

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

ClarifyDelphi: Reinforced Clarification Questions with Defeasibility Rewards for Social and Moral Situations.

Valentina Pyatkin, Jena D. Hwang, Vivek Srikumar, Ximing Lu, Liwei Jiang, Yejin Choi, Chandra Bhagavatula

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Revisiting Sentence Union Generation as a Testbed for Text Consolidation.

Eran Hirsch, Valentina Pyatkin, Ruben Wolhandler, Avi Caciularu, Asi Shefer, Ido Dagan

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

2022

Draw Me a Flower: Processing and Grounding Abstraction in Natural Language.

Royi Lachmy, Valentina Pyatkin, Avshalom Manevich, Reut Tsarfaty

Trans. Assoc. Comput. Linguistics, 2022

Reinforced Clarification Question Generation with Defeasibility Rewards for Disambiguating Social and Moral Situations.

Valentina Pyatkin, Jena D. Hwang, Vivek Srikumar, Ximing Lu, Liwei Jiang, Yejin Choi, Chandra Bhagavatula

CoRR, 2022

Just-DREAM-about-it: Figurative Language Understanding with DREAM-FLUTE.

Yuling Gu, Yao Fu, Valentina Pyatkin, Ian Magnusson, Bhavana Dalvi Mishra, Peter Clark

CoRR, 2022

Design Choices in Crowdsourcing Discourse Relation Annotations: The Effect of Worker Selection and Training.

Merel C. J. Scholman, Valentina Pyatkin, Frances Yung, Ido Dagan, Reut Tsarfaty, Vera Demberg

Proceedings of the Thirteenth Language Resources and Evaluation Conference, 2022

QASem Parsing: Text-to-text Modeling of QA-based Semantics.

Ayal Klein, Eran Hirsch, Ron Eliav, Valentina Pyatkin, Avi Caciularu, Ido Dagan

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

2021

Draw Me a Flower: Grounding Formal Abstract Structures Stated in Informal Natural Language.

Royi Lachmy, Valentina Pyatkin, Reut Tsarfaty

CoRR, 2021

Asking It All: Generating Contextualized Questions for any Semantic Role.

Valentina Pyatkin, Paul Roit, Julian Michael, Yoav Goldberg, Reut Tsarfaty, Ido Dagan

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

The Possible, the Plausible, and the Desirable: Event-Based Modality Detection for Language Processing.

Valentina Pyatkin, Shoval Sadde, Aynat Rubinstein, Paul Portner, Reut Tsarfaty

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

QADiscourse - Discourse Relations as QA Pairs: Representation, Crowdsourcing and Baselines.

Valentina Pyatkin, Ayal Klein, Reut Tsarfaty, Ido Dagan

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

QANom: Question-Answer driven SRL for Nominalizations.

Ayal Klein, Jonathan Mamou, Valentina Pyatkin, Daniela Stepanov, Hangfeng He, Dan Roth, Luke Zettlemoyer, Ido Dagan

Proceedings of the 28th International Conference on Computational Linguistics, 2020

2017

Discourse Relations and Conjoined VPs: Automated Sense Recognition.

Valentina Pyatkin, Bonnie Webber

Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, 2017