Roy Schwartz

According to our database, Roy Schwartz authored at least 68 papers between 2011 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Morphosyntactic probing of multilingual BERT models.

Judit Ács, Endre Hamerlik, Roy Schwartz, Noah A. Smith, András Kornai

Nat. Lang. Eng., 2024

From Tokens to Words: On the Inner Lexicon of LLMs.

Guy Kaplan, Matanel Oren, Yuval Reif, Roy Schwartz

CoRR, 2024

Attend First, Consolidate Later: On the Importance of Attention in Different LLM Layers.

Amit Ben Artzy, Roy Schwartz

CoRR, 2024

What Can Natural Language Processing Do for Peer Review?

Ilia Kuznetsov, Osama Mohammed Afzal, Koen Dercksen, Nils Dycke, Alexander Goldberg, Tom Hope, Dirk Hovy, Jonathan K. Kummerfeld, Anne Lauscher, Kevin Leyton-Brown, Sheng Lu, Mausam, Margot Mieskes, Aurélie Névéol, Danish Pruthi, Lizhen Qu, Roy Schwartz, Noah A. Smith, Thamar Solorio, Jingyan Wang, Xiaodan Zhu, Anna Rogers, Nihar B. Shah, Iryna Gurevych

CoRR, 2024

Accelerating Speculative Decoding using Dynamic Speculation Length.

Jonathan Mamou, Oren Pereg, Daniel Korat, Moshe Berchansky, Nadav Timor, Moshe Wasserblat, Roy Schwartz

CoRR, 2024

The Larger the Better? Improved LLM Code-Generation via Budget Reallocation.

Michael Hassid, Tal Remez, Jonas Gehring, Roy Schwartz, Yossi Adi

CoRR, 2024

Transformers are Multi-State RNNs.

Matanel Oren, Michael Hassid, Yossi Adi, Roy Schwartz

CoRR, 2024

Beyond Performance: Quantifying and Mitigating Label Bias in LLMs.

Yuval Reif, Roy Schwartz

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

Transformers are Multi-State RNNs.

Matanel Oren, Michael Hassid, Yarden Nir, Yossi Adi, Roy Schwartz

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

2023

Efficient Methods for Natural Language Processing: A Survey.

Marcos V. Treviso, Ji-Ung Lee, Tianchu Ji, Betty van Aken, Qingqing Cao, Manuel R. Ciosici, Michael Hassid, Kenneth Heafield, Sara Hooker, Colin Raffel, Pedro Henrique Martins, André F. T. Martins, Jessica Zosa Forde, Peter A. Milder, Edwin Simpson, Noam Slonim, Jesse Dodge, Emma Strubell, Niranjan Balasubramanian, Leon Derczynski, Iryna Gurevych, Roy Schwartz

Trans. Assoc. Comput. Linguistics, 2023

Read, Look or Listen? What's Needed for Solving a Multimodal Dataset.

Netta Madvil, Yonatan Bitton, Roy Schwartz

CoRR, 2023

Surveying (Dis)Parities and Concerns of Compute Hungry NLP Research.

Ji-Ung Lee, Haritz Puerto, Betty van Aken, Yuki Arase, Jessica Zosa Forde, Leon Derczynski, Andreas Rücklé, Iryna Gurevych, Roy Schwartz, Emma Strubell, Jesse Dodge

CoRR, 2023

Textually Pretrained Speech Language Models.

Michael Hassid, Tal Remez, Tu Anh Nguyen, Itai Gat, Alexis Conneau, Felix Kreuk, Jade Copet, Alexandre Défossez, Gabriel Synnaeve, Emmanuel Dupoux, Roy Schwartz, Yossi Adi

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images.

Nitzan Bitton Guetta, Yonatan Bitton, Jack Hessel, Ludwig Schmidt, Yuval Elovici, Gabriel Stanovsky, Roy Schwartz

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Curating Datasets for Better Performance with Example Training Dynamics.

Aviad Sar-Shalom, Roy Schwartz

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

Finding the SWEET Spot: Analysis and Improvement of Adaptive Inference in Low Resource Settings.

Daniel Rotem, Michael Hassid, Jonathan Mamou, Roy Schwartz

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Fighting Bias With Bias: Promoting Model Robustness by Amplifying Dataset Biases.

Yuval Reif, Roy Schwartz

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

VASR: Visual Analogies of Situation Recognition.

Yonatan Bitton, Ron Yosef, Eliyahu Strugo, Dafna Shahaf, Roy Schwartz, Gabriel Stanovsky

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

Efficient and Equitable Natural Language Processing in the Age of Deep Learning (Dagstuhl Seminar 22232).

Jesse Dodge, Iryna Gurevych, Roy Schwartz, Emma Strubell, Betty van Aken

Dagstuhl Reports, 2022

Efficient Methods for Natural Language Processing: A Survey.

Marcos V. Treviso, Tianchu Ji, Ji-Ung Lee, Betty van Aken, Qingqing Cao, Manuel R. Ciosici, Michael Hassid, Kenneth Heafield, Sara Hooker, Pedro Henrique Martins, André F. T. Martins, Peter A. Milder, Colin Raffel, Edwin Simpson, Noam Slonim, Niranjan Balasubramanian, Leon Derczynski, Roy Schwartz

CoRR, 2022

Fewer Errors, but More Stereotypes? The Effect of Model Size on Gender Bias.

Yarden Tal, Inbal Magar, Roy Schwartz

CoRR, 2022

TangoBERT: Reducing Inference Cost by using Cascaded Architecture.

Jonathan Mamou, Oren Pereg, Moshe Wasserblat, Roy Schwartz

CoRR, 2022

WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models.

Yonatan Bitton, Nitzan Bitton Guetta, Ron Yosef, Yuval Elovici, Mohit Bansal, Gabriel Stanovsky, Roy Schwartz

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

On the Limitations of Dataset Balancing: The Lost Battle Against Spurious Correlations.

Roy Schwartz, Gabriel Stanovsky

Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2022, 2022

Measuring the Carbon Intensity of AI in Cloud Instances.

Jesse Dodge, Taylor Prewitt, Remi Tachet des Combes, Erika Odmark, Roy Schwartz, Emma Strubell, Alexandra Sasha Luccioni, Noah A. Smith, Nicole DeCario, Will Buchanan

Proceedings of the FAccT '22: 2022 ACM Conference on Fairness, Accountability, and Transparency, Seoul, Republic of Korea, June 21, 2022

How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers.

Michael Hassid, Hao Peng, Daniel Rotem, Jungo Kasai, Ivan Montero, Noah A. Smith, Roy Schwartz

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

ABC: Attention with Bounded-memory Control.

Hao Peng, Jungo Kasai, Nikolaos Pappas, Dani Yogatama, Zhaofeng Wu, Lingpeng Kong, Roy Schwartz, Noah A. Smith

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

Data Contamination: From Memorization to Exploitation.

Inbal Magar, Roy Schwartz

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2022

2021

Provable Limitations of Acquiring Meaning from Ungrounded Form: What Will Future Language Models Understand?

William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith

Trans. Assoc. Comput. Linguistics, 2021

On the Power of Saturated Transformers: A View from Circuit Complexity.

William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith

CoRR, 2021

Extracting a Knowledge Base of Mechanisms from COVID-19 Papers.

Tom Hope, Aida Amini, David Wadden, Madeleine van Zuylen, Sravanthi Parasa, Eric Horvitz, Daniel S. Weld, Roy Schwartz, Hannaneh Hajishirzi

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA.

Yonatan Bitton, Gabriel Stanovsky, Roy Schwartz, Michael Elhadad

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Random Feature Attention.

Hao Peng, Nikolaos Pappas, Dani Yogatama, Roy Schwartz, Noah A. Smith, Lingpeng Kong

Proceedings of the 9th International Conference on Learning Representations, 2021

Effects of Parameter Norm Growth During Transformer Training: Inductive Bias from Gradient Descent.

William Merrill, Vivek Ramanujan, Yoav Goldberg, Roy Schwartz, Noah A. Smith

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Expected Validation Performance and Estimation of a Random Variable's Maximum.

Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, Noah A. Smith

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

Data Efficient Masked Language Modeling for Vision and Language.

Yonatan Bitton, Michael Elhadad, Gabriel Stanovsky, Roy Schwartz

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

2020

Parameter Norm Growth During Training of Transformers.

William Merrill, Vivek Ramanujan, Yoav Goldberg, Roy Schwartz, Noah A. Smith

CoRR, 2020

Extracting a Knowledge Base of Mechanisms from COVID-19 Papers.

Aida Amini, Tom Hope, David Wadden, Madeleine van Zuylen, Eric Horvitz, Roy Schwartz, Hannaneh Hajishirzi

CoRR, 2020

Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping.

Jesse Dodge, Gabriel Ilharco, Roy Schwartz, Ali Farhadi, Hannaneh Hajishirzi, Noah A. Smith

CoRR, 2020

Green AI.

Roy Schwartz, Jesse Dodge, Noah A. Smith, Oren Etzioni

Commun. ACM, 2020

Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics.

Swabha Swayamdipta, Roy Schwartz, Nicholas Lourie, Yizhong Wang, Hannaneh Hajishirzi, Noah A. Smith, Yejin Choi

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

The Right Tool for the Job: Matching Model and Instance Complexities.

Roy Schwartz, Gabriel Stanovsky, Swabha Swayamdipta, Jesse Dodge, Noah A. Smith

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

A Mixture of h - 1 Heads is Better than h Heads.

Hao Peng, Roy Schwartz, Dianqi Li, Noah A. Smith

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

A Formal Hierarchy of RNN Architectures.

William Merrill, Gail Weiss, Yoav Goldberg, Roy Schwartz, Noah A. Smith, Eran Yahav

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

Inoculation by Fine-Tuning: A Method for Analyzing Challenge Datasets.

Nelson F. Liu, Roy Schwartz, Noah A. Smith

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Knowledge Enhanced Contextual Word Representations.

Matthew E. Peters, Mark Neumann, Robert L. Logan IV, Roy Schwartz, Vidur Joshi, Sameer Singh, Noah A. Smith

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

PaLM: A Hybrid Parser and Language Model.

Hao Peng, Roy Schwartz, Noah A. Smith

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

RNN Architecture Learning with Sparse Regularization.

Jesse Dodge, Roy Schwartz, Hao Peng, Noah A. Smith

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

Show Your Work: Improved Reporting of Experimental Results.

Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, Noah A. Smith

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

2018

SoPa: Bridging CNNs, RNNs, and Weighted Finite-State Machines.

Roy Schwartz, Sam Thomson, Noah A. Smith

CoRR, 2018

LSTMs Exploit Linguistic Attributes of Data.

Nelson F. Liu, Omer Levy, Roy Schwartz, Chenhao Tan, Noah A. Smith

Proceedings of The Third Workshop on Representation Learning for NLP, 2018

A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applications.

Dongyeop Kang, Waleed Ammar, Bhavana Dalvi, Madeleine van Zuylen, Sebastian Kohlmeier, Eduard H. Hovy, Roy Schwartz

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

Annotation Artifacts in Natural Language Inference Data.

Suchin Gururangan, Swabha Swayamdipta, Omer Levy, Roy Schwartz, Samuel R. Bowman, Noah A. Smith

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference.

Rowan Zellers, Yonatan Bisk, Roy Schwartz, Yejin Choi

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

Rational Recurrences.

Hao Peng, Roy Schwartz, Sam Thomson, Noah A. Smith

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

Bridging CNNs, RNNs, and Weighted Finite-State Machines.

Roy Schwartz, Sam Thomson, Noah A. Smith

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

2017

Story Cloze Task: UW NLP System.

Roy Schwartz, Maarten Sap, Ioannis Konstas, Leila Zilles, Yejin Choi, Noah A. Smith

Proceedings of the 2nd Workshop on Linking Models of Lexical, 2017

Automatic Selection of Context Configurations for Improved Class-Specific Word Representations.

Ivan Vulic, Roy Schwartz, Ari Rappoport, Roi Reichart, Anna Korhonen

Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), 2017

The Effect of Different Writing Tasks on Linguistic Style: A Case Study of the ROC Story Cloze Task.

Roy Schwartz, Maarten Sap, Ioannis Konstas, Leila Zilles, Yejin Choi, Noah A. Smith

Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), 2017

2016

Pattern-Based methods for Improved Lexical Semantics and Word Embeddings (שער נוסף בעברית: : שיטות מבוססות תבניות לשיפור סמנטיקה לקסיקלית ושיכוני מילים.).

Roy Schwartz

PhD thesis, 2016

Automatic Selection of Context Configurations for Improved (and Fast) Class-Specific Word Representations.

Ivan Vulic, Roy Schwartz, Ari Rappoport, Roi Reichart, Anna Korhonen

CoRR, 2016

Symmetric Patterns and Coordinations: Fast and Enhanced Representations of Verbs and Adjectives.

Roy Schwartz, Roi Reichart, Ari Rappoport

Proceedings of the NAACL HLT 2016, 2016

2015

Symmetric Pattern Based Word Embeddings for Improved Word Similarity Prediction.

Roy Schwartz, Roi Reichart, Ari Rappoport

Proceedings of the 19th Conference on Computational Natural Language Learning, 2015

How Well Do Distributional Models Capture Different Types of Semantic Knowledge?

Dana Rubinstein, Effi Levi, Roy Schwartz, Ari Rappoport

Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, 2015

2014

Minimally Supervised Classification to Semantic Categories using Automatically Acquired Symmetric Patterns.

Roy Schwartz, Roi Reichart, Ari Rappoport

Proceedings of the COLING 2014, 2014

2013

Authorship Attribution of Micro-Messages.

Roy Schwartz, Oren Tsur, Ari Rappoport, Moshe Koppel

Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, 2013

2012

Learnability-Based Syntactic Annotation Design.

Roy Schwartz, Omri Abend, Ari Rappoport

Proceedings of the COLING 2012, 2012

2011

Neutralizing Linguistically Problematic Annotations in Unsupervised Dependency Parsing Evaluation.

Roy Schwartz, Omri Abend, Roi Reichart, Ari Rappoport

Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, 2011