Naomi Saphra

According to our database, Naomi Saphra authored at least 37 papers between 2013 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Sometimes I am a Tree: Data Drives Unstable Hierarchical Generalization.

Tian Qin, Naomi Saphra, David Alvarez-Melis

CoRR, 2024

Mechanistic?

Naomi Saphra, Sarah Wiegreffe

CoRR, 2024

Benchmarks as Microscopes: A Call for Model Metrology.

Michael Saxon, Ari Holtzman, Peter West, William Yang Wang, Naomi Saphra

CoRR, 2024

Recite, Reconstruct, Recollect: Memorization in LMs as a Multifaceted Phenomenon.

USVSN Sai Prashanth, Alvin Deng, Kyle O'Brien, Jyothir S. V, Mohammad Aflah Khan, Jaydeep Borkar, Christopher A. Choquette-Choo, Jacob Ray Fuehne, Stella Biderman, Tracy Ke, Katherine Lee, Naomi Saphra

CoRR, 2024

Transcendence: Generative Models Can Outperform The Experts That Train Them.

Edwin Zhang, Vincent Zhu, Naomi Saphra, Anat Kleiman, Benjamin L. Edelman, Milind Tambe, Sham M. Kakade, Eran Malach

CoRR, 2024

Knowing Your Nonlinearities: Shapley Interactions Reveal the Underlying Structure of Data.

Divyansh Singhvi, Andrej Erkelens, Raghav Jain, Diganta Misra, Naomi Saphra

CoRR, 2024

First Tragedy, then Parse: History Repeats Itself in the New Era of Large Language Models.

Naomi Saphra, Eve Fleisig, Kyunghyun Cho, Adam Lopez

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

TRAM: Bridging Trust Regions and Sharpness Aware Minimization.

Tom Sherborne, Naomi Saphra, Pradeep Dasigi, Hao Peng

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs.

Angelica Chen, Ravid Shwartz-Ziv, Kyunghyun Cho, Matthew L. Leavitt, Naomi Saphra

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Fast Forwarding Low-Rank Training.

Adir Rahamim, Naomi Saphra, Sara Kangaslahti, Yonatan Belinkov

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

ChatGPT Doesn't Trust Chargers Fans: Guardrail Sensitivity in Context.

Victoria R. Li, Yida Chen, Naomi Saphra

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Attribute Diversity Determines the Systematicity Gap in VQA.

Ian Berlot-Attwell, Kumar Krishna Agrawal, Annabelle Michael Carrell, Yash Sharma, Naomi Saphra

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Dynamic Masking Rate Schedules for MLM Pretraining.

Zachary Ankner, Naomi Saphra, Davis W. Blalock, Jonathan Frankle, Matthew L. Leavitt

Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics, 2024

2023

A taxonomy and review of generalization research in NLP.

Dieuwke Hupkes, Mario Giulianelli, Verna Dankers, Mikel Artetxe, Yanai Elazar, Tiago Pimentel, Christos E. Christodoulopoulos, Karim Lasri, Naomi Saphra, Arabella Sinclair, Dennis Ulmer, Florian Schottmann, Khuyagbaatar Batsuren, Kaiser Sun, Koustuv Sinha, Leila Khalatbari, Maria Ryskina, Rita Frieske, Ryan Cotterell, Zhijing Jin

Nat. Mac. Intell., October, 2023

Latent State Models of Training Dynamics.

Michael Y. Hu, Angelica Chen, Naomi Saphra, Kyunghyun Cho

Trans. Mach. Learn. Res., 2023

Towards out-of-distribution generalization in large-scale astronomical surveys: robust networks learn similar representations.

Yash Gondhalekar, Sultan Hassan, Naomi Saphra, Sambatra Andrianomena

CoRR, 2023

Linear Connectivity Reveals Generalization Strategies.

Jeevesh Juneja, Rachit Bansal, Kyunghyun Cho, João Sedoc, Naomi Saphra

Proceedings of the Eleventh International Conference on Learning Representations, 2023

2022

One Venue, Two Conferences: The Separation of Chinese and American Citation Networks.

Bingchen Zhao, Yuling Gu, Jessica Zosa Forde, Naomi Saphra

CoRR, 2022

State-of-the-art generalisation research in NLP: a taxonomy and review.

Dieuwke Hupkes, Mario Giulianelli, Verna Dankers, Mikel Artetxe, Yanai Elazar, Tiago Pimentel, Christos Christodoulopoulos, Karim Lasri, Naomi Saphra, Arabella Sinclair, Dennis Ulmer, Florian Schottmann, Khuyagbaatar Batsuren, Kaiser Sun, Koustuv Sinha, Leila Khalatbari, Maria Ryskina, Rita Frieske, Ryan Cotterell, Zhijing Jin

CoRR, 2022

Learning Transductions to Test Systematic Compositionality.

Josef Valvoda, Naomi Saphra, Jonathan Rawski, Ryan Cotterell, Adina Williams

CoRR, 2022

The MultiBERTs: BERT Reproductions for Robustness Analysis.

Thibault Sellam, Steve Yadlowsky, Ian Tenney, Jason Wei, Naomi Saphra, Alexander D'Amour, Tal Linzen, Jasmijn Bastings, Iulia Raluca Turc, Jacob Eisenstein, Dipanjan Das, Ellie Pavlick

Proceedings of the Tenth International Conference on Learning Representations, 2022

Benchmarking Compositionality with Formal Languages.

Josef Valvoda, Naomi Saphra, Jonathan Rawski, Adina Williams, Ryan Cotterell

Proceedings of the 29th International Conference on Computational Linguistics, 2022

2021

A Non-Linear Structural Probe.

Jennifer C. White, Tiago Pimentel, Naomi Saphra, Ryan Cotterell

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

2020

Word Interdependence Exposes How LSTMs Compose Representations.

Naomi Saphra, Adam Lopez

CoRR, 2020

LSTMS Compose - and Learn - Bottom-Up.

Naomi Saphra, Adam Lopez

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020

Pareto Probing: Trading Off Accuracy for Complexity.

Tiago Pimentel, Naomi Saphra, Adina Williams, Ryan Cotterell

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Understanding Privacy-Related Questions on Stack Overflow.

Mohammad Tahaei, Kami Vaniea, Naomi Saphra

Proceedings of the CHI '20: CHI Conference on Human Factors in Computing Systems, 2020

2019

How to Evaluate Word Representations of Informal Domain?

Yekun Chai, Naomi Saphra, Adam Lopez

CoRR, 2019

Sparsity Emerges Naturally in Neural Language Models.

Naomi Saphra, Adam Lopez

CoRR, 2019

Understanding Learning Dynamics Of Language Models with SVCCA.

Naomi Saphra, Adam Lopez

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

2018

Language Models Learn POS First.

Naomi Saphra, Adam Lopez

Proceedings of the Workshop: Analyzing and Interpreting Neural Networks for NLP, 2018

2017

DyNet: The Dynamic Neural Network Toolkit.

Graham Neubig, Chris Dyer, Yoav Goldberg, Austin Matthews, Waleed Ammar, Antonios Anastasopoulos, Miguel Ballesteros, David Chiang, Daniel Clothiaux, Trevor Cohn, Kevin Duh, Manaal Faruqui, Cynthia Gan, Dan Garrette, Yangfeng Ji, Lingpeng Kong, Adhiguna Kuncoro, Gaurav Kumar, Chaitanya Malaviya, Paul Michel, Yusuke Oda, Matthew Richardson, Naomi Saphra, Swabha Swayamdipta, Pengcheng Yin

CoRR, 2017

2016

Evaluating Informal-Domain Word Representations With UrbanDictionary.

Naomi Saphra, Adam Lopez

CoRR, 2016

Evaluating Informal-Domain Word Representations With UrbanDictionary.

Naomi Saphra

Proceedings of the 1st Workshop on Evaluating Vector-Space Representations for NLP, 2016

2015

AMRICA: an AMR Inspector for Cross-language Alignments.

Naomi Saphra, Adam Lopez

Proceedings of the NAACL HLT 2015, The 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Denver, Colorado, USA, May 31, 2015

2014

Understanding Objects in Detail with Fine-Grained Attributes.

Andrea Vedaldi, Siddharth Mahendran, Stavros Tsogkas, Subhransu Maji, Ross B. Girshick, Juho Kannala, Esa Rahtu, Iasonas Kokkinos, Matthew B. Blaschko, David J. Weiss, Ben Taskar, Karen Simonyan, Naomi Saphra, Sammy Mohamed

Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, 2014

2013

A Framework for (Under)specifying Dependency Syntax without Overloading Annotators.

Nathan Schneider, Brendan O'Connor, Naomi Saphra, David Bamman, Manaal Faruqui, Noah A. Smith, Chris Dyer, Jason Baldridge

Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse, 2013