William Merrill

According to our database, William Merrill authored at least 42 papers between 2001 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

What Formal Languages Can Transformers Express? A Survey.

Lena Strobl, William Merrill, Gail Weiss, David Chiang, Dana Angluin

Trans. Assoc. Comput. Linguistics, 2024

Let's Think Dot by Dot: Hidden Computation in Transformer Language Models.

Jacob Pfau, William Merrill, Samuel R. Bowman

CoRR, 2024

OLMo: Accelerating the Science of Language Models.

Dirk Groeneveld, Iz Beltagy, Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi

CoRR, 2024

How Language Model Hallucinations Can Snowball.

Muru Zhang, Ofir Press, William Merrill, Alisa Liu, Noah A. Smith

Proceedings of the Forty-first International Conference on Machine Learning, 2024

The Illusion of State in State-Space Models.

William Merrill, Jackson Petty, Ashish Sabharwal

Proceedings of the Forty-first International Conference on Machine Learning, 2024

The Expressive Power of Transformers with Chain of Thought.

William Merrill, Ashish Sabharwal

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Evaluating n-Gram Novelty of Language Models Using Rusty-DAWG.

William Merrill, Noah A. Smith, Yanai Elazar

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Can You Learn Semantics Through Next-Word Prediction? The Case of Entailment.

William Merrill, Zhaofeng Wu, Norihito Naka, Yoon Kim, Tal Linzen

Proceedings of the Findings of the Association for Computational Linguistics, 2024

OLMo: Accelerating the Science of Language Models.

Dirk Groeneveld, Iz Beltagy, Evan Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

Transparency Helps Reveal When Language Models Learn Meaning.

Zhaofeng Wu, William Merrill, Hao Peng, Iz Beltagy, Noah A. Smith

Trans. Assoc. Comput. Linguistics, 2023

The Parallelism Tradeoff: Limitations of Log-Precision Transformers.

William Merrill, Ashish Sabharwal

Trans. Assoc. Comput. Linguistics, 2023

Transformers as Recognizers of Formal Languages: A Survey on Expressivity.

Lena Strobl, William Merrill, Gail Weiss, David Chiang, Dana Angluin

CoRR, 2023

A Tale of Two Circuits: Grokking as Competition of Sparse and Dense Subnetworks.

William Merrill, Nikolaos Tsilivis, Aman Shukla

CoRR, 2023

A Logic for Expressing Log-Precision Transformers.

William Merrill, Ashish Sabharwal

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Formal languages and neural models for learning on sequences.

William Merrill

Proceedings of the International Conference on Grammatical Inference, 2023

Formal Languages and the NLP Black Box.

William Merrill

Proceedings of the Developments in Language Theory - 27th International Conference, 2023

2022

Saturated Transformers are Constant-Depth Threshold Circuits.

William Merrill, Ashish Sabharwal, Noah A. Smith

Trans. Assoc. Comput. Linguistics, 2022

Transformers Implement First-Order Logic with Majority Quantifiers.

William Merrill, Ashish Sabharwal

CoRR, 2022

Log-Precision Transformers are Constant-Depth Uniform Threshold Circuits.

William Merrill, Ashish Sabharwal

CoRR, 2022

Extracting Finite Automata from RNNs Using State Merging.

William Merrill, Nikolaos Tsilivis

CoRR, 2022

Entailment Semantics Can Be Extracted from an Ideal Language Model.

William Merrill, Alex Warstadt, Tal Linzen

Proceedings of the 26th Conference on Computational Natural Language Learning, 2022

ReCLIP: A Strong Zero-Shot Baseline for Referring Expression Comprehension.

Sanjay Subramanian, William Merrill, Trevor Darrell, Matt Gardner, Sameer Singh, Anna Rohrbach

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021

Provable Limitations of Acquiring Meaning from Ungrounded Form: What Will Future Language Models Understand?

William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith

Trans. Assoc. Comput. Linguistics, 2021

On the Power of Saturated Transformers: A View from Circuit Complexity.

William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith

CoRR, 2021

Formal Language Theory Meets Modern NLP.

William Merrill

CoRR, 2021

Effects of Parameter Norm Growth During Transformer Training: Inductive Bias from Gradient Descent.

William Merrill, Vivek Ramanujan, Yoav Goldberg, Roy Schwartz, Noah A. Smith

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Competency Problems: On Finding and Removing Artifacts in Language Data.

Matt Gardner, William Merrill, Jesse Dodge, Matthew E. Peters, Alexis Ross, Sameer Singh, Noah A. Smith

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

2020

Parameter Norm Growth During Training of Transformers.

William Merrill, Vivek Ramanujan, Yoav Goldberg, Roy Schwartz, Noah A. Smith

CoRR, 2020

CORD-19: The Covid-19 Open Research Dataset.

Lucy Lu Wang, Kyle Lo, Yoganand Chandrasekhar, Russell Reas, Jiangjiang Yang, Darrin Eide, Kathryn Funk, Rodney Kinney, Ziyang Liu, William Merrill, Paul Mooney, Dewey A. Murdick, Devvret Rishi, Jerry Sheehan, Zhihong Shen, Brandon Stilson, Alex D. Wade, Kuansan Wang, Chris Wilhelm, Boya Xie, Douglas Raymond, Daniel S. Weld, Oren Etzioni, Sebastian Kohlmeier

CoRR, 2020

On the Linguistic Capacity of Real-Time Counter Automata.

William Merrill

CoRR, 2020

A Formal Hierarchy of RNN Architectures.

William Merrill, Gail Weiss, Yoav Goldberg, Roy Schwartz, Noah A. Smith, Eran Yahav

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

Sequential Neural Networks as Automata.

William Merrill

CoRR, 2019

Finding Syntactic Representations in Neural Stacks.

William Merrill, Lenny Khazan, Noah Amsel, Yiding Hao, Simon Mendelsohn, Robert Frank

CoRR, 2019

Finding Hierarchical Structure in Neural Stacks Using Unsupervised Parsing.

William Merrill, Lenny Khazan, Noah Amsel, Yiding Hao, Simon Mendelsohn, Robert Frank

Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, 2019

Detecting Syntactic Change Using a Neural Part-of-Speech Tagger.

William Merrill, Gigi Felice Stark, Robert Frank

Proceedings of the 1st International Workshop on Computational Approaches to Historical Language Change, 2019

2018

End-to-End Graph-Based TAG Parsing with Neural Networks.

Jungo Kasai, Robert Frank, Pauli Xu, William Merrill, Owen Rambow

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

Context-Free Transductions with Neural Stacks.

Yiding Hao, William Merrill, Dana Angluin, Robert Frank, Noah Amsel, Andrew Benz, Simon Mendelsohn

Proceedings of the Workshop: Analyzing and Interpreting Neural Networks for NLP, 2018

Using Machine Learning to Understand Transfer from First Language to Second Language.

Tiwalayo Eisape, William Merrill, Joshua K. Hartshorne, Sven Dietz

Proceedings of the 40th Annual Meeting of the Cognitive Science Society, 2018

2010

Where is the return on investment in wireless sensor networks?

William Merrill

IEEE Wirel. Commun., 2010

2004

Methods for Scalable Self-Assembly of Ad Hoc Wireless Sensor Networks.

Katayoun Sohrabi, William Merrill, Jeremy Elson, Lewis Girod, Fredric Newberg, William J. Kaiser

IEEE Trans. Mob. Comput., 2004

Dynamic Networking and Smart Sensing Enable Next-Generation Landmines.

William Merrill, Lewis Girod, Brian Schiffer, Dustin McIntire, Guillaume Rava, Katayoun Sohrabi, Fredric Newberg, Jeremy Elson, William J. Kaiser

IEEE Pervasive Comput., 2004

2001

Preserving and Protecting the Freedom to Learn Online.

William Merrill

Proceedings of WebNet 2001, 2001