Anej Svete

According to our database, Anej Svete authored at least 21 papers between 2020 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Can Transformers Learn <i>n</i>-gram Language Models?

Anej Svete, Nadav Borenstein, Mike Zhou, Isabelle Augenstein, Ryan Cotterell

CoRR, 2024

A Fundamental Trade-off in Aligned Language Models and its Relation to Sampling Adaptors.

Naaman Tan, Josef Valvoda, Anej Svete, Tianyu Liu, Yanxia Qin, Min-Yen Kan, Ryan Cotterell

CoRR, 2024

What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages.

Nadav Borenstein, Anej Svete, Robin Shing Moon Chan, Josef Valvoda, Franz Nowak, Isabelle Augenstein, Eleanor Chodroff, Ryan Cotterell

CoRR, 2024

On Affine Homotopy between Language Encoders.

Robin Chan, Reda Boumasmoud, Anej Svete, Yuxin Ren, Qipeng Guo, Zhijing Jin, Shauli Ravfogel, Mrinmaya Sachan, Bernhard Schölkopf, Mennatallah El-Assady, Ryan Cotterell

CoRR, 2024

Transformers Can Represent <i>n</i>-gram Language Models.

Anej Svete, Ryan Cotterell

CoRR, 2024

A Theoretical Result on the Inductive Bias of RNN Language Models.

Anej Svete, Robin Shing Moon Chan, Ryan Cotterell

CoRR, 2024

Lower Bounds on the Expressivity of Recurrent Neural Language Models.

Anej Svete, Franz Nowak, Anisha Mohamed Sahabdeen, Ryan Cotterell

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

Transformers Can Represent n-gram Language Models.

Anej Svete, Ryan Cotterell

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

The Role of n-gram Smoothing in the Age of Neural Networks.

Luca Malagutti, Andrius Buinovskij, Anej Svete, Clara Meister, Afra Amini, Ryan Cotterell

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

A Probability-Quality Trade-off in Aligned Language Models and its Relation to Sampling Adaptors.

Naaman Tan, Josef Valvoda, Tianyu Liu, Anej Svete, Yanxia Qin, Min-Yen Kan, Ryan Cotterell

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Can Transformers Learn n-gram Language Models?

Anej Svete, Nadav Borenstein, Mike Zhou, Isabelle Augenstein, Ryan Cotterell

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

An L* Algorithm for Deterministic Weighted Regular Languages.

Clemente Pasti, Talu Karagöz, Franz Nowak, Anej Svete, Reda Boumasmoud, Ryan Cotterell

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

On Efficiently Representing Regular Languages as RNNs.

Anej Svete, Robin Chan, Ryan Cotterell

Proceedings of the Findings of the Association for Computational Linguistics, 2024

On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning.

Franz Nowak, Anej Svete, Alexandra Butoi, Ryan Cotterell

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages.

Nadav Borenstein, Anej Svete, Robin Chan, Josef Valvoda, Franz Nowak, Isabelle Augenstein, Eleanor Chodroff, Ryan Cotterell

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

Formal Aspects of Language Modeling.

Ryan Cotterell, Anej Svete, Clara Meister, Tianyu Liu, Li Du

CoRR, 2023

A Geometric Notion of Causal Probing.

Clément Guerner, Anej Svete, Tianyu Liu, Alexander Warstadt, Ryan Cotterell

CoRR, 2023

Recurrent Neural Language Models as Probabilistic Finite-state Automata.

Anej Svete, Ryan Cotterell

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

On the Representational Capacity of Recurrent Neural Language Models.

Franz Nowak, Anej Svete, Li Du, Ryan Cotterell

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

2022

Algorithms for Acyclic Weighted Finite-State Automata with Failure Arcs.

Anej Svete, Benjamin Dayan, Ryan Cotterell, Tim Vieira, Jason Eisner

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

2020

It is not just about the Melody: How Europe Votes for its Favorite Songs.

Anej Svete, Jakob Hostnik

CoRR, 2020