Omer Levy

According to our database, Omer Levy authored at least 91 papers between 2012 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Keep Guessing? When Considering Inference Scaling, Mind the Baselines.

Gal Yona, Or Honovich, Omer Levy, Roee Aharoni

CoRR, 2024

Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model.

Chunting Zhou, Lili Yu, Arun Babu, Kushal Tirumala, Michihiro Yasunaga, Leonid Shamis, Jacob Kahn, Xuezhe Ma, Luke Zettlemoyer, Omer Levy

CoRR, 2024

Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length.

Xuezhe Ma, Xiaomeng Yang, Wenhan Xiong, Beidi Chen, Lili Yu, Hao Zhang, Jonathan May, Luke Zettlemoyer, Omer Levy, Chunting Zhou

CoRR, 2024

Branch-Solve-Merge Improves Large Language Model Evaluation and Generation.

Swarnadeep Saha, Omer Levy, Asli Celikyilmaz, Mohit Bansal, Jason Weston, Xian Li

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

Self-Alignment with Instruction Backtranslation.

Xian Li, Ping Yu, Chunting Zhou, Timo Schick, Omer Levy, Luke Zettlemoyer, Jason Weston, Mike Lewis

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Altogether: Image Captioning via Re-aligning Alt-text.

Hu Xu, Po-Yao Huang, Xiaoqing Ellen Tan, Ching-Feng Yeh, Jacob Kahn, Christine Jou, Gargi Ghosh, Omer Levy, Luke Zettlemoyer, Wen-tau Yih, Shang-Wen Li, Saining Xie, Christoph Feichtenhofer

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

2023

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models.

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang, Alicia Parrish, Allen Nie, Aman Hussain, Amanda Askell, Amanda Dsouza, Ambrose Slone, Ameet Rahane, Anantharaman S. Iyer, Anders Andreassen, Andrea Madotto, Andrea Santilli, Andreas Stuhlmüller, Andrew M. Dai, Andrew La, Andrew K. Lampinen, Andy Zou, Angela Jiang, Angelica Chen, Anh Vuong, Animesh Gupta, Anna Gottardi, Antonio Norelli, Anu Venkatesh, Arash Gholamidavoodi, Arfa Tabassum, Arul Menezes, Arun Kirubarajan, Asher Mullokandov, Ashish Sabharwal, Austin Herrick, Avia Efrat, Aykut Erdem, Ayla Karakas, B. Ryan Roberts, Bao Sheng Loe, Barret Zoph, Bartlomiej Bojanowski, Batuhan Özyurt, Behnam Hedayatnia, Behnam Neyshabur, Benjamin Inden, Benno Stein, Berk Ekmekci, Bill Yuchen Lin, Blake Howald, Bryan Orinion, Cameron Diao, Cameron Dour, Catherine Stinson, Cedrick Argueta, Cèsar Ferri Ramírez, Chandan Singh, Charles Rathkopf, Chenlin Meng, Chitta Baral, Chiyu Wu, Chris Callison-Burch, Chris Waites, Christian Voigt, Christopher D. Manning, Christopher Potts, Cindy Ramirez, Clara E. Rivera, Clemencia Siro, Colin Raffel, Courtney Ashcraft, Cristina Garbacea, Damien Sileo, Dan Garrette, Dan Hendrycks, Dan Kilman, Dan Roth, Daniel Freeman, Daniel Khashabi, Daniel Levy, Daniel Moseguí González, Danielle Perszyk, Danny Hernandez, Danqi Chen, Daphne Ippolito, Dar Gilboa, David Dohan, David Drakard, David Jurgens, Debajyoti Datta, Deep Ganguli, Denis Emelin, Denis Kleyko, Deniz Yuret, Derek Chen, Derek Tam, Dieuwke Hupkes, Diganta Misra, Dilyar Buzan, Dimitri Coelho Mollo, Diyi Yang, Dong-Ho Lee, Dylan Schrader, Ekaterina Shutova, Ekin Dogus Cubuk, Elad Segal, Eleanor Hagerman, Elizabeth Barnes, Elizabeth Donoway, Ellie Pavlick, Emanuele Rodolà, Emma Lam, Eric Chu, Eric Tang, Erkut Erdem, Ernie Chang, Ethan A. Chi, Ethan Dyer, Ethan J. Jerzak, Ethan Kim, Eunice Engefu Manyasi, Evgenii Zheltonozhskii, Fanyue Xia, Fatemeh Siar, Fernando Martínez-Plumed, Francesca Happé, François Chollet, Frieda Rong, Gaurav Mishra, Genta Indra Winata, Gerard de Melo, Germán Kruszewski, Giambattista Parascandolo, Giorgio Mariani, Gloria Wang, Gonzalo Jaimovitch-López, Gregor Betz, Guy Gur-Ari, Hana Galijasevic, Hannah Kim, Hannah Rashkin, Hannaneh Hajishirzi, Harsh Mehta, Hayden Bogar, Henry Shevlin, Hinrich Schütze, Hiromu Yakura, Hongming Zhang, Hugh Mee Wong, Ian Ng, Isaac Noble, Jaap Jumelet, Jack Geissinger, Jackson Kernion, Jacob Hilton, Jaehoon Lee, Jaime Fernández Fisac, James B. Simon, James Koppel, James Zheng, James Zou, Jan Kocon, Jana Thompson, Janelle Wingfield, Jared Kaplan, Jarema Radom, Jascha Sohl-Dickstein, Jason Phang, Jason Wei, Jason Yosinski, Jekaterina Novikova, Jelle Bosscher, Jennifer Marsh, Jeremy Kim, Jeroen Taal, Jesse H. Engel, Jesujoba Alabi, Jiacheng Xu, Jiaming Song, Jillian Tang, Joan Waweru, John Burden, John Miller, John U. Balis, Jonathan Batchelder, Jonathan Berant, Jörg Frohberg, Jos Rozen, José Hernández-Orallo, Joseph Boudeman, Joseph Guerr, Joseph Jones, Joshua B. Tenenbaum, Joshua S. Rule, Joyce Chua, Kamil Kanclerz, Karen Livescu, Karl Krauth, Karthik Gopalakrishnan, Katerina Ignatyeva, Katja Markert, Kaustubh D. Dhole, Kevin Gimpel, Kevin Omondi, Kory Mathewson, Kristen Chiafullo, Ksenia Shkaruta, Kumar Shridhar, Kyle McDonell, Kyle Richardson, Laria Reynolds, Leo Gao, Li Zhang, Liam Dugan, Lianhui Qin, Lidia Contreras Ochando, Louis-Philippe Morency, Luca Moschella, Lucas Lam, Lucy Noble, Ludwig Schmidt, Luheng He, Luis Oliveros Colón, Luke Metz, Lütfi Kerem Senel, Maarten Bosma, Maarten Sap, Maartje ter Hoeve, Maheen Farooqi, Manaal Faruqui, Mantas Mazeika, Marco Baturan, Marco Marelli, Marco Maru, María José Ramírez-Quintana, Marie Tolkiehn, Mario Giulianelli, Martha Lewis, Martin Potthast, Matthew L. Leavitt, Matthias Hagen, Mátyás Schubert, Medina Baitemirova, Melody Arnaud, Melvin McElrath, Michael A. Yee, Michael Cohen, Michael Gu, Michael I. Ivanitskiy, Michael Starritt, Michael Strube, Michal Swedrowski, Michele Bevilacqua, Michihiro Yasunaga, Mihir Kale, Mike Cain, Mimee Xu, Mirac Suzgun, Mitch Walker, Mo Tiwari, Mohit Bansal, Moin Aminnaseri, Mor Geva, Mozhdeh Gheini, Mukund Varma T., Nanyun Peng, Nathan A. Chi, Nayeon Lee, Neta Gur-Ari Krakover, Nicholas Cameron, Nicholas Roberts, Nick Doiron, Nicole Martinez, Nikita Nangia, Niklas Deckers, Niklas Muennighoff, Nitish Shirish Keskar, Niveditha Iyer, Noah Constant, Noah Fiedel, Nuan Wen, Oliver Zhang, Omar Agha, Omar Elbaghdadi, Omer Levy, Owain Evans, Pablo Antonio Moreno Casares, Parth Doshi, Pascale Fung, Paul Pu Liang, Paul Vicol, Pegah Alipoormolabashi, Peiyuan Liao, Percy Liang, Peter Chang, Peter Eckersley, Phu Mon Htut, Pinyu Hwang, Piotr Milkowski, Piyush Patil, Pouya Pezeshkpour, Priti Oli, Qiaozhu Mei, Qing Lyu, Qinlang Chen, Rabin Banjade, Rachel Etta Rudolph, Raefer Gabriel, Rahel Habacker, Ramon Risco, Raphaël Millière, Rhythm Garg, Richard Barnes, Rif A. Saurous, Riku Arakawa, Robbe Raymaekers, Robert Frank, Rohan Sikand, Roman Novak, Roman Sitelew, Ronan LeBras, Rosanne Liu, Rowan Jacobs, Rui Zhang, Ruslan Salakhutdinov, Ryan Chi, Ryan Lee, Ryan Stovall, Ryan Teehan, Rylan Yang, Sahib Singh, Saif M. Mohammad, Sajant Anand, Sam Dillavou, Sam Shleifer, Sam Wiseman, Samuel Gruetter, Samuel R. Bowman, Samuel S. Schoenholz, Sanghyun Han, Sanjeev Kwatra, Sarah A. Rous, Sarik Ghazarian, Sayan Ghosh, Sean Casey, Sebastian Bischoff, Sebastian Gehrmann, Sebastian Schuster, Sepideh Sadeghi, Shadi Hamdan, Sharon Zhou, Shashank Srivastava, Sherry Shi, Shikhar Singh, Shima Asaadi, Shixiang Shane Gu, Shubh Pachchigar, Shubham Toshniwal, Shyam Upadhyay, Shyamolima (Shammie) Debnath, Siamak Shakeri, Simon Thormeyer, Simone Melzi, Siva Reddy, Sneha Priscilla Makini, Soo-Hwan Lee, Spencer Torene, Sriharsha Hatwar, Stanislas Dehaene, Stefan Divic, Stefano Ermon, Stella Biderman, Stephanie Lin, Stephen Prasad, Steven T. Piantadosi, Stuart M. Shieber, Summer Misherghi, Svetlana Kiritchenko, Swaroop Mishra, Tal Linzen, Tal Schuster, Tao Li, Tao Yu, Tariq Ali, Tatsu Hashimoto, Te-Lin Wu, Théo Desbordes, Theodore Rothschild, Thomas Phan, Tianle Wang, Tiberius Nkinyili, Timo Schick, Timofei Kornev, Titus Tunduny, Tobias Gerstenberg, Trenton Chang, Trishala Neeraj, Tushar Khot, Tyler Shultz, Uri Shaham, Vedant Misra, Vera Demberg, Victoria Nyamai, Vikas Raunak, Vinay V. Ramasesh, Vinay Uday Prabhu, Vishakh Padmakumar, Vivek Srikumar, William Fedus, William Saunders, William Zhang, Wout Vossen, Xiang Ren, Xiaoyu Tong, Xinran Zhao, Xinyi Wu, Xudong Shen, Yadollah Yaghoobzadeh, Yair Lakretz, Yangqiu Song, Yasaman Bahri, Yejin Choi, Yichi Yang, Yiding Hao, Yifu Chen, Yonatan Belinkov, Yu Hou, Yufang Hou, Yuntao Bai, Zachary Seid, Zhuoye Zhao, Zijian Wang, Zijie J. Wang, Zirui Wang, Ziyi Wu

Trans. Mach. Learn. Res., 2023

The Temporal Structure of Language Processing in the Human Brain Corresponds to The Layered Hierarchy of Deep Language Models.

Ariel Goldstein, Eric Ham, Mariano Schain, Samuel A. Nastase, Zaid Zada, Avigail Dabush, Bobbi Aubrey, Harshvardhan Gazula, Amir Feder, Werner K. Doyle, Sasha Devore, Patricia Dugan, Daniel Friedman, Roi Reichart, Michael P. Brenner, Avinatan Hassidim, Orrin Devinsky, Adeen Flinker, Omer Levy, Uri Hasson

CoRR, 2023

X&Fuse: Fusing Visual Information in Text-to-Image Generation.

Yuval Kirstain, Omer Levy, Adam Polyak

CoRR, 2023

LIMA: Less Is More for Alignment.

Chunting Zhou, Pengfei Liu, Puxin Xu, Srinivasan Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, Lili Yu, Susan Zhang, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer, Omer Levy

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation.

Yuval Kirstain, Adam Polyak, Uriel Singer, Shahbuland Matiana, Joe Penna, Omer Levy

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Scaling Laws for Generative Mixed-Modal Language Models.

Armen Aghajanyan, Lili Yu, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer

Proceedings of the International Conference on Machine Learning, 2023

ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding.

Uri Shaham, Maor Ivgi, Avia Efrat, Jonathan Berant, Omer Levy

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Vision Transformers with Mixed-Resolution Tokenization.

Tomer Ronen, Omer Levy, Avram Golbert

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor.

Or Honovich, Thomas Scialom, Omer Levy, Timo Schick

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Instruction Induction: From Few Examples to Natural Language Task Descriptions.

Or Honovich, Uri Shaham, Samuel R. Bowman, Omer Levy

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

LMentry: A Language Model Benchmark of Elementary Language Tasks.

Avia Efrat, Or Honovich, Omer Levy

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

Causes and Cures for Interference in Multilingual Translation.

Uri Shaham, Maha Elbayad, Vedanuj Goswami, Omer Levy, Shruti Bhosale

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

A Simple Baseline for Beam Search Reranking.

Lior Vassertail, Omer Levy

CoRR, 2022

Breaking Character: Are Subwords Good Enough for MRLs After All?

Omri Keren, Tal Avinari, Reut Tsarfaty, Omer Levy

CoRR, 2022

Are Mutually Intelligible Languages Easier to Translate?

Avital Friedland, Jonathan Zeltser, Omer Levy

CoRR, 2022

Simple Local Attentions Remain Competitive for Long-Context Tasks.

Wenhan Xiong, Barlas Oguz, Anchit Gupta, Xilun Chen, Diana Liskovich, Omer Levy, Scott Yih, Yashar Mehdad

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Learning to Retrieve Passages without Supervision.

Ori Ram, Gal Shachaf, Omer Levy, Jonathan Berant, Amir Globerson

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Models In a Spelling Bee: Language Models Implicitly Learn the Character Composition of Tokens.

Itay Itzhak, Omer Levy

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

A Few More Examples May Be Worth Billions of Parameters.

Yuval Kirstain, Patrick S. H. Lewis, Sebastian Riedel, Omer Levy

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Transformer Language Models without Positional Encodings Still Learn Positional Information.

Adi Haviv, Ori Ram, Ofir Press, Peter Izsak, Omer Levy

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

SCROLLS: Standardized CompaRison Over Long Language Sequences.

Uri Shaham, Elad Segal, Maor Ivgi, Avia Efrat, Ori Yoran, Adi Haviv, Ankit Gupta, Wenhan Xiong, Mor Geva, Jonathan Berant, Omer Levy

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

How Optimal is Greedy Decoding for Extractive Question Answering?

Or Castel, Ori Ram, Avia Efrat, Omer Levy

Proceedings of the 4th Conference on Automated Knowledge Base Construction, 2022

What Do You Get When You Cross Beam Search with Nucleus Sampling?

Uri Shaham, Omer Levy

Proceedings of the Third Workshop on Insights from Negative Results in NLP, 2022

2021

Understanding large-scale software systems - structure and flows.

Omer Levy, Dror G. Feitelson

Empir. Softw. Eng., 2021

ParaShoot: A Hebrew Question Answering Dataset.

Omri Keren, Omer Levy

CoRR, 2021

Neural Machine Translation without Embeddings.

Uri Shaham, Omer Levy

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Can Latent Alignments Improve Autoregressive Machine Translation?

Adi Haviv, Lior Vassertail, Omer Levy

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

How to Train BERT with an Academic Budget.

Peter Izsak, Moshe Berchansky, Omer Levy

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Transformer Feed-Forward Layers Are Key-Value Memories.

Mor Geva, Roei Schuster, Jonathan Berant, Omer Levy

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Cryptonite: A Cryptic Crossword Benchmark for Extreme Ambiguity in Language.

Avia Efrat, Uri Shaham, Dan Kilman, Omer Levy

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Few-Shot Question Answering by Pretraining Span Selection.

Ori Ram, Yuval Kirstain, Jonathan Berant, Amir Globerson, Omer Levy

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

Coreference Resolution without Span Representations.

Yuval Kirstain, Ori Ram, Omer Levy

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

SpanBERT: Improving Pre-training by Representing and Predicting Spans.

Mandar Joshi, Danqi Chen, Yinhan Liu, Daniel S. Weld, Luke Zettlemoyer, Omer Levy

Trans. Assoc. Comput. Linguistics, 2020

Emergent linguistic structure in artificial neural networks trained by self-supervision.

Christopher D. Manning, Kevin Clark, John Hewitt, Urvashi Khandelwal, Omer Levy

Proc. Natl. Acad. Sci. USA, 2020

The Turking Test: Can Language Models Understand Instructions?

Avia Efrat, Omer Levy

CoRR, 2020

Semi-Autoregressive Training Improves Mask-Predict Decoding.

Marjan Ghazvininejad, Omer Levy, Luke Zettlemoyer

CoRR, 2020

Aligned Cross Entropy for Non-Autoregressive Machine Translation.

Marjan Ghazvininejad, Vladimir Karpukhin, Luke Zettlemoyer, Omer Levy

Proceedings of the 37th International Conference on Machine Learning, 2020

Structural Language Models of Code.

Uri Alon, Roy Sadaka, Omer Levy, Eran Yahav

Proceedings of the 37th International Conference on Machine Learning, 2020

Generalization through Memorization: Nearest Neighbor Language Models.

Urvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer, Mike Lewis

Proceedings of the 8th International Conference on Learning Representations, 2020

Blockwise Self-Attention for Long Document Understanding.

Jiezhong Qiu, Hao Ma, Omer Levy, Wen-tau Yih, Sinong Wang, Jie Tang

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020

Improving Transformer Models by Reordering their Sublayers.

Ofir Press, Noah A. Smith, Omer Levy

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension.

Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, Luke Zettlemoyer

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

code2vec: learning distributed representations of code.

Uri Alon, Meital Zilberstein, Omer Levy, Eran Yahav

Proc. ACM Program. Lang., 2019

Structural Language Models for Any-Code Generation.

Uri Alon, Roy Sadaka, Omer Levy, Eran Yahav

CoRR, 2019

RoBERTa: A Robustly Optimized BERT Pretraining Approach.

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, Veselin Stoyanov

CoRR, 2019

Constant-Time Machine Translation with Conditional Masked Language Models.

Marjan Ghazvininejad, Omer Levy, Yinhan Liu, Luke Zettlemoyer

CoRR, 2019

SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems.

Alex Wang, Yada Pruksachatkun, Nikita Nangia, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, Samuel R. Bowman

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Are Sixteen Heads Really Better than One?

Paul Michel, Omer Levy, Graham Neubig

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

pair2vec: Compositional Word-Pair Embeddings for Cross-Sentence Inference.

Mandar Joshi, Eunsol Choi, Omer Levy, Daniel S. Weld, Luke Zettlemoyer

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Understanding large-scale software: a hierarchical view.

Omer Levy, Dror G. Feitelson

Proceedings of the 27th International Conference on Program Comprehension, 2019

code2seq: Generating Sequences from Structured Representations of Code.

Uri Alon, Shaked Brody, Omer Levy, Eran Yahav

Proceedings of the 7th International Conference on Learning Representations, 2019

BERT for Coreference Resolution: Baselines and Analysis.

Mandar Joshi, Omer Levy, Luke Zettlemoyer, Daniel S. Weld

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

Mask-Predict: Parallel Decoding of Conditional Masked Language Models.

Marjan Ghazvininejad, Omer Levy, Yinhan Liu, Luke Zettlemoyer

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

What Does BERT Look at? An Analysis of BERT's Attention.

Kevin Clark, Urvashi Khandelwal, Omer Levy, Christopher D. Manning

Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, 2019

Training on Synthetic Noise Improves Robustness to Natural Noise in Machine Translation.

Vladimir Karpukhin, Omer Levy, Jacob Eisenstein, Marjan Ghazvininejad

Proceedings of the 5th Workshop on Noisy User-generated Text, 2019

2018

code2seq: Generating Sequences from Structured Representations of Code.

Uri Alon, Omer Levy, Eran Yahav

CoRR, 2018

LSTMs Exploit Linguistic Attributes of Data.

Nelson F. Liu, Omer Levy, Roy Schwartz, Chenhao Tan, Noah A. Smith

Proceedings of The Third Workshop on Representation Learning for NLP, 2018

A general path-based representation for predicting program properties.

Uri Alon, Meital Zilberstein, Omer Levy, Eran Yahav

Proceedings of the 39th ACM SIGPLAN Conference on Programming Language Design and Implementation, 2018

Annotation Artifacts in Natural Language Inference Data.

Suchin Gururangan, Swabha Swayamdipta, Omer Levy, Roy Schwartz, Samuel R. Bowman, Noah A. Smith

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

Simulating Action Dynamics with Neural Process Networks.

Antoine Bosselut, Omer Levy, Ari Holtzman, Corin Ennis, Dieter Fox, Yejin Choi

Proceedings of the 6th International Conference on Learning Representations, 2018

GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding.

Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, Samuel R. Bowman

Proceedings of the Workshop: Analyzing and Interpreting Neural Networks for NLP, 2018

Ultra-Fine Entity Typing.

Eunsol Choi, Omer Levy, Yejin Choi, Luke Zettlemoyer

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

Long Short-Term Memory as a Dynamically Computed Element-wise Weighted Sum.

Omer Levy, Kenton Lee, Nicholas FitzGerald, Luke Zettlemoyer

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling.

Luheng He, Kenton Lee, Omer Levy, Luke Zettlemoyer

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

Deep RNNs Encode Soft Hierarchical Syntax.

Terra Blevins, Omer Levy, Luke Zettlemoyer

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

2017

Recurrent Additive Networks.

Kenton Lee, Omer Levy, Luke Zettlemoyer

CoRR, 2017

A Strong Baseline for Learning Cross-Lingual Word Embeddings from Sentence Alignments.

Omer Levy, Anders Søgaard, Yoav Goldberg

Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, 2017

Zero-Shot Relation Extraction via Reading Comprehension.

Omer Levy, Minjoon Seo, Eunsol Choi, Luke Zettlemoyer

Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), 2017

Named Entity Disambiguation for Noisy Text.

Yotam Eshel, Noam Cohen, Kira Radinsky, Shaul Markovitch, Ikuya Yamada, Omer Levy

Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), 2017

2016

Reconsidering Cross-lingual Word Embeddings.

Omer Levy, Anders Søgaard, Yoav Goldberg

CoRR, 2016

Modeling Extractive Sentence Intersection via Subtree Entailment.

Omer Levy, Ido Dagan, Gabriel Stanovsky, Judith Eckle-Kohler, Iryna Gurevych

Proceedings of the COLING 2016, 2016

Annotating Relation Inference in Context via Question Answering.

Omer Levy, Ido Dagan

Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, 2016

2015

Improving Distributional Similarity with Lessons Learned from Word Embeddings.

Omer Levy, Yoav Goldberg, Ido Dagan

Trans. Assoc. Comput. Linguistics, 2015

A Simple Word Embedding Model for Lexical Substitution.

Oren Melamud, Omer Levy, Ido Dagan

Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing, 2015

Do Supervised Distributional Methods Really Learn Lexical Inference Relations?

Omer Levy, Steffen Remus, Chris Biemann, Ido Dagan

Proceedings of the NAACL HLT 2015, The 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Denver, Colorado, USA, May 31, 2015

Learning to Exploit Structured Resources for Lexical Inference.

Vered Shwartz, Omer Levy, Ido Dagan, Jacob Goldberger

Proceedings of the 19th Conference on Computational Natural Language Learning, 2015

2014

word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding method.

Yoav Goldberg, Omer Levy

CoRR, 2014

Neural Word Embedding as Implicit Matrix Factorization.

Omer Levy, Yoav Goldberg

Proceedings of the Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems 2014, 2014

Linguistic Regularities in Sparse and Explicit Word Representations.

Omer Levy, Yoav Goldberg

Proceedings of the Eighteenth Conference on Computational Natural Language Learning, 2014

Focused Entailment Graphs for Open IE Propositions.

Omer Levy, Ido Dagan, Jacob Goldberger

Proceedings of the Eighteenth Conference on Computational Natural Language Learning, 2014

The Excitement Open Platform for Textual Inferences.

Bernardo Magnini, Roberto Zanoli, Ido Dagan, Kathrin Eichler, Guenter Neumann, Tae-Gil Noh, Sebastian Padó, Asher Stern, Omer Levy

Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014

Dependency-Based Word Embeddings.

Omer Levy, Yoav Goldberg

Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014

2013

UKP-BIU: Similarity and Entailment Metrics for Student Response Analysis.

Omer Levy, Torsten Zesch, Ido Dagan, Iryna Gurevych

Proceedings of the 7th International Workshop on Semantic Evaluation, 2013

Recognizing Partial Textual Entailment.

Omer Levy, Torsten Zesch, Ido Dagan, Iryna Gurevych

Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, 2013

2012

Teaching Machines to Learn by Metaphors.

Omer Levy, Shaul Markovitch

Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, 2012