Alon Albalak

According to our database, Alon Albalak authored at least 22 papers between 2021 and 2024.

Collaborative distances:

• Dijkstra number of three.
• Erdős number of four.

2024

A Survey on Data Selection for Language Models.

Alon Albalak, Yanai Elazar, Sang Michael Xie, Shayne Longpre, Nathan Lambert, Xinyi Wang, Niklas Muennighoff, Bairu Hou, Liangming Pan, Haewon Jeong, Colin Raffel, Shiyu Chang, Tatsunori Hashimoto, William Yang Wang

Trans. Mach. Learn. Res., 2024

Generative Reward Models.

Dakota Mahan, Duy Phung, Rafael Rafailov, Chase Blagden, Nathan Lile, Louis Castricato, Jan-Philipp Fränken, Chelsea Finn, Alon Albalak

CoRR, 2024

Generalization v.s. Memorization: Tracing Language Models' Capabilities Back to Pretraining Data.

Antonis Antoniades, Xinyi Wang, Yanai Elazar, Alfonso Amayuelas, Alon Albalak, Kexun Zhang, William Yang Wang

CoRR, 2024

A Mathematical Framework, a Taxonomy of Modeling Paradigms, and a Suite of Learning Techniques for Neural-Symbolic Systems.

Charles Dickens, Connor Pryor, Changyu Gao, Alon Albalak, Eriq Augustine, William Yang Wang, Stephen J. Wright, Lise Getoor

CoRR, 2024

The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources.

Shayne Longpre, Stella Biderman, Alon Albalak, Hailey Schoelkopf, Daniel McDuff, Sayash Kapoor, Kevin Klyman, Kyle Lo, Gabriel Ilharco, Nay San, Maribeth Rauh, Aviya Skowron, Bertie Vidgen, Laura Weidinger, Arvind Narayanan, Victor Sanh, David Ifeoluwa Adelani, Percy Liang, Rishi Bommasani, Peter Henderson, Sasha Luccioni, Yacine Jernite, Luca Soldaini

CoRR, 2024

DataComp-LM: In search of the next generation of training sets for language models.

Jeffrey Li, Alex Fang, Georgios Smyrnis, Maor Ivgi, Matt Jordan, Samir Yitzhak Gadre, Hritik Bansal, Etash Kumar Guha, Sedrick Keh, Kushal Arora, Saurabh Garg, Rui Xin, Niklas Muennighoff, Reinhard Heckel, Jean Mercat, Mayee Chen, Suchin Gururangan, Mitchell Wortsman, Alon Albalak, Yonatan Bitton, Marianna Nezhurina, Amro Abbas, Cheng-Yu Hsieh, Dhruba Ghosh, Josh Gardner, Maciej Kilian, Hanlin Zhang, Rulin Shao, Sarah M. Pratt, Sunny Sanyal, Gabriel Ilharco, Giannis Daras, Kalyani Marathe, Aaron Gokaslan, Jieyu Zhang, Khyathi Raghavi Chandu, Thao Nguyen, Igor Vasiljevic, Sham M. Kakade, Shuran Song, Sujay Sanghavi, Fartash Faghri, Sewoong Oh, Luke Zettlemoyer, Kyle Lo, Alaaeldin El-Nouby, Hadi Pouransari, Alexander Toshev, Stephanie Wang, Dirk Groeneveld, Luca Soldaini, Pang Wei Koh, Jenia Jitsev, Thomas Kollar, Alexandros G. Dimakis, Yair Carmon, Achal Dave, Ludwig Schmidt, Vaishaal Shankar

CoRR, 2024

Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence.

Bo Peng, Daniel Goldstein, Quentin Anthony, Alon Albalak, Eric Alcaide, Stella Biderman, Eugene Cheah, Xingjian Du, Teddy Ferdinan, Haowen Hou, Przemyslaw Kazienko, Kranthi Kiran GV, Jan Kocon, Bartlomiej Koptyra, Satyapriya Krishna, Ronald McClelland Jr., Niklas Muennighoff, Fares Obeid, Atsushi Saito, Guangyu Song, Haoqin Tu, Stanislaw Wozniak, Ruichong Zhang, Bingchen Zhao, Qihang Zhao, Peng Zhou, Jian Zhu, Rui-Jie Zhu

CoRR, 2024

2023

Efficient Online Data Mixing For Language Model Pre-Training.

Alon Albalak, Liangming Pan, Colin Raffel, William Yang Wang

CoRR, 2023

RWKV: Reinventing RNNs for the Transformer Era.

Bo Peng, Eric Alcaide, Quentin Anthony, Alon Albalak, Samuel Arcadinho, Huanqi Cao, Xin Cheng, Michael Chung, Matteo Grella, Kranthi Kiran G. V., Xuzheng He, Haowen Hou, Przemyslaw Kazienko, Jan Kocon, Jiaming Kong, Bartlomiej Koptyra, Hayden Lau, Krishna Sri Ipsit Mantri, Ferdinand Mom, Atsushi Saito, Xiangru Tang, Bolun Wang, Johan S. Wind, Stanislaw Wozniak, Ruichong Zhang, Zhenyuan Zhang, Qihang Zhao, Peng Zhou, Jian Zhu, Rui-Jie Zhu

CoRR, 2023

Improving Few-Shot Generalization by Exploring and Exploiting Auxiliary Data.

Alon Albalak, Colin A. Raffel, William Yang Wang

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

NeuPSL: Neural Probabilistic Soft Logic.

Connor Pryor, Charles Dickens, Eriq Augustine, Alon Albalak, William Yang Wang, Lise Getoor

Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, 2023

RWKV: Reinventing RNNs for the Transformer Era.

Bo Peng, Eric Alcaide, Quentin Anthony, Alon Albalak, Samuel Arcadinho, Stella Biderman, Huanqi Cao, Xin Cheng, Michael Chung, Leon Derczynski, Xingjian Du, Matteo Grella, Kranthi Kiran GV, Xuzheng He, Haowen Hou, Przemyslaw Kazienko, Jan Kocon, Jiaming Kong, Bartlomiej Koptyra, Hayden Lau, Jiaju Lin, Krishna Sri Ipsit Mantri, Ferdinand Mom, Atsushi Saito, Guangyu Song, Xiangru Tang, Johan S. Wind, Stanislaw Wozniak, Zhenyuan Zhang, Qinghua Zhou, Jian Zhu, Rui-Jie Zhu

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning.

Liangming Pan, Alon Albalak, Xinyi Wang, William Yang Wang

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Addressing Issues of Cross-Linguality in Open-Retrieval Question Answering Systems For Emergent Domains.

Alon Albalak, Sharon Levy, William Yang Wang

Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics. EACL 2023, 2023

CausalDialogue: Modeling Utterance-level Causality in Conversations.

Yi-Lin Tuan, Alon Albalak, Wenda Xu, Michael Saxon, Connor Pryor, Lise Getoor, William Yang Wang

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

2022

An Exploration of Data Efficiency in Intra-Dataset Task Transfer for Dialog Understanding.

Josiah Ross, Luke Yoffe, Alon Albalak, William Yang Wang

CoRR, 2022

Data-Efficiency with a Single GPU: An Exploration of Transfer Methods for Small Language Models.

Alon Albalak, Akshat Shrivastava, Chinnadhurai Sankar, Adithya Sagar, Mike Ross

CoRR, 2022

Emotion Recognition in Conversation using Probabilistic Soft Logic.

Eriq Augustine, Pegah Jandaghi, Alon Albalak, Connor Pryor, Charles Dickens, William Yang Wang, Lise Getoor

CoRR, 2022

FETA: A Benchmark for Few-Sample Task Transfer in Open-Domain Dialogue.

Alon Albalak, Yi-Lin Tuan, Pegah Jandaghi, Connor Pryor, Luke Yoffe, Deepak Ramachandran, Lise Getoor, Jay Pujara, William Yang Wang

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

D-REX: Dialogue Relation Extraction with Explanations.

Alon Albalak, Varun Embar, Yi-Lin Tuan, Lise Getoor, William Yang Wang

Proceedings of the 4th Workshop on NLP for Conversational AI, 2022

2021

Dimensions of Transparency in NLP Applications.

Michael Saxon, Sharon Levy, Xinyi Wang, Alon Albalak, William Yang Wang

CoRR, 2021

Modeling Disclosive Transparency in NLP Application Descriptions.

Michael Saxon, Sharon Levy, Xinyi Wang, Alon Albalak, William Yang Wang

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021