Yonatan Bisk

According to our database, Yonatan Bisk authored at least 107 papers between 2010 and 2024.

Collaborative distances:

• Dijkstra number of three.
• Erdős number of three.

2024

ANAVI: Audio Noise Awareness using Visuals of Indoor environments for NAVIgation.

Vidhi Jain, Rishi Veerapaneni, Yonatan Bisk

CoRR, 2024

Embodied-RAG: General non-parametric Embodied Memory for Retrieval and Generation.

Quanting Xie, So Yeon Min, Tianyi Zhang, Aarav Bajaj, Ruslan Salakhutdinov, Matthew Johnson-Roberson, Yonatan Bisk

CoRR, 2024

MotIF: Motion Instruction Fine-tuning.

Minyoung Hwang, Joey Hejna, Dorsa Sadigh, Yonatan Bisk

CoRR, 2024

DegustaBot: Zero-Shot Visual Preference Estimation for Personalized Multi-Object Rearrangement.

Benjamin A. Newman, Pranay Gupta, Kris Kitani, Yonatan Bisk, Henny Admoni, Christopher Jason Paxton

CoRR, 2024

Towards Open-World Mobile Manipulation in Homes: Lessons from the Neurips 2023 HomeRobot Open Vocabulary Mobile Manipulation Challenge.

Sriram Yenamandra, Arun Ramachandran, Mukul Khanna, Karmesh Yadav, Jay Vakil, Andrew Melnik, Michael Büttner, Leon Harz, Lyon Brown, Gora Chand Nandi, Arjun P. S, Gaurav Kumar Yadav, Rahul Kala, Robert Haschke, Yang Luo, Jinxin Zhu, Yansen Han, Bingyi Lu, Xuan Gu, Qinyuan Liu, Yaping Zhao, Qiting Ye, Chenxiao Dou, Yansong Chua, Volodymyr Kuzma, Vladyslav Humennyy, Ruslan Partsey, Jonathan Francis, Devendra Singh Chaplot, Gunjan Chhablani, Alexander Clegg, Théophile Gervet, Vidhi Jain, Ram Ramrakhya, Andrew Szot, Austin S. Wang, Tsung-Yen Yang, Aaron Edsinger, Charles C. Kemp, Binit Shah, Zsolt Kira, Dhruv Batra, Roozbeh Mottaghi, Yonatan Bisk, Chris Paxton

CoRR, 2024

DiffusionPID: Interpreting Diffusion via Partial Information Decomposition.

Shaurya Dewan, Rushikesh Zawar, Prakanshul Saxena, Yingshan Chang, Andrew Luo, Yonatan Bisk

CoRR, 2024

Language Models Need Inductive Biases to Count Inductively.

Yingshan Chang, Yonatan Bisk

CoRR, 2024

AgentKit: Flow Engineering with Graphs, not Coding.

Yue Wu, Yewen Fan, So Yeon Min, Shrimai Prabhumoye, Stephen McAleer, Yonatan Bisk, Ruslan Salakhutdinov, Yuanzhi Li, Tom M. Mitchell

CoRR, 2024

Direct Preference Optimization of Video Large Multimodal Models from Language Model Reward.

Ruohong Zhang, Liangke Gui, Zhiqing Sun, Yihao Feng, Keyang Xu, Yuanhan Zhang, Di Fu, Chunyuan Li, Alexander Hauptmann, Yonatan Bisk, Yiming Yang

CoRR, 2024

Dialogue with Robots: Proposals for Broadening Participation and Research in the SLIVAR Community.

Casey Kennington, Malihe Alikhani, Heather Pon-Barry, Katherine Atwell, Yonatan Bisk, Daniel Fried, Felix Gervits, Zhao Han, Mert Inan, Michael Johnston, Raj Korpan, Diane J. Litman, Matthew Marge, Cynthia Matuszek, Ross Mead, Shiwali Mohan, Raymond J. Mooney, Natalie Parde, Jivko Sinapov, Angela Stewart, Matthew Stone, Stefanie Tellex, Tom Williams

CoRR, 2024

Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformers.

Vidhi Jain, Maria Attarian, Nikhil J. Joshi, Ayzaan Wahid, Danny Driess, Quan Vuong, Pannag R. Sanketi, Pierre Sermanet, Stefan Welker, Christine Chan, Igor Gilitschenski, Yonatan Bisk, Debidatta Dwibedi

CoRR, 2024

MOSAIC: Learning Unified Multi-Sensory Object Property Representations for Robot Learning via Interactive Perception.

Gyan Tatiya, Jonathan Francis, Ho-Hsiang Wu, Yonatan Bisk, Jivko Sinapov

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

Open X-Embodiment: Robotic Learning Datasets and RT-X Models : Open X-Embodiment Collaboration.

Abby O'Neill, Abdul Rehman, Abhiram Maddukuri, Abhishek Gupta, Abhishek Padalkar, Abraham Lee, Acorn Pooley, Agrim Gupta, Ajay Mandlekar, Ajinkya Jain, Albert Tung, Alex Bewley, Alexander Herzog, Alex Irpan, Alexander Khazatsky, Anant Rai, Anchit Gupta, Andrew Wang, Anikait Singh, Animesh Garg, Aniruddha Kembhavi, Annie Xie, Anthony Brohan, Antonin Raffin, Archit Sharma, Arefeh Yavary, Arhan Jain, Ashwin Balakrishna, Ayzaan Wahid, Ben Burgess-Limerick, Beomjoon Kim, Bernhard Schölkopf, Blake Wulfe, Brian Ichter, Cewu Lu, Charles Xu, Charlotte Le, Chelsea Finn, Chen Wang, Chenfeng Xu, Cheng Chi, Chenguang Huang, Christine Chan, Christopher Agia, Chuer Pan, Chuyuan Fu, Coline Devin, Danfei Xu, Daniel Morton, Danny Driess, Daphne Chen, Deepak Pathak, Dhruv Shah, Dieter Büchler, Dinesh Jayaraman, Dmitry Kalashnikov, Dorsa Sadigh, Edward Johns, Ethan Paul Foster, Fangchen Liu, Federico Ceola, Fei Xia, Feiyu Zhao, Freek Stulp, Gaoyue Zhou, Gaurav S. Sukhatme, Gautam Salhotra, Ge Yan, Gilbert Feng, Giulio Schiavi, Glen Berseth, Gregory Kahn, Guanzhi Wang, Hao Su, Haoshu Fang, Haochen Shi, Henghui Bao, Heni Ben Amor, Henrik I. Christensen, Hiroki Furuta, Homer Walke, Hongjie Fang, Huy Ha, Igor Mordatch, Ilija Radosavovic, Isabel Leal, Jacky Liang, Jad Abou-Chakra, Jaehyung Kim, Jaimyn Drake, Jan Peters, Jan Schneider, Jasmine Hsu, Jeannette Bohg, Jeffrey Bingham, Jeffrey Wu, Jensen Gao, Jiaheng Hu, Jiajun Wu, Jialin Wu, Jiankai Sun, Jianlan Luo, Jiayuan Gu, Jie Tan, Jihoon Oh, Jimmy Wu, Jingpei Lu, Jingyun Yang, Jitendra Malik, João Silvério, Joey Hejna, Jonathan Booher, Jonathan Tompson, Jonathan Yang, Jordi Salvador, Joseph J. Lim, Junhyek Han, Kaiyuan Wang, Kanishka Rao, Karl Pertsch, Karol Hausman, Keegan Go, Keerthana Gopalakrishnan, Ken Goldberg, Kendra Byrne, Kenneth Oslund, Kento Kawaharazuka, Kevin Black, Kevin Lin, Kevin Zhang, Kiana Ehsani, Kiran Lekkala, Kirsty Ellis, Krishan Rana, Krishnan Srinivasan, Kuan Fang, Kunal Pratap Singh, Kuo-Hao Zeng, Kyle Hatch, Kyle Hsu, Laurent Itti, Lawrence Yunliang Chen, Lerrel Pinto, Li Fei-Fei, Liam Tan, Linxi Jim Fan, Lionel Ott, Lisa Lee, Luca Weihs, Magnum Chen, Marion Lepert, Marius Memmel, Masayoshi Tomizuka, Masha Itkina, Mateo Guaman Castro, Max Spero, Maximilian Du, Michael Ahn, Michael C. Yip, Mingtong Zhang, Mingyu Ding, Minho Heo, Mohan Kumar Srirama, Mohit Sharma, Moo Jin Kim, Naoaki Kanazawa, Nicklas Hansen, Nicolas Heess, Nikhil J. Joshi, Niko Sünderhauf, Ning Liu, Norman Di Palo, Nur Muhammad (Mahi) Shafiullah, Oier Mees, Oliver Kroemer, Osbert Bastani, Pannag R. Sanketi, Patrick Tree Miller, Patrick Yin, Paul Wohlhart, Peng Xu, Peter David Fagan, Peter Mitrano, Pierre Sermanet, Pieter Abbeel, Priya Sundaresan, Qiuyu Chen, Quan Vuong, Rafael Rafailov, Ran Tian, Ria Doshi, Roberto Martín-Martín, Rohan Baijal, Rosario Scalise, Rose Hendrix, Roy Lin, Runjia Qian, Ruohan Zhang, Russell Mendonca, Rutav Shah, Ryan Hoque, Ryan Julian, Samuel Bustamante, Sean Kirmani, Sergey Levine, Shan Lin, Sherry Moore, Shikhar Bahl, Shivin Dass, Shubham D. Sonawani, Shuran Song, Sichun Xu, Siddhant Haldar, Siddharth Karamcheti, Simeon Adebola, Simon Guist, Soroush Nasiriany, Stefan Schaal, Stefan Welker, Stephen Tian, Subramanian Ramamoorthy, Sudeep Dasari, Suneel Belkhale, Sungjae Park, Suraj Nair, Suvir Mirchandani, Takayuki Osa, Tanmay Gupta, Tatsuya Harada, Tatsuya Matsushima, Ted Xiao, Thomas Kollar, Tianhe Yu, Tianli Ding, Todor Davchev, Tony Z. Zhao, Travis Armstrong, Trevor Darrell, Trinity Chung, Vidhi Jain, Vincent Vanhoucke, Wei Zhan, Wenxuan Zhou, Wolfram Burgard, Xi Chen, Xiaolong Wang, Xinghao Zhu, Xinyang Geng, Xiyuan Liu, Liangwei Xu, Xuanlin Li, Yao Lu, Yecheng Jason Ma, Yejin Kim, Yevgen Chebotar, Yifan Zhou, Yifeng Zhu, Yilin Wu, Ying Xu, Yixuan Wang, Yonatan Bisk, Yoonyoung Cho, Youngwoon Lee, Yuchen Cui, Yue Cao, Yueh-Hua Wu, Yujin Tang, Yuke Zhu, Yunchu Zhang, Yunfan Jiang, Yunshuang Li, Yunzhu Li, Yusuke Iwasawa, Yutaka Matsuo, Zehan Ma, Zhuo Xu, Zichen Jeff Cui, Zichen Zhang, Zipeng Lin

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

WebArena: A Realistic Web Environment for Building Autonomous Agents.

Shuyan Zhou, Frank F. Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Tianyue Ou, Yonatan Bisk, Daniel Fried, Uri Alon, Graham Neubig

Proceedings of the Twelfth International Conference on Learning Representations, 2024

SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents.

Xuhui Zhou, Hao Zhu, Leena Mathur, Ruohong Zhang, Haofei Yu, Zhengyang Qi, Louis-Philippe Morency, Yonatan Bisk, Daniel Fried, Graham Neubig, Maarten Sap

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Tools Fail: Detecting Silent Errors in Faulty Tools.

Jimin Sun, So Yeon Min, Yingshan Chang, Yonatan Bisk

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

How to Train Your Fact Verifier: Knowledge Transfer with Multimodal Open Models.

Jaeyoung Lee, Ximing Lu, Jack Hessel, Faeze Brahman, Youngjae Yu, Yonatan Bisk, Yejin Choi, Saadia Gabriel

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

Gradient Localization Improves Lifelong Pretraining of Language Models.

Jared Fernandez, Yonatan Bisk, Emma Strubell

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

Situated Instruction Following.

So Yeon Min, Xavier Puig, Devendra Singh Chaplot, Tsung-Yen Yang, Akshara Rai, Priyam Parashar, Ruslan Salakhutdinov, Yonatan Bisk, Roozbeh Mottaghi

Proceedings of the Computer Vision - ECCV 2024, 2024

Skews in the Phenomenon Space Hinder Generalization in Text-to-Image Generation.

Yingshan Chang, Yasi Zhang, Zhiyuan Fang, Ying Nian Wu, Yonatan Bisk, Feng Gao

Proceedings of the Computer Vision - ECCV 2024, 2024

OpenEQA: Embodied Question Answering in the Era of Foundation Models.

Arjun Majumdar, Anurag Ajay, Xiaohan Zhang, Pranav Putta, Sriram Yenamandra, Mikael Henaff, Sneha Silwal, Paul McVay, Oleksandr Maksymets, Sergio Arnaud, Karmesh Yadav, Qiyang Li, Ben Newman, Mohit Sharma, Vincent-Pierre Berges, Shiqi Zhang, Pulkit Agrawal, Yonatan Bisk, Dhruv Batra, Mrinal Kalakrishnan, Franziska Meier, Chris Paxton, Alexander Sax, Aravind Rajeswaran

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

SOTOPIA-π: Interactive Learning of Socially Intelligent Language Agents.

Ruiyi Wang, Haofei Yu, Wenxin Sharon Zhang, Zhengyang Qi, Maarten Sap, Yonatan Bisk, Graham Neubig, Hao Zhu

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

VISREAS: Complex Visual Reasoning with Unanswerable Questions.

Syeda Nahida Akter, Sangwu Lee, Yingshan Chang, Yonatan Bisk, Eric Nyberg

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

Training Vision-Language Transformers from Captions.

Liangke Gui, Yingshan Chang, Qiuyuan Huang, Subhojit Som, Alexander G. Hauptmann, Jianfeng Gao, Yonatan Bisk

Trans. Mach. Learn. Res., 2023

Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis.

Yafei Hu, Quanting Xie, Vidhi Jain, Jonathan Francis, Jay Patrikar, Nikhil Varma Keetha, Seungchan Kim, Yaqi Xie, Tianyi Zhang, Shibo Zhao, Yu Quan Chong, Chen Wang, Katia P. Sycara, Matthew Johnson-Roberson, Dhruv Batra, Xiaolong Wang, Sebastian A. Scherer, Zsolt Kira, Fei Xia, Yonatan Bisk

CoRR, 2023

Reasoning about the Unseen for Efficient Outdoor Object Navigation.

Quanting Xie, Tianyi Zhang, Kedi Xu, Matthew Johnson-Roberson, Yonatan Bisk

CoRR, 2023

MOSAIC: Learning Unified Multi-Sensory Object Property Representations for Robot Perception.

Gyan Tatiya, Jonathan Francis, Ho-Hsiang Wu, Yonatan Bisk, Jivko Sinapov

CoRR, 2023

WebArena: A Realistic Web Environment for Building Autonomous Agents.

Shuyan Zhou, Frank F. Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Yonatan Bisk, Daniel Fried, Uri Alon, Graham Neubig

CoRR, 2023

MAEA: Multimodal Attribution for Embodied AI.

Vidhi Jain, Jayant Sravan Tamarapalli, Sahiti Yerramilli, Yonatan Bisk

CoRR, 2023

SPRING: GPT-4 Out-performs RL Algorithms by Studying Papers and Reasoning.

Yue Wu, Shrimai Prabhumoye, So Yeon Min, Yonatan Bisk, Ruslan Salakhutdinov, Amos Azaria, Tom M. Mitchell, Yuanzhi Li

CoRR, 2023

Plan, Eliminate, and Track - Language Models are Good Teachers for Embodied Agents.

Yue Wu, So Yeon Min, Yonatan Bisk, Ruslan Salakhutdinov, Amos Azaria, Yuanzhi Li, Tom M. Mitchell, Shrimai Prabhumoye

CoRR, 2023

The Framework Tax: Disparities Between Inference Efficiency in Research and Deployment.

Jared Fernandez, Jacob Kahn, Clara Na, Yonatan Bisk, Emma Strubell

CoRR, 2023

SPAE: Semantic Pyramid AutoEncoder for Multimodal Generation with Frozen LLMs.

Lijun Yu, Yong Cheng, Zhiruo Wang, Vivek Kumar, Wolfgang Macherey, Yanping Huang, David A. Ross, Irfan Essa, Yonatan Bisk, Ming-Hsuan Yang, Kevin P. Murphy, Alexander G. Hauptmann, Lu Jiang

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

SPRING: Studying Papers and Reasoning to play Games.

Yue Wu, So Yeon Min, Shrimai Prabhumoye, Yonatan Bisk, Russ Salakhutdinov, Amos Azaria, Tom M. Mitchell, Yuanzhi Li

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Self-Supervised Object Goal Navigation with In-Situ Finetuning.

So Yeon Min, Yao-Hung Hubert Tsai, Wei Ding, Ali Farhadi, Ruslan Salakhutdinov, Yonatan Bisk, Jian Zhang

IROS, 2023

Computational Language Acquisition with Theory of Mind.

Andy Liu, Hao Zhu, Emmy Liu, Yonatan Bisk, Graham Neubig

Proceedings of the Eleventh International Conference on Learning Representations, 2023

The Framework Tax: Disparities Between Inference Efficiency in NLP Research and Deployment.

Jared Fernandez, Jacob Kahn, Clara Na, Yonatan Bisk, Emma Strubell

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

EXCALIBUR: Encouraging and Evaluating Embodied Exploration.

Hao Zhu, Raghav Kapoor, So Yeon Min, Winson Han, Jiatai Li, Kaiwen Geng, Graham Neubig, Yonatan Bisk, Aniruddha Kembhavi, Luca Weihs

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

HomeRobot: Open-Vocabulary Mobile Manipulation.

Sriram Yenamandra, Arun Ramachandran, Karmesh Yadav, Austin S. Wang, Mukul Khanna, Théophile Gervet, Tsung-Yen Yang, Vidhi Jain, Alexander Clegg, John M. Turner, Zsolt Kira, Manolis Savva, Angel X. Chang, Devendra Singh Chaplot, Dhruv Batra, Roozbeh Mottaghi, Yonatan Bisk, Chris Paxton

Proceedings of the Conference on Robot Learning, 2023

SLAP: Spatial-Language Attention Policies.

Priyam Parashar, Vidhi Jain, Xiaohan Zhang, Jay Vakil, Sam Powers, Yonatan Bisk, Chris Paxton

Proceedings of the Conference on Robot Learning, 2023

2022

Object Goal Navigation with End-to-End Self-Supervision.

So Yeon Min, Yao-Hung Hubert Tsai, Wei Ding, Ali Farhadi, Ruslan Salakhutdinov, Yonatan Bisk, Jian Zhang

CoRR, 2022

Retrospectives on the Embodied AI Workshop.

Matt Deitke, Dhruv Batra, Yonatan Bisk, Tommaso Campari, Angel X. Chang, Devendra Singh Chaplot, Changan Chen, Claudia Pérez-D'Arpino, Kiana Ehsani, Ali Farhadi, Li Fei-Fei, Anthony G. Francis, Chuang Gan, Kristen Grauman, David Hall, Winson Han, Unnat Jain, Aniruddha Kembhavi, Jacob Krantz, Stefan Lee, Chengshu Li, Sagnik Majumder, Oleksandr Maksymets, Roberto Martín-Martín, Roozbeh Mottaghi, Sonia Raychaudhuri, Mike Roberts, Silvio Savarese, Manolis Savva, Mohit Shridhar, Niko Sünderhauf, Andrew Szot, Ben Talbot, Joshua B. Tenenbaum, Jesse Thomason, Alexander Toshev, Joanne Truong, Luca Weihs, Jiajun Wu

CoRR, 2022

Training Vision-Language Transformers from Captions Alone.

Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

CoRR, 2022

HEAR 2021: Holistic Evaluation of Audio Representations.

Joseph Turian, Jordie Shier, Humair Raj Khan, Bhiksha Raj, Björn W. Schuller, Christian J. Steinmetz, Colin Malloy, George Tzanetakis, Gissel Velarde, Kirk McNally, Max Henry, Nicolas Pinto, Camille Noufi, Christian Clough, Dorien Herremans, Eduardo Fonseca, Jesse H. Engel, Justin Salamon, Philippe Esling, Pranay Manocha, Shinji Watanabe, Zeyu Jin, Yonatan Bisk

CoRR, 2022

KAT: A Knowledge Augmented Transformer for Vision-and-Language.

Liangke Gui, Borui Wang, Qiuyuan Huang, Alexander Hauptmann, Yonatan Bisk, Jianfeng Gao

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Symmetric Machine Theory of Mind.

Melanie Sclar, Graham Neubig, Yonatan Bisk

Proceedings of the International Conference on Machine Learning, 2022

A Framework for Learning to Request Rich and Contextually Useful Information from Humans.

Khanh X. Nguyen, Yonatan Bisk, Hal Daumé III

Proceedings of the International Conference on Machine Learning, 2022

FILM: Following Instructions in Language with Modular Methods.

So Yeon Min, Devendra Singh Chaplot, Pradeep Kumar Ravikumar, Yonatan Bisk, Ruslan Salakhutdinov

Proceedings of the Tenth International Conference on Learning Representations, 2022

EvEntS ReaLM: Event Reasoning of Entity States via Language Models.

Evangelia Spiliopoulou, Artidoro Pagnoni, Yonatan Bisk, Eduard H. Hovy

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization.

Shruti Palaskar, Akshita Bhagia, Yonatan Bisk, Florian Metze, Alan W. Black, Ana Marasovic

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Don't Copy the Teacher: Data and Model Challenges in Embodied Dialogue.

So Yeon Min, Hao Zhu, Ruslan Salakhutdinov, Yonatan Bisk

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

WebQA: Multihop and Multimodal QA.

Yingshan Chang, Guihong Cao, Mridu Narang, Jianfeng Gao, Hisami Suzuki, Yonatan Bisk

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Transformers Are Adaptable Task Planners.

Vidhi Jain, Yixin Lin, Eric Undersander, Yonatan Bisk, Akshara Rai

Proceedings of the Conference on Robot Learning, 2022

Language Learning from Communicative Goals and Linguistic Input.

Hao Zhu, Yonatan Bisk, Graham Neubig

Proceedings of the 44th Annual Meeting of the Cognitive Science Society, 2022

2021

It's Time to Do Something: Mitigating the Negative Impacts of Computing Through a Change to the Peer Review Process.

Brent J. Hecht, Lauren Wilcox, Jeffrey P. Bigham, Johannes Schöning, Ehsan Hoque, Jason Ernst, Yonatan Bisk, Luigi De Russis, Lana Yarosh, Bushra Anjum, Danish Contractor, Cathy Wu

CoRR, 2021

Learning When and What to Ask: a Hierarchical Reinforcement Learning Framework.

Khanh Nguyen, Yonatan Bisk, Hal Daumé III

CoRR, 2021

Worst of Both Worlds: Biases Compound in Pre-trained Vision-and-Language Models.

Tejas Srinivasan, Yonatan Bisk

CoRR, 2021

HEAR: Holistic Evaluation of Audio Representations.

Joseph Turian, Jordie Shier, Humair Raj Khan, Bhiksha Raj, Björn W. Schuller, Christian J. Steinmetz, Colin Malloy, George Tzanetakis, Gissel Velarde, Kirk McNally, Max Henry, Nicolas Pinto, Camille Noufi, Christian Clough, Dorien Herremans, Eduardo Fonseca, Jesse H. Engel, Justin Salamon, Philippe Esling, Pranay Manocha, Shinji Watanabe, Zeyu Jin, Yonatan Bisk

Proceedings of the NeurIPS 2021 Competitions and Demonstrations Track, 2021

WebQA: A Multimodal Multihop NeurIPS Challenge.

Yingshan Chang, Yonatan Bisk

Proceedings of the NeurIPS 2021 Competitions and Demonstrations Track, 2021

Few-shot Language Coordination by Modeling Theory of Mind.

Hao Zhu, Graham Neubig, Yonatan Bisk

Proceedings of the 38th International Conference on Machine Learning, 2021

ALFWorld: Aligning Text and Embodied Environments for Interactive Learning.

Mohit Shridhar, Xingdi Yuan, Marc-Alexandre Côté, Yonatan Bisk, Adam Trischler, Matthew J. Hausknecht

Proceedings of the 9th International Conference on Learning Representations, 2021

TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment.

Jianwei Yang, Yonatan Bisk, Jianfeng Gao

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

An Empirical Study on the Generalization Power of Neural Representations Learned via Visual Guessing Games.

Alessandro Suglia, Yonatan Bisk, Ioannis Konstas, Antonio Vergari, Emanuele Bastianelli, Andrea Vanzo, Oliver Lemon

Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021

Language Grounding with 3D Objects.

Jesse Thomason, Mohit Shridhar, Yonatan Bisk, Chris Paxton, Luke Zettlemoyer

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

Dependency Induction Through the Lens of Visual Perception.

Ruisi Su, Shruti Rijhwani, Hao Zhu, Junxian He, Xinyu Wang, Yonatan Bisk, Graham Neubig

Proceedings of the 25th Conference on Computational Natural Language Learning, 2021

Grounding 'Grounding' in NLP.

Khyathi Raghavi Chandu, Yonatan Bisk, Alan W. Black

Proceedings of the Findings of the Association for Computational Linguistics: ACL/IJCNLP 2021, 2021

Knowledge-driven Data Construction for Zero-shot Evaluation in Commonsense Question Answering.

Kaixin Ma, Filip Ilievski, Jonathan Francis, Yonatan Bisk, Eric Nyberg, Alessandro Oltramari

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

The Return of Lexical Dependencies: Neural Lexicalized PCFGs.

Hao Zhu, Yonatan Bisk, Graham Neubig

Trans. Assoc. Comput. Linguistics, 2020

Knowledge-driven Self-supervision for Zero-shot Commonsense Question Answering.

Kaixin Ma, Filip Ilievski, Jonathan Francis, Yonatan Bisk, Eric Nyberg, Alessandro Oltramari

CoRR, 2020

A Benchmark for Structured Procedural Knowledge Extraction from Cooking Videos.

Frank F. Xu, Lei Ji, Botian Shi, Junyi Du, Graham Neubig, Yonatan Bisk, Nan Duan

CoRR, 2020

Multi-View Learning for Vision-and-Language Navigation.

Qiaolin Xia, Xiujun Li, Chunyuan Li, Yonatan Bisk, Zhifang Sui, Jianfeng Gao, Yejin Choi, Noah A. Smith

CoRR, 2020

RMM: A Recursive Mental Model for Dialog Navigation.

Homero Roman Roman, Yonatan Bisk, Jesse Thomason, Asli Celikyilmaz, Jianfeng Gao

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020

Experience Grounds Language.

Yonatan Bisk, Ari Holtzman, Jesse Thomason, Jacob Andreas, Yoshua Bengio, Joyce Chai, Mirella Lapata, Angeliki Lazaridou, Jonathan May, Aleksandr Nisnevich, Nicolas Pinto, Joseph P. Turian

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks.

Mohit Shridhar, Jesse Thomason, Daniel Gordon, Yonatan Bisk, Winson Han, Roozbeh Mottaghi, Luke Zettlemoyer, Dieter Fox

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

Imagining Grounded Conceptual Representations from Perceptual Information in Situated Guessing Games.

Alessandro Suglia, Antonio Vergari, Ioannis Konstas, Yonatan Bisk, Emanuele Bastianelli, Andrea Vanzo, Oliver Lemon

Proceedings of the 28th International Conference on Computational Linguistics, 2020

PIQA: Reasoning about Physical Commonsense in Natural Language.

Yonatan Bisk, Rowan Zellers, Ronan Le Bras, Jianfeng Gao, Yejin Choi

Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence, 2020

2019

Character-based Surprisal as a Model of Human Reading in the Presence of Errors.

Michael Hahn, Frank Keller, Yonatan Bisk, Yonatan Belinkov

CoRR, 2019

Defending Against Neural Fake News.

Rowan Zellers, Ari Holtzman, Hannah Rashkin, Yonatan Bisk, Ali Farhadi, Franziska Roesner, Yejin Choi

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Shifting the Baseline: Single Modality Performance on Visual Navigation & QA.

Jesse Thomason, Daniel Gordon, Yonatan Bisk

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Benchmarking Hierarchical Script Knowledge.

Yonatan Bisk, Jan Buys, Karl Pichotta, Yejin Choi

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

EARLY FUSION for Goal Directed Robotic Vision.

Aaron Walsman, Yonatan Bisk, Saadia Gabriel, Dipendra Misra, Yoav Artzi, Yejin Choi, Dieter Fox

Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2019

Improving Robot Success Detection using Static Object Data.

Rosario Scalise, Jesse Thomason, Yonatan Bisk, Siddhartha S. Srinivasa

Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2019

Prospection: Interpretable plans from language by predicting the future.

Chris Paxton, Yonatan Bisk, Jesse Thomason, Arunkumar Byravan, Dieter Fox

Proceedings of the International Conference on Robotics and Automation, 2019

Robust Navigation with Language Pretraining and Stochastic Sampling.

Xiujun Li, Chunyuan Li, Qiaolin Xia, Yonatan Bisk, Asli Celikyilmaz, Jianfeng Gao, Noah A. Smith, Yejin Choi

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

From Recognition to Cognition: Visual Commonsense Reasoning.

Rowan Zellers, Yonatan Bisk, Ali Farhadi, Yejin Choi

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

Tactical Rewind: Self-Correction via Backtracking in Vision-And-Language Navigation.

Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, Jingjing Liu, Jianfeng Gao, Yejin Choi, Siddhartha S. Srinivasa

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

Character-based Surprisal as a Model of Reading Difficulty in the Presence of Errors.

Michael Hahn, Frank Keller, Yonatan Bisk, Yonatan Belinkov

Proceedings of the 41th Annual Meeting of the Cognitive Science Society, 2019

HellaSwag: Can a Machine Really Finish Your Sentence?

Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, Yejin Choi

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

2018

Balancing Shared Autonomy with Human-Robot Communication.

Rosario Scalise, Yonatan Bisk, Maxwell Forbes, Daqing Yi, Yejin Choi, Siddhartha S. Srinivasa

CoRR, 2018

CHALET: Cornell House Agent Learning Environment.

Claudia Yan, Dipendra Kumar Misra, Andrew Bennett, Aaron Walsman, Yonatan Bisk, Yoav Artzi

CoRR, 2018

Synthetic and Natural Noise Both Break Neural Machine Translation.

Yonatan Belinkov, Yonatan Bisk

Proceedings of the 6th International Conference on Learning Representations, 2018

SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference.

Rowan Zellers, Yonatan Bisk, Roy Schwartz, Yejin Choi

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

Inducing Grammars with and for Neural Machine Translation.

Yonatan Bisk, Ke M. Tran

Proceedings of the 2nd Workshop on Neural Machine Translation and Generation, 2018

Learning Interpretable Spatial Operations in a Rich 3D Blocks World.

Yonatan Bisk, Kevin J. Shih, Yejin Choi, Daniel Marcu

Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, 2018

2017

Natural Language Inference from Multiple Premises.

Alice Lai, Yonatan Bisk, Julia Hockenmaier

Proceedings of the Eighth International Joint Conference on Natural Language Processing, 2017

2016

Supertagging With LSTMs.

Ashish Vaswani, Yonatan Bisk, Kenji Sagae, Ryan Musa

Proceedings of the NAACL HLT 2016, 2016

Natural Language Communication with Robots.

Yonatan Bisk, Deniz Yuret, Daniel Marcu

Proceedings of the NAACL HLT 2016, 2016

Unsupervised Neural Hidden Markov Models.

Ke M. Tran, Yonatan Bisk, Ashish Vaswani, Daniel Marcu, Kevin Knight

Proceedings of the Workshop on Structured Prediction for NLP@EMNLP 2016, 2016

Evaluating Induced CCG Parsers on Grounded Semantic Parsing.

Yonatan Bisk, Siva Reddy, John Blitzer, Julia Hockenmaier, Mark Steedman

Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016

Towards a Dataset for Human Computer Communication via Grounded Language Acquisition.

Yonatan Bisk, Daniel Marcu, William Wong

Proceedings of the Symbiotic Cognitive Systems, 2016

2015

Unsupervised grammar induction with Combinatory Categorial Grammars

Yonatan Bisk

PhD thesis, 2015

Probing the Linguistic Strengths and Limitations of Unsupervised Grammar Induction.

Yonatan Bisk, Julia Hockenmaier

Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, 2015

Labeled Grammar Induction with Minimal Supervision.

Yonatan Bisk, Christos Christodoulopoulos, Julia Hockenmaier

Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, 2015

2013

An HDP Model for Inducing Combinatory Categorial Grammars.

Yonatan Bisk, Julia Hockenmaier

Trans. Assoc. Comput. Linguistics, 2013

2012

Document-topic hierarchies from document graphs.

Tim Weninger, Yonatan Bisk, Jiawei Han

Proceedings of the 21st ACM International Conference on Information and Knowledge Management, 2012

Simple Robust Grammar Induction with Combinatory Categorial Grammars.

Yonatan Bisk, Julia Hockenmaier

Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, 2012

2010

Normal-form parsing for Combinatory Categorial Grammars with generalized composition and type-raising.

Julia Hockenmaier, Yonatan Bisk

Proceedings of the COLING 2010, 2010