Roei Herzig

According to our database, Roei Herzig authored at least 37 papers between 2018 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Sparse Attention Vectors: Generative Multimodal Model Features Are Discriminative Vision-Language Classifiers.

Chancharik Mitra, Brandon Huang, Tianning Chai, Zhiqiu Lin, Assaf Arbelle, Rogério Feris, Leonid Karlinsky, Trevor Darrell, Deva Ramanan, Roei Herzig

CoRR, 2024

In-Context Learning Enables Robot Action Prediction in LLMs.

Yida Yin, Zekai Wang, Yuvan Sharma, Dantong Niu, Trevor Darrell, Roei Herzig

CoRR, 2024

Multimodal Task Vectors Enable Many-Shot Multimodal In-Context Learning.

Brandon Huang, Chancharik Mitra, Assaf Arbelle, Leonid Karlinsky, Trevor Darrell, Roei Herzig

CoRR, 2024

Navigating the Labyrinth: Evaluating and Enhancing LLMs' Ability to Reason About Search Problems.

Nasim Borazjanizadeh, Roei Herzig, Trevor Darrell, Rogério Feris, Leonid Karlinsky

CoRR, 2024

LLARVA: Vision-Action Instruction Tuning Enhances Robot Learning.

Dantong Niu, Yuvan Sharma, Giscard Biamby, Jerome Quenum, Yutong Bai, Baifeng Shi, Trevor Darrell, Roei Herzig

CoRR, 2024

ConMe: Rethinking Evaluation of Compositional Reasoning for Modern VLMs.

Irene Huang, Wei Lin, Muhammad Jehanzeb Mirza, Jacob A. Hansen, Sivan Doveh, Victor Ion Butoi, Roei Herzig, Assaf Arbelle, Hilde Kuehne, Trevor Darrell, Chuang Gan, Aude Oliva, Rogério Feris, Leonid Karlinsky

CoRR, 2024

TraveLER: A Multi-LMM Agent Framework for Video Question-Answering.

Chuyi Shang, Amos You, Sanjay Subramanian, Trevor Darrell, Roei Herzig

CoRR, 2024

PromptonomyViT: Multi-Task Prompt Learning Improves Video Transformers using Synthetic Scene Data.

Roei Herzig, Ofir Abramovich, Elad Ben-Avraham, Assaf Arbelle, Leonid Karlinsky, Ariel Shamir, Trevor Darrell, Amir Globerson

Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2024

TraveLER: A Modular Multi-LMM Agent Framework for Video Question-Answering.

Chuyi Shang, Amos You, Sanjay Subramanian, Trevor Darrell, Roei Herzig

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Recursive Visual Programming.

Jiaxin Ge, Sanjay Subramanian, Baifeng Shi, Roei Herzig, Trevor Darrell

Proceedings of the Computer Vision - ECCV 2024, 2024

Unsupervised Universal Image Segmentation.

Dantong Niu, Xudong Wang, Xinyang Han, Long Lian, Roei Herzig, Trevor Darrell

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

Compositional Chain-of-Thought Prompting for Large Multimodal Models.

Chancharik Mitra, Brandon Huang, Trevor Darrell, Roei Herzig

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

2023

Object-based (yet Class-agnostic) Video Domain Adaptation.

Dantong Niu, Amir Bar, Roei Herzig, Trevor Darrell, Anna Rohrbach

CoRR, 2023

Dense and Aligned Captions (DAC) Promote Compositional Reasoning in VL Models.

Sivan Doveh, Assaf Arbelle, Sivan Harary, Roei Herzig, Donghyun Kim, Paola Cascante-Bonilla, Amit Alfassy, Rameswar Panda, Raja Giryes, Rogério Feris, Shimon Ullman, Leonid Karlinsky

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Incorporating Structured Representations into Pretrained Vision & Language Models Using Scene Graphs.

Roei Herzig, Alon Mendelson, Leonid Karlinsky, Assaf Arbelle, Rogério Feris, Trevor Darrell, Amir Globerson

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Teaching Structured Vision & Language Concepts to Vision & Language Models.

Sivan Doveh, Assaf Arbelle, Sivan Harary, Eli Schwartz, Roei Herzig, Raja Giryes, Rogério Feris, Rameswar Panda, Shimon Ullman, Leonid Karlinsky

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

2022

Teaching Structured Vision&Language Concepts to Vision&Language Models.

Sivan Doveh, Assaf Arbelle, Sivan Harary, Rameswar Panda, Roei Herzig, Eli Schwartz, Donghyun Kim, Raja Giryes, Rogério Feris, Shimon Ullman, Leonid Karlinsky

CoRR, 2022

FETA: Towards Specializing Foundation Models for Expert Task Applications.

Amit Alfassy, Assaf Arbelle, Oshri Halimi, Sivan Harary, Roei Herzig, Eli Schwartz, Rameswar Panda, Michele Dolfi, Christoph Auer, Kate Saenko, Peter W. J. Staar, Rogério Feris, Leonid Karlinsky

CoRR, 2022

Structured Video Tokens @ Ego4D PNR Temporal Localization Challenge 2022.

Elad Ben-Avraham, Roei Herzig, Karttikeya Mangalam, Amir Bar, Anna Rohrbach, Leonid Karlinsky, Trevor Darrell, Amir Globerson

CoRR, 2022

Bringing Image Scene Structure to Video via Frame-Clip Consistency of Object Tokens.

Elad Ben-Avraham, Roei Herzig, Karttikeya Mangalam, Amir Bar, Anna Rohrbach, Leonid Karlinsky, Trevor Darrell, Amir Globerson

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

FETA: Towards Specializing Foundational Models for Expert Task Applications.

Amit Alfassy, Assaf Arbelle, Oshri Halimi, Sivan Harary, Roei Herzig, Eli Schwartz, Rameswar Panda, Michele Dolfi, Christoph Auer, Peter W. J. Staar, Kate Saenko, Rogério Feris, Leonid Karlinsky

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Object-Region Video Transformers.

Roei Herzig, Elad Ben-Avraham, Karttikeya Mangalam, Amir Bar, Gal Chechik, Anna Rohrbach, Trevor Darrell, Amir Globerson

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Unsupervised Domain Generalization by Learning a Bridge Across Domains.

Sivan Harary, Eli Schwartz, Assaf Arbelle, Peter W. J. Staar, Shady Abu-Hussein, Elad Amrani, Roei Herzig, Amit Alfassy, Raja Giryes, Hilde Kuehne, Dina Katabi, Kate Saenko, Rogério Feris, Leonid Karlinsky

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

DETReg: Unsupervised Pretraining with Region Priors for Object Detection.

Amir Bar, Xin Wang, Vadim Kantorov, Colorado J. Reed, Roei Herzig, Gal Chechik, Anna Rohrbach, Trevor Darrell, Amir Globerson

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

2021

Compositional Video Synthesis with Action Graphs.

Amir Bar, Roei Herzig, Xiaolong Wang, Anna Rohrbach, Gal Chechik, Trevor Darrell, Amir Globerson

Proceedings of the 38th International Conference on Machine Learning, 2021

2020

Learning Object Detection from Captions via Textual Scene Attributes.

Achiya Jerbi, Roei Herzig, Jonathan Berant, Gal Chechik, Amir Globerson

CoRR, 2020

Compositional Video Synthesis with Action Graphs.

Amir Bar, Roei Herzig, Xiaolong Wang, Gal Chechik, Trevor Darrell, Amir Globerson

CoRR, 2020

Differentiable Scene Graphs.

Moshiko Raboh, Roei Herzig, Jonathan Berant, Gal Chechik, Amir Globerson

Proceedings of the IEEE Winter Conference on Applications of Computer Vision, 2020

Learning Canonical Representations for Scene Graph to Image Generation.

Roei Herzig, Amir Bar, Huijuan Xu, Gal Chechik, Trevor Darrell, Amir Globerson

Proceedings of the Computer Vision - ECCV 2020, 2020

Something-Else: Compositional Action Recognition With Spatial-Temporal Interaction Networks.

Joanna Materzynska, Tete Xiao, Roei Herzig, Huijuan Xu, Xiaolong Wang, Trevor Darrell

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

2019

Precise Detection in Densely Packed Scenes.

Eran Goldman, Roei Herzig, Aviv Eisenschtat, Oria Ratzon, Itsik Levi, Jacob Goldberger, Tal Hassner

CoRR, 2019

Learning Latent Scene-Graph Representations for Referring Relationships.

Moshiko Raboh, Roei Herzig, Gal Chechik, Jonathan Berant, Amir Globerson

CoRR, 2019

Spatio-Temporal Action Graph Networks.

Roei Herzig, Elad Levi, Huijuan Xu, Hang Gao, Eli Brosh, Xiaolong Wang, Amir Globerson, Trevor Darrell

Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision Workshops, 2019

Precise Detection in Densely Packed Scenes.

Eran Goldman, Roei Herzig, Aviv Eisenschtat, Jacob Goldberger, Tal Hassner

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

Accurate Visual Localization for Automotive Applications.

Eli Brosh, Matan Friedmann, Ilan Kadar, Lev Yitzhak Lavy, Elad Levi, Shmuel Rippa, Yair Lempert, Bruno Fernandez-Ruiz, Roei Herzig, Trevor Darrell

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2019

2018

Classifying Collisions with Spatio-Temporal Action Graph Networks.

Roei Herzig, Elad Levi, Huijuan Xu, Eli Brosh, Amir Globerson, Trevor Darrell

CoRR, 2018

Mapping Images to Scene Graphs with Permutation-Invariant Structured Prediction.

Roei Herzig, Moshiko Raboh, Gal Chechik, Jonathan Berant, Amir Globerson

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018