Po-Yao Huang

According to our database, Po-Yao Huang authored at least 58 papers between 2014 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

DINOv2: Learning Robust Visual Features without Supervision.

Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy V. Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, Mido Assran, Nicolas Ballas, Wojciech Galuba, Russell Howes, Po-Yao Huang, Shang-Wen Li, Ishan Misra, Michael Rabbat, Vasu Sharma, Gabriel Synnaeve, Hu Xu, Hervé Jégou, Julien Mairal, Patrick Labatut, Armand Joulin, Piotr Bojanowski

Trans. Mach. Learn. Res., 2024

Text Quality-Based Pruning for Efficient Training of Language Models.

Vasu Sharma, Karthik Padthe, Newsha Ardalani, Kushal Tirumala, Russell Howes, Hu Xu, Po-Yao Huang, Shang-Wen Li, Armen Aghajanyan, Gargi Ghosh, Luke Zettlemoyer

CoRR, 2024

VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wild.

Puyuan Peng, Po-Yao Huang, Daniel Li, Abdelrahman Mohamed, David Harwath

CoRR, 2024

Adversarially Masked Video Consistency for Unsupervised Domain Adaptation.

Xiaoyu Zhu, Junwei Liang, Po-Yao Huang, Alex Hauptmann

CoRR, 2024

Demystifying CLIP Data.

Hu Xu, Saining Xie, Xiaoqing Ellen Tan, Po-Yao Huang, Russell Howes, Vasu Sharma, Shang-Wen Li, Gargi Ghosh, Luke Zettlemoyer, Christoph Feichtenhofer

Proceedings of the Twelfth International Conference on Learning Representations, 2024

AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models.

Yuan Tseng, Layne Berry, Yiting Chen, I-Hsiang Chiu, Hsuan-Hao Lin, Max Liu, Puyuan Peng, Yi-Jen Shih, Hung-Yu Wang, Haibin Wu, Poyao Huang, Chun-Mao Lai, Shang-Wen Li, David Harwath, Yu Tsao, Abdelrahman Mohamed, Chi-Luen Feng, Hung-Yi Lee

Proceedings of the IEEE International Conference on Acoustics, 2024

Altogether: Image Captioning via Re-aligning Alt-text.

Hu Xu, Po-Yao Huang, Xiaoqing Ellen Tan, Ching-Feng Yeh, Jacob Kahn, Christine Jou, Gargi Ghosh, Omer Levy, Luke Zettlemoyer, Wen-tau Yih, Shang-Wen Li, Saining Xie, Christoph Feichtenhofer

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Self-Supervised Audio-Visual Soundscape Stylization.

Tingle Li, Renhao Wang, Po-Yao Huang, Andrew Owens, Gopala Anumanchipalli

Proceedings of the Computer Vision - ECCV 2024, 2024

MoDE: CLIP Data Experts via Clustering.

Jiawei Ma, Po-Yao Huang, Saining Xie, Shang-Wen Li, Luke Zettlemoyer, Shih-Fu Chang, Wen-Tau Yih, Hu Xu

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wild.

Puyuan Peng, Po-Yao Huang, Shang-Wen Li, Abdelrahman Mohamed, David Harwath

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

Video Pivoting Unsupervised Multi-Modal Machine Translation.

Mingjie Li, Po-Yao Huang, Xiaojun Chang, Junjie Hu, Yi Yang, Alex Hauptmann

IEEE Trans. Pattern Anal. Mach. Intell., March, 2023

AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models.

Yuan Tseng, Layne Berry, Yi-Ting Chen, I-Hsiang Chiu, Hsuan-Hao Lin, Max Liu, Puyuan Peng, Yi-Jen Shih, Hung-Yu Wang, Haibin Wu, Po-Yao Huang, Chun-Mao Lai, Shang-Wen Li, David Harwath, Yu Tsao, Shinji Watanabe, Abdelrahman Mohamed, Chi-Luen Feng, Hung-yi Lee

CoRR, 2023

SeamlessM4T-Massively Multilingual & Multimodal Machine Translation.

Seamless Communication, Loïc Barrault, Yu-An Chung, Mariano Coria Meglioli, David Dale, Ning Dong, Paul-Ambroise Duquenne, Hady Elsahar, Hongyu Gong, Kevin Heffernan, John Hoffman, Christopher Klaiber, Pengwei Li, Daniel Licht, Jean Maillard, Alice Rakotoarison, Kaushik Ram Sadagopan, Guillaume Wenzek, Ethan Ye, Bapi Akula, Peng-Jen Chen, Naji El Hachem, Brian Ellis, Gabriel Mejia Gonzalez, Justin Haaheim, Prangthip Hansanti, Russ Howes, Bernie Huang, Min-Jae Hwang, Hirofumi Inaguma, Somya Jain, Elahe Kalbassi, Amanda Kallet, Ilia Kulikov, Janice Lam, Daniel Li, Xutai Ma, Ruslan Mavlyutov, Benjamin N. Peloquin, Mohamed Ramadan, Abinesh Ramakrishnan, Anna Y. Sun, Kevin Tran, Tuan Tran, Igor Tufanov, Vish Vogeti, Carleigh Wood, Yilin Yang, Bokai Yu, Pierre Andrews, Can Balioglu, Marta R. Costa-jussà, Onur Celebi, Maha Elbayad, Cynthia Gao, Francisco Guzmán, Justine Kao, Ann Lee, Alexandre Mourachko, Juan Pino, Sravya Popuri, Christophe Ropers, Safiyyah Saleem, Holger Schwenk, Paden Tomasello, Changhan Wang, Jeff Wang, Skyler Wang

CoRR, 2023

DINOv2: Learning Robust Visual Features without Supervision.

Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy V. Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, Mahmoud Assran, Nicolas Ballas, Wojciech Galuba, Russell Howes, Po-Yao Huang, Shang-Wen Li, Ishan Misra, Michael G. Rabbat, Vasu Sharma, Gabriel Synnaeve, Hu Xu, Hervé Jégou, Julien Mairal, Patrick Labatut, Armand Joulin, Piotr Bojanowski

CoRR, 2023

MAViL: Masked Audio-Video Learners.

Po-Yao Huang, Vasu Sharma, Hu Xu, Chaitanya Ryali, Haoqi Fan, Yanghao Li, Shang-Wen Li, Gargi Ghosh, Jitendra Malik, Christoph Feichtenhofer

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistles.

Chaitanya Ryali, Yuan-Ting Hu, Daniel Bolya, Chen Wei, Haoqi Fan, Po-Yao Huang, Vaibhav Aggarwal, Arkabandhu Chowdhury, Omid Poursaeed, Judy Hoffman, Jitendra Malik, Yanghao Li, Christoph Feichtenhofer

Proceedings of the International Conference on Machine Learning, 2023

Diffusion Models as Masked Autoencoders.

Chen Wei, Karttikeya Mangalam, Po-Yao Huang, Yanghao Li, Haoqi Fan, Hu Xu, Huiyu Wang, Cihang Xie, Alan L. Yuille, Christoph Feichtenhofer

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

CiT: Curation in Training for Effective Vision-Language Data.

Hu Xu, Saining Xie, Po-Yao Huang, Licheng Yu, Russell Howes, Gargi Ghosh, Luke Zettlemoyer, Christoph Feichtenhofer

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

STMT: A Spatial-Temporal Mesh Transformer for MoCap-Based Action Recognition.

Xiaoyu Zhu, Po-Yao Huang, Junwei Liang, Celso M. de Melo, Alexander G. Hauptmann

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Flap: Fast Language-Audio Pre-Training.

Ching-Feng Yeh, Po-Yao Huang, Vasu Sharma, Shang-Wen Li, Gargi Ghosh

Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop, 2023

Generating Hashtags for Short-form Videos with Guided Signals.

Tiezheng Yu, Hanchao Yu, Davis Liang, Yuning Mao, Shaoliang Nie, Po-Yao Huang, Madian Khabsa, Pascale Fung, Yi-Chia Wang

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

A Survey of Deep Active Learning.

Pengzhen Ren, Yun Xiao, Xiaojun Chang, Po-Yao Huang, Zhihui Li, Brij B. Gupta, Xiaojiang Chen, Xin Wang

ACM Comput. Surv., 2022

A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions.

Pengzhen Ren, Yun Xiao, Xiaojun Chang, Poyao Huang, Zhihui Li, Xiaojiang Chen, Xin Wang

ACM Comput. Surv., 2022

CM3: A Causal Masked Multimodal Model of the Internet.

Armen Aghajanyan, Bernie Huang, Candace Ross, Vladimir Karpukhin, Hu Xu, Naman Goyal, Dmytro Okhonko, Mandar Joshi, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer

CoRR, 2022

Masked Autoencoders that Listen.

Po-Yao Huang, Hu Xu, Juncheng Li, Alexei Baevski, Michael Auli, Wojciech Galuba, Florian Metze, Christoph Feichtenhofer

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

AudioTagging Done Right: 2nd comparison of deep learning methods for environmental sound classification.

Juncheng Li, Shuhui Qu, Po-Yao Huang, Florian Metze

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

On Adversarial Robustness Of Large-Scale Audio Visual Learning.

Juncheng B. Li, Shuhui Qu, Xinjian Li, Bernie Po-Yao Huang, Florian Metze

Proceedings of the IEEE International Conference on Acoustics, 2022

2021

Self-Supervised Deep Correlation Tracking.

Di Yuan, Xiaojun Chang, Po-Yao Huang, Qiao Liu, Zhenyu He

IEEE Trans. Image Process., 2021

Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models.

Poyao Huang, Mandela Patrick, Junjie Hu, Graham Neubig, Florian Metze, Alex Hauptmann

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Support-set bottlenecks for video-text representation learning.

Mandela Patrick, Po-Yao Huang, Yuki Markus Asano, Florian Metze, Alexander G. Hauptmann, João F. Henriques, Andrea Vedaldi

Proceedings of the 9th International Conference on Learning Representations, 2021

Space-Time Crop & Attend: Improving Cross-modal Video Representation Learning.

Mandela Patrick, Po-Yao Huang, Ishan Misra, Florian Metze, Andrea Vedaldi, Yuki M. Asano, João F. Henriques

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

Audio-Visual Event Recognition Through the Lens of Adversary.

Juncheng B. Li, Kaixin Ma, Shuhui Qu, Po-Yao Huang, Florian Metze

Proceedings of the IEEE International Conference on Acoustics, 2021

VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding.

Hu Xu, Gargi Ghosh, Po-Yao Huang, Dmytro Okhonko, Armen Aghajanyan, Florian Metze, Luke Zettlemoyer, Christoph Feichtenhofer

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

VLM: Task-agnostic Video-Language Model Pre-training for Video Understanding.

Hu Xu, Gargi Ghosh, Po-Yao Huang, Prahal Arora, Masoumeh Aminzadeh, Christoph Feichtenhofer, Florian Metze, Luke Zettlemoyer

Proceedings of the Findings of the Association for Computational Linguistics: ACL/IJCNLP 2021, 2021

2020

A Survey of Deep Active Learning.

Pengzhen Ren, Yun Xiao, Xiaojun Chang, Po-Yao Huang, Zhihui Li, Xiaojiang Chen, Xin Wang

CoRR, 2020

Argus: Efficient Activity Detection System for Extended Video Analysis.

Wenhe Liu, Guoliang Kang, Po-Yao Huang, Xiaojun Chang, Lijun Yu, Yijun Qian, Junwei Liang, Liangke Gui, Jing Wen, Peng Chen, Alexander G. Hauptmann

Proceedings of the IEEE Winter Applications of Computer Vision Workshops, 2020

Forward and Backward Multimodal NMT for Improved Monolingual and Multilingual Cross-Modal Retrieval.

Po-Yao Huang, Xiaojun Chang, Alexander G. Hauptmann, Eduard H. Hovy

Proceedings of the 2020 on International Conference on Multimedia Retrieval, 2020

Unsupervised Multimodal Neural Machine Translation with Pseudo Visual Pivoting.

Po-Yao Huang, Junjie Hu, Xiaojun Chang, Alexander G. Hauptmann

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

RWR-GAE: Random Walk Regularization for Graph Auto Encoders.

Vaibhav, Po-Yao Huang, Robert E. Frederking

CoRR, 2019

MMVG-INF-Etrol@TRECVID 2019: Activities in Extended Video.

Xiaojun Chang, Wenhe Liu, Po-Yao Huang, Changlin Li, Fengda Zhu, Mingfei Han, Mingjie Li, Mengyuan Ma, Siyi Hu, Guoliang Kang, Junwei Liang, Liangke Gui, Lijun Yu, Yijun Qian, Jing Wen, Alexander G. Hauptmann

Proceedings of the 2019 TREC Video Retrieval Evaluation, 2019

CMU-Informedia at TREC 2019 Incident Streams Track.

Junpei Zhou, Xinyu Wang, Po-Yao Huang, Alexander G. Hauptmann

Proceedings of the Twenty-Eighth Text REtrieval Conference, 2019

OPERA: Operations-oriented Probabilistic Extraction, Reasoning, and Analysis.

Eduard H. Hovy, Jaime G. Carbonell, Hans Chalupsky, Anatole Gershman, Alex Hauptmann, Florian Metze, Teruko Mitamura, Zaid Sheikh, Ankit Dangi, Aditi Chaudhary, Xianyang Chen, Xiang Kong, Bernie Huang, Salvador Medina, Hector Liu, Xuezhe Ma, Maria Ryskina, Ramon Sanabria, Varun Gangal

Proceedings of the 2019 Text Analysis Conference, 2019

Annotation Efficient Cross-Modal Retrieval with Adversarial Attentive Alignment.

Po-Yao Huang, Guoliang Kang, Wenhe Liu, Xiaojun Chang, Alexander G. Hauptmann

Proceedings of the 27th ACM International Conference on Multimedia, 2019

Improving What Cross-Modal Retrieval Models Learn through Object-Oriented Inter- and Intra-Modal Attention Networks.

Po-Yao Huang, Vaibhav, Xiaojun Chang, Alexander G. Hauptmann

Proceedings of the 2019 on International Conference on Multimedia Retrieval, 2019

Multi-Head Attention with Diversity for Learning Grounded Multilingual Multimodal Representations.

Po-Yao Huang, Xiaojun Chang, Alexander G. Hauptmann

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

2018

Informedia @ TRECVID 2018: Ad-hoc Video Search, Video to Text Description, Activities in Extended video.

Jia Chen, Shizhe Chen, Qin Jin, Alexander G. Hauptmann, Po-Yao Huang, Junwei Liang, Vaibhav, Xiaojun Chang, Jiang Liu, Ting-Yao Hu, Wenhe Liu, Wei Ke, Wayner Barrios, Haroon Idrees, Donghyun Yoo, Yaser Sheikh, Ruslan Salakhutdinov, Kris Kitani, Dong Huang

Proceedings of the 2018 TREC Video Retrieval Evaluation, 2018

OPERA: Operations-oriented Probabilistic Extraction, Reasoning, and Analysis.

Eduard H. Hovy, Taylor Berg-Kirkpatrick, Jaime G. Carbonell, Hans Chalupsky, Anatole Gershman, Alexander G. Hauptmann, Florian Metze, Teruko Mitamura, Aditi Chaudhary, Xianyang Chen, Bernie Po-Yao Huang, Hector Zhengzhong Liu, Xuezhe Ma, Shruti Palaskar, Dheeraj Rajagopal, Maria Ryskina, Ramon Sanabria

Proceedings of the 2018 Text Analysis Conference, 2018

Panoramic depth reconstruction within a single shot by optimizing global sphere radii.

Po-Yao Huang, Hong Shiang Lin, Sun-Yu Gordon Chi, Liang-Han Lin, Ming Ouhyoung

Proceedings of the SIGGRAPH Asia 2018 Posters, Tokyo, Japan, December 04-07, 2018, 2018

Multimodal Filtering of Social Media for Temporal Monitoring and Event Analysis.

Po-Yao Huang, Junwei Liang, Jean-Baptiste Lamare, Alexander G. Hauptmann

Proceedings of the 2018 ACM on International Conference on Multimedia Retrieval, 2018

RCAA: Relational Context-Aware Agents for Person Search.

Xiaojun Chang, Po-Yao Huang, Yi-Dong Shen, Xiaodan Liang, Yi Yang, Alexander G. Hauptmann

Proceedings of the Computer Vision - ECCV 2018, 2018

2017

Video Representation Learning and Latent Concept Mining for Large-scale Multi-label Video Classification.

Poyao Huang, Ye Yuan, Zhen-Zhong Lan, Lu Jiang, Alexander G. Hauptmann

CoRR, 2017

Synchronization for multi-perspective videos in the wild.

Junwei Liang, Poyao Huang, Jia Chen, Alexander G. Hauptmann

Proceedings of the 2017 IEEE International Conference on Acoustics, 2017

An Event Reconstruction Tool for Conflict Monitoring Using Social Media.

Junwei Liang, Desai Fan, Han Lu, Poyao Huang, Jia Chen, Lu Jiang, Alexander G. Hauptmann

Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, 2017

2016

Attention-based Multimodal Neural Machine Translation.

Po-Yao Huang, Frederick Liu, Sz-Rung Shiang, Jean Oh, Chris Dyer

Proceedings of the First Conference on Machine Translation, 2016

Informedia @ TRECVID 2016.

Junwei Liang, Jia Chen, Poyao Huang, Xuanchong Li, Lu Jiang, Zhenzhong Lan, Pingbo Pan, Hehe Fan, Qin Jin, Jiande Sun, Yang Chen, Yi Yang, Alexander G. Hauptmann

Proceedings of the 2016 TREC Video Retrieval Evaluation, 2016

2015

Cognitive vertical handover in heterogeneous networks.

Yu-Jui Liu, Shin-Ming Cheng, Po-Yao Huang

Proceedings of the 11th International Conference on Heterogeneous Networking for Quality, 2015

Entity Hierarchy Embedding.

Zhiting Hu, Poyao Huang, Yuntian Deng, Yingkai Gao, Eric P. Xing

Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, 2015

2014

Cognitive access in multichannel wireless networks using two-dimension Markov chain.

Han-Feng Lin, Shin-Ming Cheng, Po-Yao Huang

Proceedings of the International Wireless Communications and Mobile Computing Conference, 2014