Hongyu Gong

According to our database, Hongyu Gong authored at least 61 papers between 2015 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

DC-Spin: A Speaker-invariant Speech Tokenizer for Spoken Language Models.

Heng-Jui Chang, Hongyu Gong, Changhan Wang, James R. Glass, Yu-An Chung

CoRR, 2024

Investigating Decoder-only Large Language Models for Speech-to-text Translation.

Chao-Wei Huang, Hui Lu, Hongyu Gong, Hirofumi Inaguma, Ilia Kulikov, Ruslan Mavlyutov, Sravya Popuri

CoRR, 2024

SeamlessExpressiveLM: Speech Language Model for Expressive Speech-to-Speech Translation with Chain-of-Thought.

Hongyu Gong, Bandhav Veluri

CoRR, 2024

MSLM-S2ST: A Multitask Speech Language Model for Textless Speech-to-Speech Translation with Speaker Style Preservation.

Yifan Peng, Ilia Kulikov, Yilin Yang, Sravya Popuri, Hui Lu, Changhan Wang, Hongyu Gong

CoRR, 2024

An Empirical Study of Speech Language Models for Prompt-Conditioned Speech Synthesis.

Yifan Peng, Ilia Kulikov, Yilin Yang, Sravya Popuri, Hui Lu, Changhan Wang, Hongyu Gong

CoRR, 2024

Beyond Turn-Based Interfaces: Synchronous LLMs as Full-Duplex Dialogue Agents.

Bandhav Veluri, Benjamin N. Peloquin, Bokai Yu, Hongyu Gong, Shyamnath Gollakota

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

CLASP: Cross-modal Alignment Using Pre-trained Unimodal Models.

Jianing Zhou, Ziheng Zeng, Hongyu Gong, Suma Bhat

Proceedings of the Findings of the Association for Computational Linguistics, 2024

Textless Acoustic Model with Self-Supervised Distillation for Noise-Robust Expressive Speech-to-Speech Translation.

Min-Jae Hwang, Ilia Kulikov, Benjamin N. Peloquin, Hongyu Gong, Peng-Jen Chen, Ann Lee

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

Seamless: Multilingual Expressive and Streaming Speech Translation.

Loïc Barrault, Yu-An Chung, Mariano Coria Meglioli, David Dale, Ning Dong, Mark Duppenthaler, Paul-Ambroise Duquenne, Brian Ellis, Hady Elsahar, Justin Haaheim, John Hoffman, Min-Jae Hwang, Hirofumi Inaguma, Christopher Klaiber, Ilia Kulikov, Pengwei Li, Daniel Licht, Jean Maillard, Ruslan Mavlyutov, Alice Rakotoarison, Kaushik Ram Sadagopan, Abinesh Ramakrishnan, Tuan Tran, Guillaume Wenzek, Yilin Yang, Ethan Ye, Ivan Evtimov, Pierre Fernandez, Cynthia Gao, Prangthip Hansanti, Elahe Kalbassi, Amanda Kallet, Artyom Kozhevnikov, Gabriel Mejia Gonzalez, Robin San Roman, Christophe Touret, Corinne Wong, Carleigh Wood, Bokai Yu, Pierre Andrews, Can Balioglu, Peng-Jen Chen, Marta R. Costa-jussà, Maha Elbayad, Hongyu Gong, Francisco Guzmán, Kevin Heffernan, Somya Jain, Justine Kao, Ann Lee, Xutai Ma, Alexandre Mourachko, Benjamin N. Peloquin, Juan Pino, Sravya Popuri, Christophe Ropers, Safiyyah Saleem, Holger Schwenk, Anna Y. Sun, Paden Tomasello, Changhan Wang, Jeff Wang, Skyler Wang, Mary Williamson

CoRR, 2023

SeamlessM4T-Massively Multilingual & Multimodal Machine Translation.

Seamless Communication, Loïc Barrault, Yu-An Chung, Mariano Coria Meglioli, David Dale, Ning Dong, Paul-Ambroise Duquenne, Hady Elsahar, Hongyu Gong, Kevin Heffernan, John Hoffman, Christopher Klaiber, Pengwei Li, Daniel Licht, Jean Maillard, Alice Rakotoarison, Kaushik Ram Sadagopan, Guillaume Wenzek, Ethan Ye, Bapi Akula, Peng-Jen Chen, Naji El Hachem, Brian Ellis, Gabriel Mejia Gonzalez, Justin Haaheim, Prangthip Hansanti, Russ Howes, Bernie Huang, Min-Jae Hwang, Hirofumi Inaguma, Somya Jain, Elahe Kalbassi, Amanda Kallet, Ilia Kulikov, Janice Lam, Daniel Li, Xutai Ma, Ruslan Mavlyutov, Benjamin N. Peloquin, Mohamed Ramadan, Abinesh Ramakrishnan, Anna Y. Sun, Kevin Tran, Tuan Tran, Igor Tufanov, Vish Vogeti, Carleigh Wood, Yilin Yang, Bokai Yu, Pierre Andrews, Can Balioglu, Marta R. Costa-jussà, Onur Celebi, Maha Elbayad, Cynthia Gao, Francisco Guzmán, Justine Kao, Ann Lee, Alexandre Mourachko, Juan Pino, Sravya Popuri, Christophe Ropers, Safiyyah Saleem, Holger Schwenk, Paden Tomasello, Changhan Wang, Jeff Wang, Skyler Wang

CoRR, 2023

Multilingual Speech-to-Speech Translation into Multiple Target Languages.

Hongyu Gong, Ning Dong, Sravya Popuri, Vedanuj Goswami, Ann Lee, Juan Pino

CoRR, 2023

Exploration on HuBERT with Multiple Resolutions.

Jiatong Shi, Yun Tang, Hirofumi Inaguma, Hongyu Gong, Juan Pino, Shinji Watanabe

CoRR, 2023

Exploration on HuBERT with Multiple Resolution.

Jiatong Shi, Yun Tang, Hirofumi Inaguma, Hongyu Gong, Juan Pino, Shinji Watanabe

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

Pre-training for Speech Translation: CTC Meets Optimal Transport.

Phuong-Hang Le, Hongyu Gong, Changhan Wang, Juan Pino, Benjamin Lecouteux, Didier Schwab

Proceedings of the International Conference on Machine Learning, 2023

Improving Speech-to-Speech Translation Through Unlabeled Text.

Xuan-Phi Nguyen, Sravya Popuri, Changhan Wang, Yun Tang, Ilia Kulikov, Hongyu Gong

Proceedings of the IEEE International Conference on Acoustics, 2023

A Holistic Cascade System, Benchmark, and Human Evaluation Protocol for Expressive Speech-to-Speech Translation.

Wen-Chin Huang, Benjamin N. Peloquin, Justine Kao, Changhan Wang, Hongyu Gong, Elizabeth Salesky, Yossi Adi, Ann Lee, Peng-Jen Chen

Proceedings of the IEEE International Conference on Acoustics, 2023

Named Entity Detection and Injection for Direct Speech Translation.

Marco Gaido, Yun Tang, Ilia Kulikov, Rongqing Huang, Hongyu Gong, Hirofumi Inaguma

Proceedings of the IEEE International Conference on Acoustics, 2023

Non-compositional Expression Generation Based on Curriculum Learning and Continual Learning.

Jianing Zhou, Ziheng Zeng, Hongyu Gong, Suma Bhat

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translations.

Paul-Ambroise Duquenne, Hongyu Gong, Ning Dong, Jingfei Du, Ann Lee, Vedanuj Goswami, Changhan Wang, Juan Pino, Benoît Sagot, Holger Schwenk

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Speech-to-Speech Translation for a Real-world Unwritten Language.

Peng-Jen Chen, Kevin Tran, Yilin Yang, Jingfei Du, Justine Kao, Yu-An Chung, Paden Tomasello, Paul-Ambroise Duquenne, Holger Schwenk, Hongyu Gong, Hirofumi Inaguma, Sravya Popuri, Changhan Wang, Juan Pino, Wei-Ning Hsu, Ann Lee

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

2022

Efficient Language Modeling with Sparse all-MLP.

Ping Yu, Mikel Artetxe, Myle Ott, Sam Shleifer, Hongyu Gong, Ves Stoyanov, Xian Li

CoRR, 2022

Textless Speech-to-Speech Translation on Real Data.

Ann Lee, Hongyu Gong, Paul-Ambroise Duquenne, Holger Schwenk, Peng-Jen Chen, Changhan Wang, Sravya Popuri, Yossi Adi, Juan Miguel Pino, Jiatao Gu, Wei-Ning Hsu

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Findings of the IWSLT 2022 Evaluation Campaign.

Antonios Anastasopoulos, Loïc Barrault, Luisa Bentivogli, Marcely Zanon Boito, Ondrej Bojar, Roldano Cattoni, Anna Currey, Georgiana Dinu, Kevin Duh, Maha Elbayad, Clara Emmanuel, Yannick Estève, Marcello Federico, Christian Federmann, Souhir Gahbiche, Hongyu Gong, Roman Grundkiewicz, Barry Haddow, Benjamin Hsu, Dávid Javorský, Vera Kloudová, Surafel Melaku Lakew, Xutai Ma, Prashant Mathur, Paul McNamee, Kenton Murray, Maria Nadejde, Satoshi Nakamura, Matteo Negri, Jan Niehues, Xing Niu, John Ortega, Juan Miguel Pino, Elizabeth Salesky, Jiatong Shi, Matthias Sperber, Sebastian Stüker, Katsuhito Sudoh, Marco Turchi, Yogesh Virkar, Alexander Waibel, Changhan Wang, Shinji Watanabe

Proceedings of the 19th International Conference on Spoken Language Translation, 2022

From Start to Finish: Latency Reduction Strategies for Incremental Speech Synthesis in Simultaneous Speech-to-Speech Translation.

Danni Liu, Changhan Wang, Hongyu Gong, Xutai Ma, Yun Tang, Juan Miguel Pino

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

Contrastive Clustering to Mine Pseudo Parallel Data for Unsupervised Translation.

Xuan-Phi Nguyen, Hongyu Gong, Yun Tang, Changhan Wang, Philipp Koehn, Shafiq R. Joty

Proceedings of the Tenth International Conference on Learning Representations, 2022

T-Modules: Translation Modules for Zero-Shot Cross-Modal Machine Translation.

Paul-Ambroise Duquenne, Hongyu Gong, Benoît Sagot, Holger Schwenk

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Unified Speech-Text Pre-training for Speech Translation and Recognition.

Yun Tang, Hongyu Gong, Ning Dong, Changhan Wang, Wei-Ning Hsu, Jiatao Gu, Alexei Baevski, Xian Li, Abdelrahman Mohamed, Michael Auli, Juan Miguel Pino

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

Idiomatic Expression Paraphrasing without Strong Supervision.

Jianing Zhou, Ziheng Zeng, Hongyu Gong, Suma Bhat

Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022

2021

Textless Speech-to-Speech Translation on Real Data.

Ann Lee, Hongyu Gong, Paul-Ambroise Duquenne, Holger Schwenk, Peng-Jen Chen, Changhan Wang, Sravya Popuri, Juan Miguel Pino, Jiatao Gu, Wei-Ning Hsu

CoRR, 2021

Direct simultaneous speech to speech translation.

Xutai Ma, Hongyu Gong, Danni Liu, Ann Lee, Yun Tang, Peng-Jen Chen, Wei-Ning Hsu, Kenneth Heafield, Phillip Koehn, Juan Miguel Pino

CoRR, 2021

Incremental Speech Synthesis For Speech-To-Speech Translation.

Danni Liu, Changhan Wang, Hongyu Gong, Xutai Ma, Yun Tang, Juan Miguel Pino

CoRR, 2021

LAWDR: Language-Agnostic Weighted Document Representations from Pre-trained Models.

Hongyu Gong, Vishrav Chaudhary, Yuqing Tang, Francisco Guzmán

CoRR, 2021

Demystify Optimization Challenges in Multilingual Transformers.

Xian Li, Hongyu Gong

CoRR, 2021

Adaptive Sparse Transformer for Multilingual Translation.

Hongyu Gong, Xian Li, Dmitriy Genzel

CoRR, 2021

From Solving a Problem Boldly to Cutting the Gordian Knot: Idiomatic Text Generation.

Jianing Zhou, Hongyu Gong, Suma Bhat

CoRR, 2021

Self-Supervised Euphemism Detection and Identification for Content Moderation.

Wanzheng Zhu, Hongyu Gong, Rohan Bansal, Zachary Weinberg, Nicolas Christin, Giulia Fanti, Suma Bhat

Proceedings of the 42nd IEEE Symposium on Security and Privacy, 2021

Robust Optimization for Multilingual Translation with Imbalanced Data.

Xian Li, Hongyu Gong

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling.

Hongyu Gong, Yun Tang, Juan Miguel Pino, Xian Li

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Multimodal and Multilingual Embeddings for Large-Scale Speech Mining.

Paul-Ambroise Duquenne, Hongyu Gong, Holger Schwenk

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

PIE: A Parallel Idiomatic Expression Corpus for Idiomatic Sentence Generation and Paraphrasing.

Jianing Zhou, Hongyu Gong, Suma Bhat

Proceedings of the 17th Workshop on Multiword Expressions, 2021

FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task.

Yun Tang, Hongyu Gong, Xian Li, Changhan Wang, Juan Miguel Pino, Holger Schwenk, Naman Goyal

Proceedings of the 18th International Conference on Spoken Language Translation, 2021

WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipedia.

Holger Schwenk, Vishrav Chaudhary, Shuo Sun, Hongyu Gong, Francisco Guzmán

Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021

Abusive Language Detection in Heterogeneous Contexts: Dataset Collection and the Role of Supervised Attention.

Hongyu Gong, Alberto Valido, Katherine M. Ingram, Giulia Fanti, Suma Bhat, Dorothy L. Espelage

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

Representation learning of natural language and its application to language understanding and generation

Hongyu Gong

PhD thesis, 2020

FUSE: Multi-faceted Set Expansion by Coherent Clustering of Skip-Grams.

Wanzheng Zhu, Hongyu Gong, Jiaming Shen, Chao Zhang, Jingbo Shang, Suma Bhat, Jiawei Han

Proceedings of the Machine Learning and Knowledge Discovery in Databases, 2020

Rich Syntactic and Semantic Information Helps Unsupervised Text Style Transfer.

Hongyu Gong, Linfeng Song, Suma Bhat

Proceedings of the 13th International Conference on Natural Language Generation, 2020

Enriching Word Embeddings with Temporal and Spatial Information.

Hongyu Gong, Suma Bhat, Pramod Viswanath

Proceedings of the 24th Conference on Computational Natural Language Learning, 2020

Recurrent Chunking Mechanisms for Long-Text Machine Reading Comprehension.

Hongyu Gong, Yelong Shen, Dian Yu, Jianshu Chen, Dong Yu

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

IlliniMet: Illinois System for Metaphor Detection with Contextual and Linguistic Information.

Hongyu Gong, Kshitij Gupta, Akriti Jain, Suma Bhat

Proceedings of the Second Workshop on Figurative Language Processing, 2020

2019

Context-Sensitive Malicious Spelling Error Correction.

Hongyu Gong, Yuchen Li, Suma Bhat, Pramod Viswanath

Proceedings of the World Wide Web Conference, 2019

Reinforcement Learning Based Text Style Transfer without Parallel Training Corpus.

Hongyu Gong, Suma Bhat, Lingfei Wu, Jinjun Xiong, Wen-Mei W. Hwu

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

PaRe: A Paper-Reviewer Matching Approach Using a Common Topic Space.

Omer Anjum, Hongyu Gong, Suma Bhat, Wen-Mei Hwu, Jinjun Xiong

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

Equipping Educational Applications with Domain Knowledge.

Tarek Sakakini, Hongyu Gong, Jong Yoon Lee, Robert Schloss, Jinjun Xiong, Suma Bhat

Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications, 2019

2018

Embedding Syntax and Semantics of Prepositions via Tensor Decomposition.

Hongyu Gong, Suma Bhat, Pramod Viswanath

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

Preposition Sense Disambiguation and Representation.

Hongyu Gong, Jiaqi Mu, Suma Bhat, Pramod Viswanath

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

Document Similarity for Texts of Varying Lengths via Hidden Topics.

Hongyu Gong, Tarek Sakakini, Suma Bhat, Jinjun Xiong

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

2017

Distributed Multicast Tree Construction in Wireless Sensor Networks.

Hongyu Gong, Luoyi Fu, Xinzhe Fu, Lutian Zhao, Kainan Wang, Xinbing Wang

IEEE Trans. Inf. Theory, 2017

Prepositions in Context.

Hongyu Gong, Jiaqi Mu, Suma Bhat, Pramod Viswanath

CoRR, 2017

Geometry of Compositionality.

Hongyu Gong, Suma Bhat, Pramod Viswanath

Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, 2017

2015

A Distributed Algorithm to Construct Multicast Trees in WSNs: An Approximate Steiner Tree Approach.

Hongyu Gong, Lutian Zhao, Kainan Wang, Weijie Wu, Xinbing Wang

Proceedings of the 16th ACM International Symposium on Mobile Ad Hoc Networking and Computing, 2015

A distributed algorithm to construct multicast trees in wireless multi-hop networks.

Hongyu Gong, Lutian Zhao, Kainan Wang, Weijie Wu, Xinbing Wang

Proceedings of the 2015 IEEE International Conference on Communications, 2015