Ziniu Li

According to our database, Ziniu Li authored at least 25 papers between 2019 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Sensing Jamming Strategy From Limited Observations: An Imitation Learning Perspective.

Youlin Fan, Bo Jiu, Wenqiang Pu, Ziniu Li, Kang Li, Hongwei Liu

IEEE Trans. Signal Process., 2024

Entropic Distribution Matching in Supervised Fine-tuning of LLMs: Less Overfitting and Better Diversity.

Ziniu Li, Congliang Chen, Tian Xu, Zeyu Qin, Jiancong Xiao, Ruoyu Sun, Zhi-Quan Luo

CoRR, 2024

Adam-mini: Use Fewer Learning Rates To Gain More.

Yushun Zhang, Congliang Chen, Ziniu Li, Tian Ding, Chenwei Wu, Yinyu Ye, Zhi-Quan Luo, Ruoyu Sun

CoRR, 2024

BWArea Model: Learning World Model, Inverse Dynamics, and Policy for Controllable Language Generation.

Chengxing Jia, Pengyuan Wang, Ziniu Li, Yi-Chen Li, Zhilong Zhang, Nan Tang, Yang Yu

CoRR, 2024

On the Algorithmic Bias of Aligning Large Language Models with RLHF: Preference Collapse and Matching Regularization.

Jiancong Xiao, Ziniu Li, Xingyu Xie, Emily J. Getzen, Cong Fang, Qi Long, Weijie J. Su

CoRR, 2024

Why Transformers Need Adam: A Hessian Perspective.

Yushun Zhang, Congliang Chen, Tian Ding, Ziniu Li, Ruoyu Sun, Zhi-Quan Luo

CoRR, 2024

ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models.

Ziniu Li, Tian Xu, Yushun Zhang, Zhihang Lin, Yang Yu, Ruoyu Sun, Zhi-Quan Luo

Proceedings of the Forty-first International Conference on Machine Learning, 2024

When is RL better than DPO in RLHF? A Representation and Optimization Perspective.

Ziniu Li, Tian Xu, Yang Yu

Proceedings of the Second Tiny Papers Track at ICLR 2024, 2024

Unlocking Black-Box Prompt Tuning Efficiency via Zeroth-Order Optimization.

Heshen Zhan, Congliang Chen, Tian Ding, Ziniu Li, Ruoyu Sun

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

2023

Policy Optimization in RLHF: The Impact of Out-of-preference Data.

Ziniu Li, Tian Xu, Yang Yu

CoRR, 2023

ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models.

Ziniu Li, Tian Xu, Yushun Zhang, Yang Yu, Ruoyu Sun, Zhi-Quan Luo

CoRR, 2023

Deploying Offline Reinforcement Learning with Human Feedback.

Ziniu Li, Ke Xu, Liu Liu, Lanqing Li, Deheng Ye, Peilin Zhao

CoRR, 2023

Theoretical Analysis of Offline Imitation With Supplementary Dataset.

Ziniu Li, Tian Xu, Yang Yu, Zhi-Quan Luo

CoRR, 2023

Provably Efficient Adversarial Imitation Learning with Unknown Transitions.

Tian Xu, Ziniu Li, Yang Yu, Zhi-Quan Luo

Proceedings of the Uncertainty in Artificial Intelligence, 2023

Imitation Learning from Imperfection: Theoretical Justifications and Algorithms.

Ziniu Li, Tian Xu, Zeyu Qin, Yang Yu, Zhi-Quan Luo

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

2022

Error Bounds of Imitating Policies and Environments for Reinforcement Learning.

Tian Xu, Ziniu Li, Yang Yu

IEEE Trans. Pattern Anal. Mach. Intell., 2022

Understanding Adversarial Imitation Learning in Small Sample Regime: A Stage-coupled Analysis.

Tian Xu, Ziniu Li, Yang Yu, Zhi-Quan Luo

CoRR, 2022

A Note on Target Q-learning For Solving Finite MDPs with A Generative Oracle.

Ziniu Li, Tian Xu, Yang Yu

CoRR, 2022

Rethinking ValueDice: Does It Really Improve Performance?

Ziniu Li, Tian Xu, Yang Yu, Zhi-Quan Luo

CoRR, 2022

HyperDQN: A Randomized Exploration Method for Deep Reinforcement Learning.

Ziniu Li, Yingru Li, Yushun Zhang, Tong Zhang, Zhi-Quan Luo

Proceedings of the Tenth International Conference on Learning Representations, 2022

2021

Nearly Minimax Optimal Adversarial Imitation Learning with Known and Unknown Transitions.

Tian Xu, Ziniu Li, Yang Yu

CoRR, 2021

2020

Solving the Inverse Design Problem of Electrical Fuse With Machine Learning.

Xinjian Huang, Ziniu Li, Zhiyuan Liu, Bin Xiang, Yingsan Geng, Jianhua Wang

IEEE Access, 2020

Error Bounds of Imitating Policies and Environments.

Tian Xu, Ziniu Li, Yang Yu

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Efficient Exploration by Novelty-Pursuit.

Ziniu Li, Xiong-Hui Chen

Proceedings of the Distributed Artificial Intelligence - Second International Conference, 2020

2019

On Value Discrepancy of Imitation Learning.

Tian Xu, Ziniu Li, Yang Yu

CoRR, 2019