Zhongwang Zhang

According to our database, Zhongwang Zhang authored at least 15 papers between 2020 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Implicit Regularization of Dropout.

Zhongwang Zhang, Zhi-Qin John Xu

IEEE Trans. Pattern Anal. Mach. Intell., June, 2024

Local Linear Recovery Guarantee of Deep Neural Networks at Overparameterization.

Yaoyu Zhang, Leyang Zhang, Zhongwang Zhang, Zhiwei Bai

CoRR, 2024

Towards Understanding How Transformer Perform Multi-step Reasoning with Matching Operation.

Zhiwei Wang, Yunji Wang, Zhongwang Zhang, Zhangchen Zhou, Hui Jin, Tianyang Hu, Jiacheng Sun, Zhenguo Li, Yaoyu Zhang, Zhi-Qin John Xu

CoRR, 2024

Initialization is Critical to Whether Transformers Fit Composite Functions by Inference or Memorizing.

Zhongwang Zhang, Pengxiao Lin, Zhiwei Wang, Yaoyu Zhang, Zhi-Qin John Xu

CoRR, 2024

Loss Jump During Loss Switch in Solving PDEs with Neural Networks.

Zhiwei Wang, Lulu Zhang, Zhongwang Zhang, Zhi-Qin John Xu

CoRR, 2024

Anchor function: a type of benchmark functions for studying language models.

Zhongwang Zhang, Zhiwei Wang, Junjie Yao, Zhangchen Zhou, Xiaolong Li, Weinan E, Zhi-Qin John Xu

CoRR, 2024

Stochastic Modified Equations and Dynamics of Dropout Algorithm.

Zhongwang Zhang, Yuqing Li, Tao Luo, Zhi-Qin John Xu

Proceedings of the Twelfth International Conference on Learning Representations, 2024

2023

Optimistic Estimate Uncovers the Potential of Nonlinear Models.

Yaoyu Zhang, Zhongwang Zhang, Leyang Zhang, Zhiwei Bai, Tao Luo, Zhi-Qin John Xu

CoRR, 2023

Loss Spike in Training Neural Networks.

Zhongwang Zhang, Zhi-Qin John Xu

CoRR, 2023

2022

Linear Stability Hypothesis and Rank Stratification for Nonlinear Models.

Yaoyu Zhang, Zhongwang Zhang, Leyang Zhang, Zhiwei Bai, Tao Luo, Zhi-Qin John Xu

CoRR, 2022

RETSR: An Effective Review-Enhanced and Time-Aware Sequential Recommendation Framework.

Weijin Wang, Jin Li, Yilei Wang, Zhongwang Zhang

Proceedings of the 34th IEEE International Conference on Tools with Artificial Intelligence, 2022

2021

Embedding Principle: a hierarchical structure of loss landscape of deep neural networks.

Yaoyu Zhang, Yuqing Li, Zhongwang Zhang, Tao Luo, Zhi-Qin John Xu

CoRR, 2021

A variance principle explains why dropout finds flatter minima.

Zhongwang Zhang, Hanxu Zhou, Zhi-Qin John Xu

CoRR, 2021

Embedding Principle of Loss Landscape of Deep Neural Networks.

Yaoyu Zhang, Zhongwang Zhang, Tao Luo, Zhi-Qin John Xu

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

2020

A Distributed Reservation and Contention Combined TDMA Protocol for Wireless Avionics Intra-communication Networks.

Xueli Zheng, Zhongwang Zhang, Xinyang Yan, Zhongjiang Yan, Mao Yang, Bo Li

Proceedings of the IoT as a Service - 6th EAI International Conference, 2020