Tianyi Zhou

According to our database, Tianyi Zhou authored at least 12 papers between 2022 and 2023.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2023

Superiority of Softmax: Unveiling the Performance Edge Over Linear Attention.

Yichuan Deng, Zhao Song, Tianyi Zhou

CoRR, 2023

H₂O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher Ré, Clark W. Barrett, Zhangyang Wang, Beidi Chen

CoRR, 2023

A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models.

Ritwik Sinha, Zhao Song, Tianyi Zhou

CoRR, 2023

The Closeness of In-Context Learning and Weight Shifting for Softmax Regression.

Shuai Li, Zhao Song, Yu Xia, Tong Yu, Tianyi Zhou

CoRR, 2023

Algorithm and Hardness for Dynamic Attention Maintenance in Large Language Models.

Jan van den Brand, Zhao Song, Tianyi Zhou

CoRR, 2023

Solving Regularized Exp, Cosh and Sinh Regression Problems.

Zhihang Li, Zhao Song, Tianyi Zhou

CoRR, 2023

Faster Sinkhorn's Algorithm with Small Treewidth.

Zhao Song, Tianyi Zhou

CoRR, 2023

Module-wise Adaptive Distillation for Multimodality Foundation Models.

Chen Liang, Jiahui Yu, Ming-Hsuan Yang, Matthew Brown, Yin Cui, Tuo Zhao, Boqing Gong, Tianyi Zhou

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time.

Zichang Liu, Jue Wang, Tri Dao, Tianyi Zhou, Binhang Yuan, Zhao Song, Anshumali Shrivastava, Ce Zhang, Yuandong Tian, Christopher Ré, Beidi Chen

Proceedings of the International Conference on Machine Learning, 2023

Space-Efficient Interior Point Method, with Applications to Linear Programming and Maximum Weight Bipartite Matching.

S. Cliff Liu, Zhao Song, Hengjie Zhang, Lichen Zhang, Tianyi Zhou

Proceedings of the 50th International Colloquium on Automata, Languages, and Programming, 2023

Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training.

Lianke Qin, Saayan Mitra, Zhao Song, Yuanyuan Yang, Tianyi Zhou

Proceedings of the IEEE International Conference on Big Data, 2023

2022

Faster Algorithm for Structured John Ellipsoid Computation.

Zhao Song, Xin Yang, Yuanyuan Yang, Tianyi Zhou

CoRR, 2022