PanGu-Σ: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing.
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
CoRR, 2023
HyperPELT: Unified Parameter-Efficient Language Model Tuning for Both Language and Vision-and-Language Tasks.
Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023
Sparse Structure Search for Parameter-Efficient Tuning.
CoRR, 2022
Sparse Structure Search for Delta Tuning.
Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022
Leveraging Only the Category Name for Aspect Detection through Prompt-based Constrained Clustering.
Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022
CLSEBERT: Contrastive Learning for Syntax Enhanced Code Pre-Trained Model.
,
,
,
,
,
,
,
,
,
,
CoRR, 2021