Energy Cost Modelling for Optimizing Large Language Model Inference on Hardware Accelerators. - Robin Geens; Man Shi; Arne Symons; Chao Fang; Marian Verhelst (SOCC, 2024)

Anda: Unlocking Efficient LLM Inference with a Variable-Length Grouped Activation Data Format. - Chao Fang; Man Shi; Robin Geens; Arne Symons; Zhongfeng Wang; Marian Verhelst (CoRR, 2024)