MobiLoRA: Accelerating LoRA-based LLM Inference on Mobile Devices via Context-aware KV Cache Optimization

Borui Li, Yitao Wang, Haoran Ma, Ligeng Chen, Jun Xiao, Shuai Wang
May, 2025
PDF
Type
Conference paper
selected
Borui Li
Borui Li
Ph.D., Assistant Professor
MSc./MEng. Supervisor

My research interests include AIoT system, edge computing, WebAssembly, etc.