MobiLoRA: Accelerating LoRA-based LLM Inference on Mobile Devices via Context-aware KV Cache Optimization

Borui Li, Yitao Wang, Haoran Ma, Ligeng Chen, Jun Xiao, Shuai Wang
May, 2025
Type
Conference paper
selected
Borui Li
Borui Li
Ph.D., Assistant Professor

My research interests include embodied AI systems, AI infra for on-device and edge computing, and edge intelligence.