Haoran Ma

Latest

• MobiLoRA: Accelerating LoRA-based LLM Inference on Mobile Devices via Context-aware KV Cache Optimization
• Real-time Neural Network Inference on Extremely Weak Devices: Agile Offloading with Explainable AI