Yitao Wang

Latest

• MobiLoRA: Accelerating LoRA-based LLM Inference on Mobile Devices via Context-aware KV Cache Optimization
• LLM in a flash: Efficient Large Language Model Inference with Limited Memory
• Decentralized Application-Level Adaptive Scheduling for Multi-Instance DNNs on Open Mobile Devices