LLM systems & AI infrastructure · Computer Science M.S. student at HUST
Agent memory · Inference orchestration · KV cache infrastructure
Portfolio · Publications · Contact · Try the LMCache calculator ↗
NeuroMem · Streaming memory benchmark · ICML 2026, first author
Built a benchmark that interleaves writes and retrievals to measure how external LLM memory behaves as new information arrives.
SAGE · Dataflow orchestration · ICML 2026, co-author
Designed the DataStream API for composing LLM workflows and integrated NeuroMem as a backend for memory services.
LMCache · KV cache observability and capacity planning · Tencent internship
Worked on KV cache observability, trace replay, and capacity planning. Added Hunyuan and DeepSeek model support and fixed calculations in the open-source KV cache calculator.
vLLM-HUST · LLM inference on Ascend
Worked on model loading and deployment tooling for LLM inference on Ascend hardware.
CANDOR-Bench · Streaming vector search · SIGMOD 2026
Contributed to research on continuous approximate nearest-neighbor search over evolving vector streams.



