Skip to content

[None][feat] Close the Mooncake store feature gap: async loads, attention DP, speculative prefill and KV connector support in KVCacheManagerV2 - #21195

Draft
SimengLiu-nv wants to merge 20 commits into
NVIDIA:mainfrom
SimengLiu-nv:mooncake-close-main-gap
Draft

SimengLiu-nv wants to merge 20 commits into
NVIDIA:mainfrom
SimengLiu-nv:mooncake-close-main-gap

[None][feat] Attention DP: work-aware router that balances ranks by e…

2cebc83
Select commit
Loading
Failed to load commit list.
Sign in for the full log view