[Bugfix] [M5] Restore the device token when an async request resumes in a new slot - #109

[Bugfix] [M5] Restore the device token when an async request resumes in a new slot#109

bjf-frz merged 1 commit into

InferMatrixLab:mainInferMatrixLab/vllm-rlt:mainfrom

wuli666:fix/m5-f1-resume-prelude-tokenwuli666/vllm-rlt:fix/m5-f1-resume-prelude-tokenCopy head branch name to clipboard