[TRTLLM-17262][refactor] Move the disaggregated service types and latency logger out of responses_utils - #21510

[TRTLLM-17262][refactor] Move the disaggregated service types and latency logger out of responses_utils#21510

JunyiXu-nv wants to merge 15 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

JunyiXu-nv:dev-junyix-feat-serve-shared-service-typesJunyiXu-nv/TensorRT-LLM:dev-junyix-feat-serve-shared-service-typesCopy head branch name to clipboard