Skip to content

Add SGLang as a fourth inference engine - #50

Open
cguldogan wants to merge 24 commits into
NVIDIA:mainfrom
cguldogan:pr/sglang-engine
Open

cguldogan wants to merge 24 commits into
NVIDIA:mainfrom
cguldogan:pr/sglang-engine

sglang: probe /get_model_info, never /health

dc024b6
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs