Issues

• vLLM self-benchmark crash-loops on hybrid (Mamba/GDN) models: fake prefix seeding never hits the prefix cache

  backend::vllmbugdynamo-llmlanguage::python
  ai-dynamo/dynamo#18150 · Filter by author salinawu opened on Nov 4, 2026

• Fail requests explicitly after TensorRT-LLM remote-worker loss

  ai-dynamo/dynamo#18137 · Filter by author tanmayv25 opened on Nov 4, 2026
  

• [BUG]: dynamo.tokenspeed never ends a request's stream after abort; cancelled and stop-string requests stay in flight

  bugdynamo-llmlanguage::python
  ai-dynamo/dynamo#18136 · Filter by author srajabos opened on Nov 4, 2026

• [BUG]: Python wheel always builds llm-multimodal since #17496 (mm-routing no longer opt-in), slowing cold source builds

  buildlanguage::rustperformance
  ai-dynamo/dynamo#18132 · Filter by author trevor-m opened on Nov 4, 2026

• [BUG] Responses API drops requested logprobs and resets top_logprobs

  bugfrontendlanguage::rustsig-frontend
  ai-dynamo/dynamo#18095 · Filter by author indrajit96 opened on Nov 4, 2026
  

• [BUG] SGLang chat processor drops Kimi prompt controls

  backend::sglangbugfrontendlanguage::pythonsig-frontend
  ai-dynamo/dynamo#18090 · Filter by author indrajit96 opened on Nov 4, 2026
  1

• feat(frontend): add experimental TokTier prompt sessions

  backend::sglangenhancementfrontendlanguage::pythonsig-frontend
  ai-dynamo/dynamo#18086 · Filter by author elizabetht opened on Nov 4, 2026

• dynamo-vllm: tool_choice=required fails with dyn-tool-call-parser=muse

  backend::vllmbugdynamo-llmfrontendtool-calling
  ai-dynamo/dynamo#18075 · Filter by author houshengbo opened on Nov 4, 2026
  5

  

• Release blocker (1.7.0): ship AISimulate #702 to preserve evaluated deployment limits

  bugdependenciesplannerpriority::highQA Bug
  ai-dynamo/dynamo#18074 · Filter by author sttts opened on Nov 4, 2026
  

• Global Frontend: fail over to another pool on connect failure or overload

  enhancementfrontendlanguage::rustroutersig-router
  ai-dynamo/dynamo#18073 · Filter by author nnshah1 opened on Nov 4, 2026

• [FEATURE]: Env var to skip TLS certificate check for S3 LoRA downloads

  enhancementlanguage::rustlora
  ai-dynamo/dynamo#18070 · Filter by author esmaydogdu opened on Nov 4, 2026
  

• Hybrid LPX conductors without the LPX sidecar are accepted but cannot serve

  deployment::k8sdynamo-deployoperator
  ai-dynamo/dynamo#18068 · Filter by author andrewpaprotsky opened on Nov 4, 2026

• refactor(operator): retire the v1alpha1 legacy worker hash

  deployment::k8soperatorrefactor
  ai-dynamo/dynamo#18065 · Filter by author carlory opened on Nov 4, 2026

• Migrate remaining nvidia.com/v1alpha1 DynamoGraphDeployment manifests off the unserved API

  deployment::k8senhancementoperator
  ai-dynamo/dynamo#18059 · Filter by author carlory opened on Nov 4, 2026
  2

• Migrate remaining nvidia.com/v1alpha1 DynamoGraphDeployment manifests off the unserved API

  deployment::k8senhancementoperator
  ai-dynamo/dynamo#18058 · Filter by author carlory opened on Nov 4, 2026

• [BUG]: GLM JSON is buffered until finish when grammar applies immediately

  bugfrontendlanguage::rustsig-frontend
  ai-dynamo/dynamo#18057 · Filter by author Raytorin opened on Nov 4, 2026

• [BUG]: SGLang required tool calls return plain text with thinking and multimodal enabled

  backend::sglangbugdynamo-llmfrontendlanguage::rustmultimodaltool-calling
  ai-dynamo/dynamo#18054 · Filter by author indrajit96 opened on Nov 4, 2026

• [BUG]: KV router drops salted chains when vLLM's CPU offload tier is on (HostPinned placeholder events flip the cache namespace to Ambiguous)

  backend::vllmbuglanguage::rustroutersig-router
  ai-dynamo/dynamo#18052 · Filter by author Stiander opened on Nov 4, 2026

• Implement EPP peer KV-index recovery

  dep:implementingdeployment::k8senhancementeppfault tolerance[Recovery] Fault Tolerancerouter
  ai-dynamo/dynamo#18051 · Filter by author panpan0000 opened on Nov 4, 2026

• [FEAT]: Upgrade operator to controller-runtime v0.25 and expose client-go REST client metrics

  deployment::k8senhancementmetricsobservabilityoperator
  ai-dynamo/dynamo#18011 · Filter by author dongjiang1989 opened on Nov 4, 2026

• [BUG]: Router sweep rejects a public search spec without policy

  bugpythonroutersig-router
  ai-dynamo/dynamo#18002 · Filter by author wguo7 opened on Nov 4, 2026

• Global Router: pools as router-core workers, round-robin on the core

  enhancementroutersig-router
  ai-dynamo/dynamo#18001 · Filter by author nnshah1 opened on Nov 4, 2026

• docs(recipes): document the recipe changes needed to run disaggregated recipes on AWS EFA

  docsdocumentationneeds-triage
  ai-dynamo/dynamo#17992 · Filter by author shwetha-krishnamurthy opened on Nov 3, 2026

• ci: migrate generic GPU tests to shared organization runners

  cineeds-triageops
  ai-dynamo/dynamo#17984 · Filter by author sara4dev opened on Nov 3, 2026

• [BUG]: PositionalIndexer stops a Removed event at the first block it doesn't hold

  bugdynamo-runtimelanguage::rustrouter
  ai-dynamo/dynamo#17969 · Filter by author paolo-perrone opened on Nov 3, 2026