Skip to content

feat(image): add MOSS-Image inference in the shared runtime - #144

Open
sunxfancy wants to merge 2 commits into
devfrom
codex/moss-image-shared-runtime
Open

sunxfancy wants to merge 2 commits into
devfrom
codex/moss-image-shared-runtime

Conversation

@sunxfancy

@sunxfancy sunxfancy commented Nov 6, 2026 •

Copy link
Copy Markdown
Owner

MOSS-Image's official runtime requires newer Torch and Transformers versions that conflict with SSUI's shared environment. This ports its text-only Qwen3.5 encoder, DiT, FLUX.2 VAE and sampling schedule into backend/moss_image/, allowing Base/SFT bundles to load without a separate environment or global dependency changes.

  • Add Image nodes and an example for text prompts and layout JSON, with component CPU offload, cached loading and validated safetensors shards. Downloaded Python code is never executed.
  • Include pinned upstream attribution, Apache-2.0 license, numerical reference fixtures and usage documentation.
  • Resolve string workflow annotations before exposing types to the UI. Use dev's existing IPv4 executor handling and result serialization.
  • Merge current dev to resolve executor conflicts and incorporate its fix for the invalid top-level runner.temp workflow expression. The optional GPU workflow remains opt-in/scheduled; no full model download is added to normal CI.

Validation: the synthetic-weight end-to-end test exercises HTTP requests, real loopback WebSockets, sandbox execution, sharded component loading and PNG output. It checks prepare without weights, deterministic seeds, layout input, output uniqueness and failure recovery. Numerical reference, node contract, discovery, workflow compiler, Diffusers compatibility and FLUX.2 regressions were also checked with Torch 2.4.1+cpu / Transformers 4.55.4 / Diffusers 0.38.0. Local pip check passes.

Full Base/SFT weights and GPU hardware were intentionally not tested. Component offload is implemented; the official minimal/hybrid low-memory mode is not included. Existing dependency constraints and platform lockfiles are unchanged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant