Skip to content

Publish TrainerRank checkpoint slots#747

Merged
bradhilton merged 1 commit into
mainfrom
agent/trainer-rank-slot-publish
Jul 11, 2026
Merged

Publish TrainerRank checkpoint slots#747
bradhilton merged 1 commit into
mainfrom
agent/trainer-rank-slot-publish

Conversation

@bradhilton

Copy link
Copy Markdown
Collaborator

Summary

  • retain validated adapter metadata on trainable TrainerRank checkpoint slots
  • export a selected dynamic slot through the existing distributed vLLM LoRA codecs without mutating base LoRA tensors
  • preserve legacy alpha-only loading and static publisher behavior
  • cover dense exact export and static/dynamic Qwen 3.5 packed-MoE codec paths

Why

Caladan coordinates cache upload, refresh, and W&B commits, but ART owns the live trained tensors and model-specific export codecs. Clean ART main had no supported way to serialize a dynamic checkpoint slot, so Caladan could only fail closed rather than risk publishing stale base A/B tensors.

Validation

  • TrainerRank validation suite: 43 passed before the final legacy-compatibility assertion was added
  • focused Ruff: passed on the final diff
  • focused ty: exit 0 on the final diff; existing torch.distributed attribute warnings remain
  • dense and packed-MoE codec tests are included, but local collection requires Megatron Bridge/Transformer Engine and a CUDA-capable environment; the CPU workstation cannot build DeepEP or import Transformer Engine

@bradhilton bradhilton merged commit 1d1b287 into main Jul 11, 2026
5 checks passed
@bradhilton bradhilton deleted the agent/trainer-rank-slot-publish branch July 11, 2026 01:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant