Skip to content

feat(megatron): visualize distributed training topology - #98

Merged
reiase merged 3 commits into
DeepLink-org:masterfrom
VincentCheungKokomo:feature/megatron-topology
Aug 25, 2026
Merged

feat(megatron): visualize distributed training topology#98
reiase merged 3 commits into
DeepLink-org:masterfrom
VincentCheungKokomo:feature/megatron-topology

Conversation

@VincentCheungKokomo

Copy link
Copy Markdown
Contributor

Summary

  • capture Megatron parallel coordinates, rank layer ranges, and module catalogs for cluster-wide inspection
  • add physical/logical placement, rank module filtering/grouping, step trends, and clearer memory evidence to the web UI
  • align optimizer telemetry with completed training steps, flush deferred samples, and keep rank heartbeats within the stale TTL

Test plan

  • .venv/bin/python -m pytest -q tests/regression/profiling/test_torch_probe_sampling.py tests/regression/ext/test_megatron_contract.py
  • cd web && cargo test
  • cd web && cargo clippy --all-targets -- -D warnings
  • Run Qwen3-8B for 20 iterations on 8 GPUs with TP=2, PP=2, DP=2
  • Verify cluster queries return all 8 ranks and every rank ends at allocator Step 20

Made with Cursor

Vincent and others added 3 commits August 25, 2026 14:16
Capture rank-local model layouts and keep final-step telemetry consistent so the web UI can explain topology, modules, memory, and step health across a Megatron cluster.

Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
@codecov

codecov Bot commented Aug 25, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

Files with missing lines Coverage Δ
tests/regression/ext/_megatron_contract.py 100.00% <100.00%> (ø)
tests/regression/ext/conftest.py 98.24% <100.00%> (+0.06%) ⬆️
tests/regression/ext/test_megatron_contract.py 100.00% <100.00%> (ø)
.../regression/profiling/test_torch_probe_sampling.py 99.66% <100.00%> (+0.01%) ⬆️
tests/unit/probing/fakes/test_fakes.py 95.85% <100.00%> (+0.08%) ⬆️
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@reiase
reiase merged commit 0cc1492 into DeepLink-org:master Aug 25, 2026
15 of 16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants