Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion .env.example
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,8 @@

TRYOPS_POSTGRES_USER=tryops
TRYOPS_POSTGRES_DB=tryops
TRYOPS_POSTGRES_PASSWORD=change-me-postgres-password
# TRYOPS_POSTGRES_PASSWORD=change-me-postgres-password
TRYOPS_POSTGRES_PASSWORD=tryops-local-postgres

TRYOPS_MINIO_ROOT_USER=tryops
TRYOPS_MINIO_ROOT_PASSWORD=change-me-minio-root-password
Expand Down
6 changes: 3 additions & 3 deletions MLOPS_VTON_LLM_ENTERPRISE_ROADMAP.md
Original file line number Diff line number Diff line change
Expand Up @@ -1233,12 +1233,12 @@ Current readiness: backend/data/native edge are real; the browser Console still
- [~] **P3 — Frontend.** PARTIAL: React/Vite/TypeScript Console shell, typed API client, LLM Playground with direct/canary/A-B/bandit routing, VTON Studio contract form with persisted side-by-side comparison outputs, Dashboard, Request History, Pipeline Runs, Model Registry, Evaluation evidence plus optimization/Pareto/sustainability panel, Experiments board, Governance, Incident posture plus live bad-candidate and rollback drills, native incident workflow/postmortem evidence loading, API-key session field, RBAC role-aware navigation, degraded banner, and responsive styling are implemented under `web/`; browser upload/download controls, full audit-log UI, live alert workflow controls, screenshots, and accessibility/export hardening remain.
- [x] **P4 — Services & edge wiring.** Rust gateway reverse-proxies `/api/*` to FastAPI `/v1/*`, adds request IDs, propagates trace context, enforces native rate/payload/signed-artifact/quota controls plus artifact-path preflight, calls the Go guardrail sidecar before LLM generation, and `docker-compose` ties gateway+api+Postgres+Prometheus+Grafana+guardrail+MinIO+MLflow with healthchecks/restart policies. `make app-smoke` now validates the stack through a disposable Compose project so stale local volumes do not taint readiness.
- [~] **P5 — Monitoring & dashboard.** API metrics, native Rust gateway metrics, native Go runtime telemetry, OpenTelemetry Collector wiring, native trace/log correlation evidence, and Alertmanager page/ticket routing are in place; remaining work: in-app timeseries, audit-log UI, external pager/chat credentials, and live OTLP exporters for full gateway->API->model trace stitching.
- [~] **P6 — Enterprise hardening.** PARTIAL: Rust edge API-key/JWT auth preflight, viewer/operator/admin RBAC session and nav enforcement, native edge limits, quota admission, optional file quota persistence, opt-in Postgres-backed distributed quota admission with fail-closed behavior, Postgres quota usage upsert mirroring, native Postgres migration/pooling evidence, native Postgres/MinIO backup-restore drill evidence, Valkey-compatible quota counter mirroring, `.env.example` plus Compose secret loading, native Go secret-rotation/workload-identity contract evidence, live Vault KV v2 secret retrieval/rotation evidence, Kubernetes Vault `SecretStore`/`ExternalSecret` manifests, native dependency-lock contract evidence across Python/Node/Rust/Go, native rustls TLS termination, payload limits, Rust->Go guardrail enforcement, native Go full-stack load/SLO evidence, native Go incident workflow/postmortem evidence, GitHub Actions plus native Go CI/supply-chain contract evidence, and local live Syft/Trivy/Cosign execution are in place. Remaining work: production Kubernetes External Secrets sync, external k6/locust confirmation, and external error-tracker DSN exercise.
- [~] **P6 — Enterprise hardening.** PARTIAL: Rust edge API-key/JWT auth preflight, viewer/operator/admin RBAC session and nav enforcement, native edge limits, quota admission, optional file quota persistence, opt-in Postgres-backed distributed quota admission with fail-closed behavior, Postgres quota usage upsert mirroring, native Postgres migration/pooling evidence, native Postgres/MinIO backup-restore drill evidence, Valkey-compatible quota counter mirroring, `.env.example` plus Compose secret loading, native Go secret-rotation/workload-identity contract evidence, live Vault KV v2 secret retrieval/rotation evidence, Kubernetes Vault `SecretStore`/`ExternalSecret` manifests, native dependency-lock contract evidence across Python/Node/Rust/Go, native rustls TLS termination, payload limits, Rust->Go guardrail enforcement, native C++ content-safety gating, native Go full-stack load/SLO evidence, native Go incident workflow/postmortem evidence, GitHub Actions plus native Go CI/supply-chain contract evidence, and local live Syft/Trivy/Cosign execution are in place. Remaining work: production Kubernetes External Secrets sync, external k6/locust confirmation, and external error-tracker DSN exercise.
- [~] **P7 — Demo & docs.** PARTIAL: `docs/presentation_outline.md` contains the professor demo path and `make professor-demo-acceptance` now verifies the live bad-candidate gate plus seeded Pareto, energy, full-stack, VTON, lineage, promotion, rollback, and governance artifacts. Remaining work: seed data loader, product runbook, screenshots/walkthrough, and full end-user/admin guide.
- [~] **P8 — Native-first product expansion.** PARTIAL: local P8 rows PA072-PA086 are closed by verified native evidence. Rust gateway now serves `web/dist` with SPA fallback, performs API-key/JWT auth preflight, terminates optional rustls HTTPS, makes native semantic-cache admission decisions and optional C++ vector-cache lookups before FastAPI for LLM generation, mirrors accepted quota usage into Postgres plus Valkey-compatible counters with hashed-tenant usage snapshots, can use Postgres row locks as the shared quota admission ledger when `TRYOPS_GATEWAY_QUOTA_POSTGRES_ADMISSION=true`, falls back to the local quota ledger when a non-admission durable mirror is unavailable, emits the shared native trace/log envelope as JSONL, and has a validated split-image contract with Rust builder/runtime ABI checks for gateway/controller/guardrail/benchmark/C++ tools/API/web assets; native Go modules now cover VTON/LLM job execution, signed audit/webhook event dispatch, full-stack gateway/BFF load generation with SLO reporting, native CI/supply-chain contract validation plus live Syft/Trivy/Cosign evidence, native dependency-lock contract validation, native secret-rotation/workload-identity contract validation plus live Vault KV rotation, native incident workflow/postmortem evidence, distributed quota admission validation, config-contract drift checks, TLS termination contract validation, native Postgres migration/pool execution, native Postgres/MinIO backup-restore drills, container-contract validation, quota read-model/showback generation for the BFF dashboard, trace-envelope validation/reporting, observability Collector/correlation validation, Alertmanager routing validation, runtime telemetry export, SLO regression gating over native benchmark output, and a CI-grade Rust/Go/C++ performance-budget report; native C++ VTON preprocessing, image-quality metrics, production A/B/bandit routing, semantic-cache lookup, and trace-envelope validation now flow through edge/API/evidence paths. Production Kubernetes External Secrets sync, external k6/locust confirmation, external error-tracker DSN exercise, and live OTLP exporters remain.
- [~] **P8 — Native-first product expansion.** PARTIAL: local P8 rows PA072-PA086 are closed by verified native evidence. Rust gateway now serves `web/dist` with SPA fallback, performs API-key/JWT auth preflight, terminates optional rustls HTTPS, makes native semantic-cache admission decisions and optional C++ vector-cache lookups before FastAPI for LLM generation, mirrors accepted quota usage into Postgres plus Valkey-compatible counters with hashed-tenant usage snapshots, can use Postgres row locks as the shared quota admission ledger when `TRYOPS_GATEWAY_QUOTA_POSTGRES_ADMISSION=true`, falls back to the local quota ledger when a non-admission durable mirror is unavailable, emits the shared native trace/log envelope as JSONL, and has a validated split-image contract with Rust builder/runtime ABI checks for gateway/controller/guardrail/benchmark/C++ tools/API/web assets; native Go modules now cover VTON/LLM job execution, signed audit/webhook event dispatch, full-stack gateway/BFF load generation with SLO reporting, native CI/supply-chain contract validation plus live Syft/Trivy/Cosign evidence, native dependency-lock contract validation, native secret-rotation/workload-identity contract validation plus live Vault KV rotation, native incident workflow/postmortem evidence, distributed quota admission validation, config-contract drift checks, TLS termination contract validation, native Postgres migration/pool execution, native Postgres/MinIO backup-restore drills, container-contract validation, quota read-model/showback generation for the BFF dashboard, trace-envelope validation/reporting, observability Collector/correlation validation, Alertmanager routing validation, runtime telemetry export, SLO regression gating over native benchmark output, and a CI-grade Rust/Go/C++ performance-budget report; Wave 3 native fabric now adds C++ admission control, retry budgets, PII/secret redaction, content-safety gating, tamper-evident audit logs, Bloom idempotency dedup, HyperLogLog cardinality, LRU/TTL response cache, cost attribution, reservoir/priority trace sampling, plus Go consistent-hash routing; native C++ VTON preprocessing, image-quality metrics, production A/B/bandit routing, semantic-cache lookup, and trace-envelope validation also flow through edge/API/evidence paths. Production Kubernetes External Secrets sync, external k6/locust confirmation, external error-tracker DSN exercise, and live OTLP exporters remain.

### Execution order
P3 Console shell -> thin LLM slice -> VTON product slice -> operator control room -> native enterprise boundary -> production profile. Ship the thin vertical slice first: UI -> Rust gateway -> API -> real/fallback LLM -> DB -> feedback -> dashboard -> Grafana.

### Acceptance (Gate: Product Ready)
A user opens the Console in a browser and can, with no terminal, run LLM and VTON requests, see metrics/quota/trace/lineage, submit feedback, review history/dashboard/registry/audit, and as an admin promote or block a model through policy-gated controls. The full stack starts with `make app-up` and is smoke-tested with `make app-smoke`; native edge/job/SLO/config/container/CI/load/trace/observability/alerts/postgres/backup/TLS/performance/quota-read-model/distributed-quota/runtime-telemetry/live-secret evidence comes from `make native-rust-smoke`, `make native-edge-cache-smoke`, `make native-edge-guardrail-smoke`, `make native-quota-ledger-smoke`, `make native-distributed-quota-smoke`, `make native-secret-rotation-live`, `make native-quota-read-model-sample`, `make native-runtime-telemetry-sample`, `make native-observability-contract-sample`, `make native-alertmanager-contract-sample`, `make native-db-migrator-sample`, `make native-backup-restore-sample`, `make native-tls-contract-sample`, `make native-tls-smoke`, `make native-static-smoke`, `make native-job-runner-sample`, `make vton-native-api-sample`, `make gateway-benchmark-native`, `make native-fullstack-load-sample`, `make native-ci-contract-live`, `make native-slo-gate-sample`, `make native-config-contract-sample`, `make native-container-contract-sample`, `make native-trace-envelope-sample`, and `make native-performance-budget-sample`; backend contracts remain covered by the Python test suite. The professor-demo evidence bundle is gated by `make professor-demo-acceptance`.
A user opens the Console in a browser and can, with no terminal, run LLM and VTON requests, see metrics/quota/trace/lineage, submit feedback, review history/dashboard/registry/audit, and as an admin promote or block a model through policy-gated controls. The full stack starts with `make app-up` and is smoke-tested with `make app-smoke`; native edge/job/SLO/config/container/CI/load/trace/observability/alerts/postgres/backup/TLS/performance/quota-read-model/distributed-quota/runtime-telemetry/live-secret evidence comes from `make native-rust-smoke`, `make native-edge-cache-smoke`, `make native-edge-guardrail-smoke`, `make native-admission-sample`, `make native-redaction-sample`, `make native-safety-sample`, `make native-audit-log-sample`, `make native-dedup-sample`, `make native-hll-sample`, `make native-consistent-hash-sample`, `make native-cache-sample`, `make native-cost-sample`, `make native-sampler-sample`, `make native-retry-sample`, `make native-quota-ledger-smoke`, `make native-distributed-quota-smoke`, `make native-secret-rotation-live`, `make native-quota-read-model-sample`, `make native-runtime-telemetry-sample`, `make native-observability-contract-sample`, `make native-alertmanager-contract-sample`, `make native-db-migrator-sample`, `make native-backup-restore-sample`, `make native-tls-contract-sample`, `make native-tls-smoke`, `make native-static-smoke`, `make native-job-runner-sample`, `make vton-native-api-sample`, `make gateway-benchmark-native`, `make native-fullstack-load-sample`, `make native-ci-contract-live`, `make native-slo-gate-sample`, `make native-config-contract-sample`, `make native-container-contract-sample`, `make native-trace-envelope-sample`, and `make native-performance-budget-sample`; backend contracts remain covered by the Python test suite. The professor-demo evidence bundle is gated by `make professor-demo-acceptance`.
Loading
Loading