Issues

• analyzer: confusable-tools fires per pair, so large uniform surfaces drown in it (Notion: 110 findings on 24 tools)

  area:mcpdesign
  GoReal-AI/echostash-oss#129 · Filter by author YoadElkayam opened on Sep 13, 2026

• queue: eval-run dispatch robustness — idempotent jobId, enqueue failure handling, stalled workers

  area:infra
  GoReal-AI/echostash-oss#98 · Filter by author YoadElkayam opened on Aug 27, 2026

• cli: mcp audit --check gate hardening (NaN threshold, corrupt baseline, top-level title) + tests

  area:mcpgood first issue
  GoReal-AI/echostash-oss#97 · Filter by author YoadElkayam opened on Aug 27, 2026
  1

• EPIC: MCP tool surface — discovery, audit, selection eval, CI regression gate

  area:mcpepic
  GoReal-AI/echostash-oss#93 · Filter by author YoadElkayam opened on Jul 28, 2026 · M7 — MCP tool surface (audit → eval → gate)
  8

• runner: refresh cost.ts pricing table (stale for current models)

  area:runnergood first issue
  GoReal-AI/echostash-oss#92 · Filter by author YoadElkayam opened on Jul 28, 2026 · M3 — Runner + provider layer + sandbox

• mcp: extend the gate to selection accuracy — model/spec pinning + neighbor blast radius

  area:mcpdesign
  GoReal-AI/echostash-oss#90 · Filter by author YoadElkayam opened on Jul 28, 2026 · M7 — MCP tool surface (audit → eval → gate)
  1

• mcp: echostash mcp eval — selection accuracy + confusion matrix

  area:cliarea:mcp
  GoReal-AI/echostash-oss#89 · Filter by author YoadElkayam opened on Jul 28, 2026 · M7 — MCP tool surface (audit → eval → gate)

• shared+scoring: tool_selection scorer family + ScorerTarget 'tool_choice'

  area:runnerarea:shared
  GoReal-AI/echostash-oss#88 · Filter by author YoadElkayam opened on Jul 28, 2026 · M7 — MCP tool surface (audit → eval → gate)

• mcp: echostash mcp gen-cases — held-out synthetic query generation

  area:mcp
  GoReal-AI/echostash-oss#87 · Filter by author YoadElkayam opened on Jul 28, 2026 · M7 — MCP tool surface (audit → eval → gate)

• mcp: case file — user-authored + generated queries (.echostash/mcp-cases.json)

  area:mcpdesign
  GoReal-AI/echostash-oss#86 · Filter by author YoadElkayam opened on Jul 28, 2026 · M7 — MCP tool surface (audit → eval → gate)

• infra: split runner entrypoints so bullmq/redis stays out of CLI bundles

  area:infraarea:runnergood first issue
  GoReal-AI/echostash-oss#85 · Filter by author YoadElkayam opened on Jul 28, 2026 · M7 — MCP tool surface (audit → eval → gate)

• server: restrict API-key management endpoints to session (admin) auth

  area:serverpriority:mvp
  GoReal-AI/echostash-oss#73 · Filter by author YoadElkayam opened on Jun 29, 2026 · M5 — CI gate + GitHub App
  

• EPIC: MVP — usable end-to-end (scan → sandbox → eval → CI)

  epicpriority:mvp
  GoReal-AI/echostash-oss#66 · Filter by author YoadElkayam opened on Jun 21, 2026

• MVP acceptance: end-to-end smoke (scan → sandbox → dataset → eval → CI) + README quickstart

  area:docsarea:infraepicpriority:mvp
  GoReal-AI/echostash-oss#65 · Filter by author YoadElkayam opened on Jun 21, 2026 · M6 — Docker + docs + seed (demoable v1)

• web: trim MVP nav to the core loop (hide Observability + Storage) + workspace state

  area:webpriority:mvp
  GoReal-AI/echostash-oss#64 · Filter by author YoadElkayam opened on Jun 21, 2026

• server: POST /api/ci/check — regression gate aggregation

  area:serverpriority:mvp
  GoReal-AI/echostash-oss#63 · Filter by author YoadElkayam opened on Jun 21, 2026 · M5 — CI gate + GitHub App

• cli: echostash init — onboarding + echostash.config (where your scans are saved)

  area:cligood first issuepriority:mvp
  GoReal-AI/echostash-oss#62 · Filter by author YoadElkayam opened on Jun 21, 2026 · M2 — Agentless analyzer + scan ingest + registry UI

• web: settings wired (providers + API keys)

  area:webpriority:mvpweb-wiring
  GoReal-AI/echostash-oss#54 · Filter by author YoadElkayam opened on Jun 18, 2026 · M5 — CI gate + GitHub App

• web: sources page wired (connect repo, scan status, change feed)

  area:webpriority:mvpweb-wiring
  GoReal-AI/echostash-oss#53 · Filter by author YoadElkayam opened on Jun 18, 2026 · M5 — CI gate + GitHub App

• web: scorer management (persist + attach scorers to datasets/prompts)

  area:webpriority:mvpweb-wiring
  GoReal-AI/echostash-oss#52 · Filter by author YoadElkayam opened on Jun 18, 2026 · M4 — Datasets + eval matrix + scorers

• web: datasets pages wired (cases incl. expected + mocked messages)

  area:webpriority:mvpweb-wiring
  GoReal-AI/echostash-oss#51 · Filter by author YoadElkayam opened on Jun 18, 2026 · M4 — Datasets + eval matrix + scorers

• web: projects pages wired (create + attach repo)

  area:webpriority:mvpweb-wiring
  GoReal-AI/echostash-oss#50 · Filter by author YoadElkayam opened on Jun 18, 2026 · M3 — Runner + provider layer + sandbox

• web: dashboard wired to live stats

  area:webweb-wiring
  GoReal-AI/echostash-oss#49 · Filter by author YoadElkayam opened on Jun 18, 2026 · M6 — Docker + docs + seed (demoable v1)

• server: change-feed + scan-runs read API

  area:serverpriority:mvp
  GoReal-AI/echostash-oss#47 · Filter by author YoadElkayam opened on Jun 18, 2026 · M2 — Agentless analyzer + scan ingest + registry UI

• server: workspace settings + provider config API

  area:serverpriority:mvp
  GoReal-AI/echostash-oss#46 · Filter by author YoadElkayam opened on Jun 18, 2026 · M3 — Runner + provider layer + sandbox
  1