Issues

• [P2] Roofline modeling and thermal-adaptive scheduling for Apple Silicon

  enhancement
  goodmai/basalt#45 · Filter by author goodmai opened on Oct 13, 2026

• [P2] Sanitization of abliterated and low-bit quantized weights (QuaRot + refusal-subspace)

  enhancement
  goodmai/basalt#44 · Filter by author goodmai opened on Oct 13, 2026

• [P2] L2-norm key-based KV cache eviction compatible with fast attention

  enhancement
  goodmai/basalt#43 · Filter by author goodmai opened on Oct 13, 2026

• [P1] Grammar-constrained decoding with a byte-level pushdown automaton (XGrammar)

  enhancement
  goodmai/basalt#42 · Filter by author goodmai opened on Oct 13, 2026

• [P2] Optimal test-time compute allocation with KL-based early exit

  enhancement
  goodmai/basalt#41 · Filter by author goodmai opened on Oct 13, 2026

• [P1] Entropy-based dynamic temperature (EDT) and Min-P sampling with proactive RepetitionGuard

  enhancement
  goodmai/basalt#40 · Filter by author goodmai opened on Oct 13, 2026

• [P2] Speculative cascades between local MLX and cloud models

  enhancement
  goodmai/basalt#39 · Filter by author goodmai opened on Oct 13, 2026

• [P2] Model-free speculative decoding via Token Recycling

  enhancement
  goodmai/basalt#38 · Filter by author goodmai opened on Oct 13, 2026

• [P2] Heterogeneous attention-head KV compression (DuoAttention + SnapKV)

  enhancement
  goodmai/basalt#37 · Filter by author goodmai opened on Oct 13, 2026

• [P1] Non-prefix KV cache blending for multi-file context (CacheBlend)

  enhancement
  goodmai/basalt#36 · Filter by author goodmai opened on Oct 13, 2026

• [P2] AST context for diffs and local code review for self-hosted GitLab / Gitea

  enhancement
  goodmai/basalt#35 · Filter by author goodmai opened on Oct 13, 2026
  1

• [P1] Calibrated Bradley–Terry router with cache stickiness and virtual budgets

  enhancement
  goodmai/basalt#34 · Filter by author goodmai opened on Oct 13, 2026
  1

• [P2] Quest block-sparse attention, stepwise prefill, wired_limit and memory preview

  enhancement
  goodmai/basalt#33 · Filter by author goodmai opened on Oct 13, 2026
  1

• [P1] Prefix radix tree for the KV cache and FSM JSON decoding for MCP tools

  enhancement
  goodmai/basalt#32 · Filter by author goodmai opened on Oct 13, 2026
  1

• [P1] Four-dimensional quantization scoring, MoE accounting and self-calibration from real measurements

  enhancement
  goodmai/basalt#31 · Filter by author goodmai opened on Oct 13, 2026
  1

• [P2] Observability: --stats flag and a Monitor tab with real-time telemetry

  enhancement
  goodmai/basalt#30 · Filter by author goodmai opened on Oct 13, 2026
  1

• [P2] Agent onboarding (AI_SETUP.md, --check/--inspect, MCP lifecycle) and reproducibility tests

  documentation
  goodmai/basalt#29 · Filter by author goodmai opened on Oct 13, 2026
  1

• [P0] Secure server configuration: mandatory api-key off loopback and non-destructive config update

  enhancement
  goodmai/basalt#28 · Filter by author goodmai opened on Oct 13, 2026
  1

• [P1] API for coding agents: /v1/responses, reasoning_effort, fast path for service requests

  enhancement
  goodmai/basalt#27 · Filter by author goodmai opened on Oct 13, 2026
  1

• [P1] Multi-slot conversation cache with parking and prefix protection during tool calls

  enhancement
  goodmai/basalt#26 · Filter by author goodmai opened on Oct 13, 2026
  1

• [P2] Hybrid speculative decoding: Prompt Lookup + Coupled Gumbel-Max Sampling

  enhancement
  goodmai/basalt#25 · Filter by author goodmai opened on Oct 13, 2026
  1

• [P2] Elastic KV cache, K8V4 quantization with Hadamard rotation, and a streaming resident window

  enhancement
  goodmai/basalt#24 · Filter by author goodmai opened on Oct 13, 2026
  1

• [P2] Stratified context and KV-cache manager (Hot/Warm/Cold)

  enhancement
  goodmai/basalt#23 · Filter by author goodmai opened on Oct 13, 2026
  1

• [P2] Stratified hybrid router: Local MLX ↔ OpenRouter

  enhancement
  goodmai/basalt#22 · Filter by author goodmai opened on Oct 13, 2026
  1

• [P1] Consolidate tests, scripts, and assets; cover REST controllers

  enhancement
  goodmai/basalt#21 · Filter by author goodmai opened on Oct 13, 2026
  1