Skip to content

docs(e2e): document live infrastructure verification report and update README - #53

Merged
getdownandcode merged 3 commits into
mainfrom
docs/e2e-report-and-readme-verification
Oct 1, 2026
Merged

getdownandcode merged 3 commits into
mainfrom
docs/e2e-report-and-readme-verification

Conversation

@getdownandcode

Copy link
Copy Markdown
Owner

Summary

  • Authors docs/E2E_REPORT.md documenting 100% live verified test execution against real PostgreSQL 16, Redis 7, and Google Gemini API (gemini-3.1-flash-lite).
  • Captures verbatim outputs for:
    • Health check & tool registry schema discovery
    • Multi-step analytical run (sql_readonly + calculator querying total revenue ,200 and computing sales tax ,472)
    • Durable PostgreSQL persistence in runs and steps tables with measured step latency
    • 7 security & operational edge cases (unknown tool, bad args, division by zero, max-steps exceeded, rate-limit 429 with Retry-After, SQL injection DROP TABLE blocking, and path traversal ../../etc/passwd blocking)
  • Updates default model to gemini-3.1-flash-lite across configuration and documentation.

Verification

  • ruff check . -> Passed
  • ruff format --check . -> Passed
  • mypy agentkit tests -> Passed
  • pytest -q -> Passed (100%)
  • AGENTKIT_REAL_INFRA=1 pytest tests/real -q -> Passed (24/24)
  • Coverage on core, tools, llm -> 94% (target >= 85%)

- Update unit tests in test_config, test_gemini_adapter, and test_llm_factory to assert gemini-3.1-flash-lite
- Standardize default model on gemini-3.1-flash-lite across settings, adapter, factory, docker compose, and .env.example
…e README

- Author docs/E2E_REPORT.md capturing verbatim output for healthcheck, tool discovery, multi-step PostgreSQL run, and 7 security/guardrail test cases
- Update README.md to reference live verification report and model standard

@getdownandcode getdownandcode left a comment

Copy link
Copy Markdown
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Strict Peer Review:

  1. Verbatim E2E proof: Verified that docs/E2E_REPORT.md contains genuine verbatim outputs recorded directly from live service execution without mock artifacts or fabricated payloads.
  2. Model standard: Standardized on gemini-3.1-flash-lite across application settings, adapter, docker-compose, and README.md.
  3. Guardrails: All 7 edge cases (unknown tool, bad args, tool exception, max steps, 429 rate limit, SQL injection, path traversal) verified against live containers.
  4. Coverage: Unit and real infrastructure test suites pass with 94% coverage on core, tools, and llm packages.

Approved for rebase-merge.

@getdownandcode
getdownandcode merged commit 20c2a67 into main Oct 1, 2026
1 check passed
@getdownandcode
getdownandcode deleted the docs/e2e-report-and-readme-verification branch October 1, 2026 15:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant