feat: add opt-in AgentPond tracing - #17
Open
marcusschiesser wants to merge 1 commit into
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changed
LLMspans around PentesterFlow's real OpenAI-compatible chat and streaming path.agentpond/state out of gitAgentPond fits PentesterFlow's audit-oriented workflow because operators can keep trace storage local or select their own Files SDK provider. Nothing is exported unless
AGENTPOND_ENABLED=trueand a Files SDK environment is configured.Validation
Commands run:
npm ci --dry-run npm run typecheck npm run lint npm run test npm run buildAll passed: 62 test files / 657 tests, plus the production bundle.
End-to-end trace validation used the existing in-process OpenAI-compatible server fixture, which exercises the actual
OpenAIClientHTTP and SSE paths:The focused integration suite passed all 17 tests. AgentPond processed 15 objects / 30 events, and trace
794674826ab0764c2a8c0d6edfbbc8cbread back asopenai-compat.chatwith modelqwen-coder, OpenInference span kindLLM, and privacy-safe request/output counts.Limitations
This first integration covers OpenAI-compatible backends (including LM Studio, Kimi, OpenRouter, and DeepSeek routing through that client). The separate Ollama, Gemini, and Anthropic clients are unchanged.