Repository navigation
feat(agents): agy bots get images, context and a model picker - #245
Merged
Merged
Conversation
system.status lists enabledAgents. The new-bot dialog offers the agent when there is more than one, with the experimental warning and no model choice for non-Claude agents; the model, effort and context meter under the message box show only for Claude bots.
agy's input takes text blocks only, so images go as the saved file's path (the bot opens it with view_file). The usage of its last response sizes the context meter, estimated by model family, without Compact. bots.agent_model (migration 0027), bots.setAgentModel and agents.models; the app lists the agent's models under the message box, whose names carry the effort.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
On top of #244 (its commit shows until that merges). Three things an agy bot was missing, found by using it:
Images.
agy's stream input accepts text blocks only; an image block failed the whole turn. The turn now goes as text, and the image reaches the bot as the path the courier already lists; the bot opens it withview_file(checked with the realagy: it answered the colour of a test PNG).Context.
agyhas no usage request. The usage of the last response (input + cache_read + output) is what the conversation holds, with the window taken from the model family (gemini1M,claude200k, others 128k) and the panel saying it is an estimate. No Compact for these bots.Model.
bots.agent_model(migration 0027),bots.setAgentModel, andagents.models(runsagy models, cached 10 minutes). The picker under the message box lists the agent's models; the effort is part of each id/name, so there is no separate effort picker. Passed as--model.Tests:
agy_bot.rs(model to the next process, context from usage),agentBot.test.tsx, unit tests for the turn encoding and the model list; fmt, clippy -D warnings,cargo test --workspaceandpnpm checkpass.