Skip to content

feat(desktop): the bot's cursor on the owner's screen - #187

Merged
httpsphl merged 1 commit into
mainfrom
feat/desktop-screen-cursor
Oct 5, 2026
Merged

httpsphl merged 1 commit into
mainfrom
feat/desktop-screen-cursor

Conversation

@httpsphl

@httpsphl httpsphl commented Oct 5, 2026

Copy link
Copy Markdown
Owner

The owner asked to see the bot's mouse on their own screen, not only in the panel beside the chat (spec 24.9).

What changes

  • The outline's window (feat(desktop): outline in the bot's color around the window it uses #184) now also draws the bot's cursor over the window in use. It is drawn with GDI, without antialiasing because of the see-through color key.
  • The daemon task carries the cursor: the bot's name, the last point in that window and the action kind.
    • Reading leaves it where it was.
    • Another window starts without one.
    • A new action shows right away, not at the next 250 ms tick.
  • The owner's real mouse never moves for this. Everything stays click-through, and the outline stays right above the app in z-order.

Tests

  • Unit tests: easing, and the cursor following the last action while reading leaves it in place.
  • The real-window outline test still runs on CI. I did not run the window tests locally, because the owner is using the PC.

Manual

  • Ask a bot to click something in Notepad or Chrome. Its arrow and name should glide to the control on the real screen and a ring should show on the click. Bring another window in front of the app and the cursor should be covered with the outline.

The owner asked to see the bot's cursor on their own screen, not only in
the panel. The outline's window now draws it over the window in use: an
arrow in the bot's color with its name in a pill beside it, gliding to
the point of each action, a growing ring where it clicks and dots while
it types. The owner's mouse never moves for it. Reading leaves it where
it was; another window starts without one until the bot acts there.
@httpsphl
httpsphl enabled auto-merge October 5, 2026 01:18
@httpsphl
httpsphl merged commit ce59a3a into main Oct 5, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant