Skip to content

Add zoom to anthropic computer - #315

Merged
jdchawla29 merged 4 commits into
mainfrom
hud-545
Feb 7, 2026
Merged

jdchawla29 merged 4 commits into
mainfrom
hud-545

Conversation

@farrelmahaztra

@farrelmahaztra farrelmahaztra commented Feb 6, 2026

Copy link
Copy Markdown
Contributor

Note

Medium Risk
Touches core computer-control pathways (mouse/scroll/key dispatch) and adds new image-processing logic that may behave differently across platforms and screen scaling.

Overview
Adds a new Anthropic zoom computer action that validates a region box, scales it from agent coordinates to screen coordinates, and returns a cropped/resized screenshot via a new executor zoom() API.

Extends executor implementations (BaseExecutor, PyAutoGUIExecutor, XDOExecutor) with shared crop/resize logic and real screenshot-based region extraction, and updates Anthropic interactions to support modifier-held mouse actions (click/scroll via hold_keys) plus repeated key presses via a new repeat parameter (capped at 100, only screenshot on the final repeat). Adds a focused unit test verifying zoom coordinate scaling and executor invocation.

Written by Cursor Bugbot for commit 745db08. This will update automatically on new commits. Configure here.

@farrelmahaztra
farrelmahaztra marked this pull request as ready for review February 6, 2026 19:51
Comment thread hud/tools/computer/anthropic.py Outdated
Comment thread hud/tools/executors/xdo.py
Comment thread hud/tools/computer/anthropic.py Outdated

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 2 potential issues.

Bugbot Autofix is OFF. To automatically fix reported issues with Cloud Agents, enable Autofix in the Cursor dashboard.

Comment thread hud/tools/computer/anthropic.py
Comment thread hud/tools/computer/anthropic.py
@jdchawla29
jdchawla29 merged commit 4624e86 into main Feb 7, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants