computer-use-remote
Detailed operating guide for using computer_use_remote on the connected local machine. Load this skill before using computer_use_remote for desktop control, screenshots, menus, browser chrome, or other native UI tasks.
Best for desktop automationWorks with GitHub
⌘source
- author
@agent0ai- language
- Python
★17kstars
3.5kforks
Apr 29, 2026
✦overview.md
Key Features
- ·Local desktop and native UI control
- ·Screenshot-driven interaction loop
- ·Session management with startsession
- ·Normalized global screen coordinates
- ·Direct browser tooling preferred for browser tasks
Use Cases
- →Automating clicks on native UI elements like menus or dialog boxes
- →Taking screenshots to verify desktop application state
- →Controlling a local browser for tasks that require screenshot feedback
- →Interacting with desktop applications that lack API access
Best for
- ✓desktop automation
- ✓native UI testing
- ✓screenshot-based workflows
Not ideal for
- !pure browser automation
- !headless environments
FAQs
name
computer-use-remote
description
Detailed operating guide for using computer_use_remote on the connected local machine. Load this skill before using computer_use_remote for desktop control, screenshots, menus, browser chrome, or other native UI tasks.
version:1.1.0
author:Agent Zero Team
tags:["computer-use","desktop","local-ui","screenshots","native-ui"]
trigger_patterns:["computer use","computer-use","computer_use_remote","local desktop control","control local browser","click on screen","native ui"]
allowed_tools:["computer_use_remote","code_execution_remote"]
Computer Use Remote
When to Use
Load this skill before using computer_use_remote for local desktop and native UI tasks on the connected machine.
If the task is browser-only and the user is flexible, prefer direct browser tooling because it is usually more reliable and token-efficient than screenshot-driven desktop control.
Core Loop
- Call
start_sessionfirst. - Decide from the latest screenshot, not from memory.
- Interactive actions (
move,click,scroll,key,type) already attach a fresh screenshot after they run. - Use
statusfor state without starting a session. - Use
captureonly when you need another screenshot without taking an action.
Operating Rules
- Only the latest screenshot or a definitive tool result counts as evidence.
- The current API uses normalized global screen coordinates; do not assume window ids, element indexes, background-safe input, or semantic click targets unless the runtime explicitly advertises them.
- Prefer accessibility and semantic UI paths first: shortcuts, command palettes, menu accelerators, address/search bars, focus traversal, and other keyboard-accessible controls.
$install
1-click copynpx skills add agent0ai/agent-zero --skill computer-use-remoteSafety assessment
★
Clarity score
How clear and easy to understand the SKILL.md instructions are, rated from 1 to 5.
5/ 5
excellentVery clear and well structured, with almost no room for misunderstanding.
◎
Actionability score
How directly an agent can act on the SKILL.md instructions, rated from 1 to 5.
5/ 5
very highHighly actionable with clear, concrete steps that an agent can follow directly.