
Computer Use
FreeInteract with desktop applications through Orca's CLI.
Free · Opens the source repo
What Computer Use does
The Computer Use skill enables users to interact with local desktop applications via the Orca command-line interface (CLI). This skill is particularly useful for developers and designers who need to automate or inspect desktop app windows, leveraging accessibility features to read UI elements, control app states, and perform various user interface actions. With this skill, you can list currently running applications, retrieve their states, and manipulate UI components such as buttons and text fields through commands that are executed in a safe manner.
The skill operates by utilizing accessibility trees and screenshots to understand the layout and state of applications. Users can perform actions like clicking controls, typing text, scrolling, dragging elements, and setting values. This makes it suitable for a range of tasks, from automated testing of applications to enhancing workflows in environments where manual interaction is cumbersome. The skill also extends its functionality to web browsers and webviews, allowing for a seamless experience across different types of desktop UIs.
To get started, users must resolve the appropriate Orca CLI executable for their environment, ensuring they are using the correct version that matches the commands they intend to run. The skill emphasizes the importance of loading the full command guide before executing any commands, as the exact syntax and available options may vary between different versions of the Orca software. This ensures that users can effectively leverage the full capabilities of the skill without encountering outdated or unsupported commands.
Overall, the Computer Use skill is ideal for those looking to streamline their interaction with desktop applications, particularly in development and testing scenarios where automation can save significant time and effort.
When to use it
Use this skill when you need to automate interactions with desktop applications or inspect their UI elements.
When not to use it
This skill may not be suitable for applications that do not support accessibility features or for users unfamiliar with command-line interfaces.
What you can build with it
Automating UI Testing
Use the Computer Use skill to automate the testing of UI elements in desktop applications, ensuring consistent and repeatable test cases.
Interacting with Spotify
Control playback and access information from Spotify through Orca commands, allowing for seamless music management.
Inspecting Application States
Quickly retrieve the state of various applications to monitor their status or to trigger specific actions based on their current state.
How to install Computer Use
View source1. Install with the skills CLI
npx skills add stablyai/orca/computer-use --agent claude-code2. Or install it manually
Download the skill folder and drop it into ~/.claude/skills/ for all projects, or .claude/skills/ to scope it to one repo. Restart Claude Code so it picks up the new skill.
Anthropic's agentic coding CLI, and the reference implementation of Agent Skills. Drop a skill folder into ~/.claude/skills and Claude Code loads it automatically whenever a task matches the skill's description. Claude Code docs
Inside SKILL.md
Written by stablyaiComputer Use
This file is a discovery stub, not the usage guide. The full, version-matched computer-use
reference is served by the orca binary itself — kept out of this file on purpose so it can
never drift from the binary that will actually run your commands.
Engage Orca's computer-use surface whenever you must inspect or operate a local desktop app window — reading its accessibility tree, taking screenshots, or performing safe UI actions (click controls, type, press keys, scroll, drag, set values). It also covers browser windows, webviews, and Orca's own UI. Triggers include "computer use", "orca computer", "read Spotify", "read Slack", "control/click/read in a desktop app", and "get app state".
Resolve the CLI for this session
Choose the executable once and reuse it for every later command:
- If the
ORCA_CLI_COMMANDenvironment variable is set, use its value. Orca exports this for managed WSL sessions. - Otherwise, in a dev checkout whose session exposes
ORCA_DEV_REPO_ROOT, useorca-dev. - Otherwise, on Linux outside an Orca-managed terminal, use
orca-ide. Never run bareorcathere — outside Orca's terminals it normally resolves to the GNOME Orca screen reader (/usr/bin/orca) and starts speech on the user's machine. - Otherwise, use
orca.
Below, ORCA is a placeholder for the executable you resolved. Substitute it before
running anything; do not create a shell variable or run ORCA literally. This works the
same way in POSIX shells, PowerShell, and cmd.exe.
If the selected executable cannot run, report its exact error and stop. Do not fall through to another executable, which could silently target a different Orca build.
Load the full guide before running Orca commands
ORCA skills get computer-use
That prints the complete, version-matched guide for the exact binary that will handle your next commands — listing apps/windows, reading UI, and driving clicks, typing, and other accessibility actions. Read it first, then run the specific command you need.
Don't guess subcommands or flags from memory or from a cached copy of this stub. They
change between Orca releases, and this file deliberately no longer lists them. Confirm the
app is up with ORCA status --json (start it with ORCA open --json if needed), and
prefer --json for agent-driven calls.
If an older Orca does not recognize skills get
Use this fallback only when the selected binary explicitly reports that skills get is an
unknown command. Another failure is not proof of an older binary; report it rather than
guessing or changing executables. For a confirmed pre-guide binary, use only this bounded,
read-only bootstrap to orient. Do not dead-end and do not invent commands:
ORCA status --json
ORCA computer capabilities --json
ORCA computer list-apps --json
Then tell the user that updating Orca restores the full, version-matched guide via
ORCA skills get computer-use. Beyond these commands, ask the user rather than guessing a
command surface this older binary may not support.
Frequently asked questions about Computer Use
Similar skills
Spring Boot Testing
Master testing techniques for Spring Boot 4 applications.
GitHub Issues
Manage GitHub issues efficiently with MCP tools.
Geofeed Tuner
Optimize your IP geolocation feeds in CSV format.
Batch Files
Master Windows batch scripting for automation and task management.
Adobe Illustrator Scripting
Automate your Illustrator workflows with ExtendScript.
Plugin Structure
Create and organize Claude Code plugins effectively.
