New to Claude Skills? Learn how to install them →

stablyai on GitHub

Computer Use

Free

Interact with desktop applications through Orca's CLI.

Get this skill

Free · Opens the source repo

What Computer Use does

The Computer Use skill enables users to interact with local desktop applications via the Orca command-line interface (CLI). This skill is particularly useful for developers and designers who need to automate or inspect desktop app windows, leveraging accessibility features to read UI elements, control app states, and perform various user interface actions. With this skill, you can list currently running applications, retrieve their states, and manipulate UI components such as buttons and text fields through commands that are executed in a safe manner.

The skill operates by utilizing accessibility trees and screenshots to understand the layout and state of applications. Users can perform actions like clicking controls, typing text, scrolling, dragging elements, and setting values. This makes it suitable for a range of tasks, from automated testing of applications to enhancing workflows in environments where manual interaction is cumbersome. The skill also extends its functionality to web browsers and webviews, allowing for a seamless experience across different types of desktop UIs.

To get started, users must resolve the appropriate Orca CLI executable for their environment, ensuring they are using the correct version that matches the commands they intend to run. The skill emphasizes the importance of loading the full command guide before executing any commands, as the exact syntax and available options may vary between different versions of the Orca software. This ensures that users can effectively leverage the full capabilities of the skill without encountering outdated or unsupported commands.

Overall, the Computer Use skill is ideal for those looking to streamline their interaction with desktop applications, particularly in development and testing scenarios where automation can save significant time and effort.

When to use it

Use this skill when you need to automate interactions with desktop applications or inspect their UI elements.

When not to use it

This skill may not be suitable for applications that do not support accessibility features or for users unfamiliar with command-line interfaces.

What you can build with it

Automating UI Testing

Use the Computer Use skill to automate the testing of UI elements in desktop applications, ensuring consistent and repeatable test cases.

Interacting with Spotify

Control playback and access information from Spotify through Orca commands, allowing for seamless music management.

Inspecting Application States

Quickly retrieve the state of various applications to monitor their status or to trigger specific actions based on their current state.

How to install Computer Use

View source

1. Install with the skills CLI

npx skills add stablyai/orca/computer-use --agent claude-code

2. Or install it manually

Download the skill folder and drop it into ~/.claude/skills/ for all projects, or .claude/skills/ to scope it to one repo. Restart Claude Code so it picks up the new skill.

Anthropic's agentic coding CLI, and the reference implementation of Agent Skills. Drop a skill folder into ~/.claude/skills and Claude Code loads it automatically whenever a task matches the skill's description. Claude Code docs

Inside SKILL.md

Written by stablyai

Computer Use

This file is a discovery stub, not the usage guide. The full, version-matched computer-use reference is served by the orca binary itself — kept out of this file on purpose so it can never drift from the binary that will actually run your commands.

Engage Orca's computer-use surface whenever you must inspect or operate a local desktop app window — reading its accessibility tree, taking screenshots, or performing safe UI actions (click controls, type, press keys, scroll, drag, set values). It also covers browser windows, webviews, and Orca's own UI. Triggers include "computer use", "orca computer", "read Spotify", "read Slack", "control/click/read in a desktop app", and "get app state".

Resolve the CLI for this session

Choose the executable once and reuse it for every later command:

  • If the ORCA_CLI_COMMAND environment variable is set, use its value. Orca exports this for managed WSL sessions.
  • Otherwise, in a dev checkout whose session exposes ORCA_DEV_REPO_ROOT, use orca-dev.
  • Otherwise, on Linux outside an Orca-managed terminal, use orca-ide. Never run bare orca there — outside Orca's terminals it normally resolves to the GNOME Orca screen reader (/usr/bin/orca) and starts speech on the user's machine.
  • Otherwise, use orca.

Below, ORCA is a placeholder for the executable you resolved. Substitute it before running anything; do not create a shell variable or run ORCA literally. This works the same way in POSIX shells, PowerShell, and cmd.exe.

If the selected executable cannot run, report its exact error and stop. Do not fall through to another executable, which could silently target a different Orca build.

Load the full guide before running Orca commands

ORCA skills get computer-use

That prints the complete, version-matched guide for the exact binary that will handle your next commands — listing apps/windows, reading UI, and driving clicks, typing, and other accessibility actions. Read it first, then run the specific command you need.

Don't guess subcommands or flags from memory or from a cached copy of this stub. They change between Orca releases, and this file deliberately no longer lists them. Confirm the app is up with ORCA status --json (start it with ORCA open --json if needed), and prefer --json for agent-driven calls.

If an older Orca does not recognize skills get

Use this fallback only when the selected binary explicitly reports that skills get is an unknown command. Another failure is not proof of an older binary; report it rather than guessing or changing executables. For a confirmed pre-guide binary, use only this bounded, read-only bootstrap to orient. Do not dead-end and do not invent commands:

ORCA status --json
ORCA computer capabilities --json
ORCA computer list-apps --json

Then tell the user that updating Orca restores the full, version-matched guide via ORCA skills get computer-use. Beyond these commands, ask the user rather than guessing a command surface this older binary may not support.

Frequently asked questions about Computer Use

Similar skills