Claude Code: Computer Use for Desktop Automation

Claude Code

Claude can now control your computer by pointing, clicking, and navigating your screen. It reaches for precise tools first (like Slack or Google Calendar connectors), then uses direct computer control when needed. The feature includes built-in safety measures β€” system scans for prompt injection attempts, user stop controls, and permission gates before accessing new applications. Available as a research preview for Claude Pro and Max subscribers on macOS.


Claude Computer Use: Direct Desktop Automation

Claude can now control your computer to complete tasks by pointing, clicking, and navigating your screen. This capability, launched as a research preview on March 23, 2026, enables Claude to operate desktop applications directly when its built-in integrations aren't sufficient.

How It Works

Claude follows a deliberate hierarchy when completing tasks: it reaches for precise, purpose-built tools first β€” such as Slack, Google Calendar, or file system connectors β€” and only falls back to direct screen control when no dedicated integration exists. This approach prioritizes speed and reliability while using computer use as a flexible fallback for any application visible on screen.

When using computer use, Claude can open files, navigate browsers, interact with development tools, and operate desktop applications β€” all without requiring users to set up individual integrations for each app.

Safety and Permissions

The feature includes multiple safety layers:

  • Prompt injection scanning: The system actively scans for prompt injection attempts in on-screen content
  • User stop controls: Users can halt Claude's actions at any time during computer use
  • Application permission gates: Claude must request and receive permission before accessing new applications for the first time
  • Blocked applications: Some applications are blocked by default for security reasons

Current Limitations

  • Research preview only β€” not production-ready
  • macOS only at launch
  • Slower than direct integrations β€” screen-based interaction has higher latency than API-based tools
  • Complex tasks may need retries β€” multi-step workflows on screen can be less reliable than structured tool calls
  • Not recommended for sensitive data β€” given the visual nature of screen control

Availability

Computer Use is available to Claude Pro and Max subscribers. The desktop app must remain awake and running for computer use to function.