dsh-desktop-automation
A macOS DeepSeek Harness plugin that gives agents desktop mouse, keyboard, window, screenshot, and vision-guided automation tools.
Install
$ dsh plugin --profile web add dsh-desktop-automationPlugin Overview & Capabilities
AI-assisted organization based on the public repository snapshot. The content must be grounded in source evidence and does not replace compatibility or security verification.
Key Capabilities
- Registers 14 desktop_* agent tools for permission checks, app and window listing, mouse movement, clicking, dragging, scrolling, keystrokes, text input, screenshots, vision, UI location, and service shutdown.
- Controls macOS desktop interaction through a local socket and an on-demand CGEvent service.
- Captures full-screen or regional screenshots.
- Supports a vision loop of screenshot, image understanding, UI-element coordinate location, action, and verification.
- Provides HTTP routes for desktop-service status, start, stop, checking, and authorization guidance.
- Reuses DSH vision credentials for desktop_see and desktop_locate when configured.
Useful For
- Let an agent operate a macOS application through mouse, keyboard, scrolling, and window controls.
- Automate GUI workflows that require reading a screen, locating an element, clicking it, and checking the result.
- Capture screenshots and extract UI or text information through configured vision credentials.
- Inspect desktop automation permission and local service status from DSH.
Who It Fits
- DeepSeek Harness users on macOS who need agent-driven desktop automation.
- Developers building or testing GUI-based workflows in a logged-in macOS session.
- Users with configured DSH vision credentials who want screenshot understanding and UI grounding.
Documented Limitations
- Designed for macOS and relies on a GUI-session CGEvent service.
- The desktop-control-server requires one-time macOS Accessibility permission.
- Screenshot capture requires Screen Recording authorization as described by the repository.
- Vision features require configured DSH vision credentials (OPENCODE_GO_API_KEY) and network access.
- desktop_app activates only applications that are already running.
- UI-location output can be unstable on complex screenshots; the README suggests retrying with a cleaner or cropped image.
- The service is started on demand and is not configured for boot or login autostart.
DSH Compatibility
Version-specific runtime evidence collected by DSH Plugin. A missing result means we have not tested that combination yet.
Security Signals
Objective signals discovered from package metadata and source inspection. These are not a guarantee that a plugin is safe.
package.json declares 0 runtime, 0 development, 0 peer, and 0 optional dependencies.
package.json declares DSH bundle metadata.
GitHub reports the repository license as MIT.
A root package.json was captured and can be inspected by the registry.
Public GitHub source metadata is available for this registry snapshot.
Source & Registry Notes
Public provenance, Registry classification, and the latest source check for this entry, kept separate from runtime verification.
- Source repository
- Junkrat9527/dsh-desktop-automation
- Registry source
- GitHub · dsh-plugin topic
- Registry classification
- Plugin
- Source checked
- ba7e01c · 2026-08-21
This project is independently indexed from public source information. DSH Plugin is not affiliated with DeepSeek or the plugin author. Always check the author repository before installation.
Repository Activity
- GitHub stars
- 0GitHub stars
- Forks
- 0
- Open issues
- 0
- Last commit
- 2026-08-20
- Last release
- No release detected
Related DSH Plugins
Ranked by overlapping capabilities, use cases, plugin type, categories, and DSH profile.
Vision routing and pixel-level visual tool suite for DeepSeek Harness agents with built-in free fallbacks.
View plugin →DeepSeek Harness web-search plugin that adds web search, X search, and focused page fetching with structured evidence.
View plugin →Persistent multi-model Agent teams and bounded DAG workflows with GUI controls for DeepSeek Harness.
View plugin →A bilingual DeepSeek Harness cost-tracking plugin with session and daily costs, budgets, pricing management, balance lookup, and coding-plan quota displays.
View plugin →