Overview of OS Automation MCP Servers
mainOS Automation servers enable AI agents to control desktop operating systems through various methods:
- GNOME Automation (
gnome-desktop-mcp): Provides 30 tools via D-Bus for GNOME 45–49 Linux desktops, including screenshots, window management, mouse/keyboard injection, clipboard, workspaces, and notifications. - Hybrid Computer-Use (
cellar): Fuses accessibility trees, Chrome DevTools Protocol, and vision into structured context. Includes a continuous awareness engine (Cortex) and works offline with Ollama. - Windows Entity-Based Automation (
desktop-touch-mcp): Uses UIA and CDP for Windows automation, focusing on entity-based actions rather than just coordinates to reduce UI automation failures. - macOS VM Management (
nemeton-mcp): A bridge for Nemeton that uses Apple's Virtualization.framework to create and control Linux & macOS VMs with 50+ tools for lifecycle, console, files, and networking. - macOS OCR (
freezetext-mcp): Uses Apple Vision to extract text from any part of the Mac screen, including videos and protected PDFs. - GUI App Development Loop (
glass): Provides a build → see → interact → debug loop for native GUI apps. It works as an external black box (no app integration required) across X11, Wayland, Windows, macOS, Android emulators, and iOS Simulators.