Sunny Is an Open-Source Desktop AI Assistant Built for Accessibility

Summary

Sunny is an open-source Electron desktop assistant designed for older adults, non-technical users, and people who want to automate computer tasks without writing scripts. Users can type or speak requests, while Sunny uses screen understanding to identify windows, buttons, text fields, and navigation elements, then move the mouse, click, type, scroll, and open applications with permission. Its accessibility features include high-contrast visuals, enlarged text, text-to-speech, voice input, hands-free cooking instructions, medication reminders, and spoken weather and news digests. The project offers verified recipe search and a cooking mode with large step-by-step controls, scheduled vocal medication alerts, and a local weather and headline digest. AI can run offline through an embedded Moondream vision model or through Ollama with local vision-capable models; OpenAI, Anthropic, and Groq are optional cloud providers that require explicit consent. Sunny says screen captures, preferences, API keys, and logs remain on the device by default, with API keys protected by the operating system’s secure storage. Destructive actions such as sending email, deleting files, making purchases, or changing settings require confirmation. The assistant also sanitizes screen text and detects possible indirect prompt injections, stopping when it identifies a high-severity threat. Pre-built installers are provided for Windows, macOS, and Linux, and the project is released under the MIT License.