projects

2026in progressprivate repo

My personal assistant

Agentic OS: a voice assistant with Claude as its brain, on Home Assistant

Jarvis answers on the PC and on the phone: Home Assistant handles what it understands and Claude everything else. It files tasks into the speaker’s own list, sets alarms and timers, runs the house and analyses whatever is on my screen.

It is the piece that ties the rest together: the notes vault is the memory, the task page is the list, and Home Assistant is the body. The repo keeps only what did not already exist: the Home Assistant configuration, versioned before it is pasted onto the Raspberry Pi; a Stream Deck plugin whose icon follows the voice satellite live — idle, listening, thinking, speaking —; and a FastAPI analyser that, on “Jarvis, analyse my screen”, captures the focused window, sends it to Claude and reads the summary aloud.

The delicate part is not the AI, it is the seams between processes that do not know each other. Windows will not let a background process hand focus to another window, so the analysis window kept opening behind until it attached to the focused window’s thread before asking. And Stream Deck lost the plugin’s settings on every start: the plugin now keeps its own copy and hands it back when they arrive empty.