jellz77 takes Mike fully on-prem

A new build wires Mike up to AI models running on your own hardware instead of a cloud provider.

infrastructuresecurity

jellz77 has rebuilt the fork around Ollama - software that runs open-source AI models locally, on a server you control, rather than calling out to a hosted API. The model picker now reads whatever models are installed on that local server and offers them alongside the usual options, with per-user key overrides where needed. The owner's own description is modest: "an attempt at fully on-prem."

A couple of rough edges are worth knowing before you lean on it. Right now everyone shares a single local server reachable from the back end - there's no per-user endpoint - and the interface lists local models whether or not a server is actually wired up, so a missing connection only shows itself when you send a message.

So what Worth a look for any firm that can't let client matter leave its own infrastructure and wants the AI to stay inside the building.

View this fork on GitHub →

Spotted something wrong? Or know the PR text has fresher detail than the writeup above?

Commits in this thread

2 commits from jellz77/mike, oldest first. Source extracted verbatim from the harvested git log.

SHA Subject Author Date
6d0431cb added ollama support jon 2026-05-06 ↗ GitHub
04d126f6 added ollama support jon 2026-05-06 ↗ GitHub

Capture this thread into my fork

Download a single Markdown prompt that tells Claude how to port every commit above into your working tree — adapting paths and structure to match your repo. Run it via claude -p < capture-thread-128.md from inside the repo you want the changes in.

⬇ Download capture-thread-128.md