stakwork teaches Mike to run on local models

A pair of merged changes let this fork point Mike at open models running on your own hardware instead of a cloud provider.

infrastructuresecurity

Maintained by Paul Itoi · verified on MikeWatch

The work adds support for Ollama - a tool for running open large language models on your own server rather than calling out to a hosted API - and threads it through both the backend and the chat interface. Once it's pointed at a local server, installed models show up as their own group in the model picker, with a health badge telling you whether the connection is live.

There's a deliberate trade-off baked in. Local models handle structured commands inconsistently, so when one is selected the team switches off document editing and citations and surfaces a banner explaining why. Worth knowing before you switch: the setting is server-wide today, with no per-user endpoint, so it's an all-or-nothing choice for the whole deployment.

So what Anyone weighing whether sensitive matter data can stay inside their own walls should watch this fork - it trades some features for keeping the model in-house.

View this fork on GitHub →

Spotted something wrong? Or know the PR text has fresher detail than the writeup above?

Commits in this thread

2 commits from stakwork/mikeoss, oldest first. Source extracted verbatim from the harvested git log.

SHA Subject Author Date
e88d06b0 Generated with Hive: Add Ollama LLM provider adapter, routing, and model list endpoint (#4) Paul Itoi 2026-05-08 ↗ GitHub
Co-authored-by: pitoi <pitoi@users.noreply.github.com>
c629bb00 Generated with Hive: Add Ollama model picker, account settings section, and tool-unavailability notice to UI (#5) Paul Itoi 2026-05-08 ↗ GitHub
Co-authored-by: pitoi <pitoi@users.noreply.github.com>

Capture this thread into my fork

Download a single Markdown prompt that tells Claude how to port every commit above into your working tree — adapting paths and structure to match your repo. Run it via claude -p < capture-thread-212.md from inside the repo you want the changes in.

⬇ Download capture-thread-212.md