jpbreda teaches Mike to run on a model you host yourself

A new option lets Mike talk to a privately-hosted AI instead of only the commercial cloud services.

infrastructureintegration

Until now, Mike has run on two outside AI services, Claude and Gemini, both reached over the internet. jpbreda adds a third path: pointing Mike at a language model running on your own servers (using vLLM, a tool for serving open-source models on your own hardware). Because it's configured once at the server level rather than per user, everyone on the deployment gets the local option without managing their own keys.

There's a rough edge worth knowing before anyone leans on this: the local model shows up in the picker whether or not an operator has actually set it up, so an unconfigured deployment would offer a choice that fails when selected. The work was opened as a pull request but closed without being merged into the main project, so for now it lives as an experiment in this fork.

So what Worth a look for any firm that wants legal AI without sending matter data to an outside vendor.

View this fork on GitHub →

Spotted something wrong? Or know the PR text has fresher detail than the writeup above?

Commits in this thread

3 commits from jpbreda/mike, oldest first. Source extracted verbatim from the harvested git log.

SHA Subject Author Date
0c84ef49 feat: Add LocalLLM (vLLM) provider support Joseph Breda 2026-05-02 ↗ GitHub
commit body
- Add OpenAI-compatible LLM provider for local vLLM endpoints
- Support for configurable model names via environment variables
- Add LocalLLM Main and LocalLLM Lite as default models
- Update model selector to include LocalLLM options
- Fix generate_docx title fallback for missing parameters
- Add LibreOffice dependency note for document conversion
cc951105 feat: Replace unsloth model with placeholder in .env.example Joseph Breda 2026-05-04 ↗ GitHub
fe3fd823 docs: Add LLM configuration options to README Joseph Breda 2026-05-04 ↗ GitHub

Capture this thread into my fork

Download a single Markdown prompt that tells Claude how to port every commit above into your working tree — adapting paths and structure to match your repo. Run it via claude -p < capture-thread-313.md from inside the repo you want the changes in.

⬇ Download capture-thread-313.md