nforum lets Mike run on your own hardware

A new self-hosted option means the legal-AI chat can run on infrastructure you control instead of a third-party cloud.

infrastructuresecurity

nforum has wired in support for running Mike's chat against a self-hosted AI model - an inference setup you stand up on your own servers rather than calling out to a cloud provider. Configuration is environment-level, so there's no per-user key to hand out, and the local engine sits alongside the existing cloud option behind a single shared client that routes each request to the right backend.

One thing to watch if you adopt this: once the self-hosted endpoint is switched on, the fork quietly makes the local model the default for everything, including background tasks like generating chat titles. That's a sensible bias for an on-premises shop, but it's baked into the code rather than left as a setting - worth knowing before you pick it up wholesale.

So what Relevant to any firm or legal-ops team that wants AI answers without client data leaving their own infrastructure.

View this fork on GitHub →

Spotted something wrong? Or know the PR text has fresher detail than the writeup above?

Commits in this thread

4 commits from nforum/mike, oldest first. Source extracted verbatim from the harvested git log.

SHA	Subject	Author	Date
`0c84ef49`	feat: Add LocalLLM (vLLM) provider support	Joseph Breda	2026-05-02	↗ GitHub
commit body - Add OpenAI-compatible LLM provider for local vLLM endpoints - Support for configurable model names via environment variables - Add LocalLLM Main and LocalLLM Lite as default models - Update model selector to include LocalLLM options - Fix generate_docx title fallback for missing parameters - Add LibreOffice dependency note for document conversion
`cc951105`	feat: Replace unsloth model with placeholder in .env.example	Joseph Breda	2026-05-04	↗ GitHub
`fe3fd823`	docs: Add LLM configuration options to README	Joseph Breda	2026-05-04	↗ GitHub
`86dab800`	merge: resolve PR #20 (vLLM/LocalLLM) conflicts with PR #16 (OpenAI)	Bojan Plese	2026-05-07	↗ GitHub
commit body Unified LLM provider architecture: - openai.ts: dual client factory (OpenAI cloud + vLLM local) via baseURL - models.ts: all 4 provider groups (LocalLLM, Anthropic, Google, OpenAI) - userSettings.ts: DB openai key with VLLM_API_KEY env fallback - ModelToggle.tsx: 4-group type union and GROUP_ORDER - modelAvailability.ts: LocalLLM always available (server-configured) - All frontend apiKeys: use profile.openaiApiKey from DB

Capture this thread into my fork

Download a single Markdown prompt that tells Claude how to port every commit above into your working tree — adapting paths and structure to match your repo. Run it via claude -p < capture-thread-49.md from inside the repo you want the changes in.

⬇ Download capture-thread-49.md