Sloth-ninja puts Mike's AI work behind the firm's firewall
This fork adds an on-premises model option for firms that need AI traffic to stay on their own hardware.
The new option is aimed at data sovereignty. A firm can connect Mike to a locally hosted, OpenAI-compatible model service while keeping the chat experience, streamed replies and tool use intact. Sloth-ninja's guidance is candid: the tested local model works, but cloud models may still deliver stronger results.
- Local model choices appear in chat and account settings only after an administrator configures them.
- Existing saved choices fall back safely if the local service later becomes unavailable.
- Staff cannot enter their own model-server addresses, which keeps that connection under server-side control.
Cloud OpenAI traffic remains separate from this setup.
Spotted something wrong? Or know the PR text has fresher detail than the writeup above?