brauliogusmao lets Mike run on your own machine
A fourth AI engine option means the model can live entirely on local hardware - no cloud round-trip required.
Until now, Mike leaned on hosted AI services from the big providers, which means every question and document touches an outside server. brauliogusmao adds Ollama - a tool for running open-source language models locally - as an alternative. Point Mike at a model on your own machine and nothing has to leave the building.
There's a clever accommodation here. Smaller local models are unreliable when asked to fetch documents on their own mid-conversation, so the work loads the relevant document text up front, before the model starts reasoning. That trades a bit of flexibility for far more dependable answers on modest hardware. The whole thing is bolted on as an extra layer, so firms that don't want it are unaffected. One caveat worth checking on GitHub: the backend exposes local models, but whether the interface fully surfaces them in a picker isn't yet confirmed.
Spotted something wrong? Or know the PR text has fresher detail than the writeup above?