emileriksenkeev makes long-running legal AI chats far less fragile
This fork is hardening the moments when complex chat work is most likely to disappear or stall.
Long, multi-step requests can now keep working through more of the real-world failure points that interrupt legal AI workflows.
- Longer task runs can complete rather than stopping after a short sequence of actions.
- Streaming connections send keepalive signals, reducing the chance that proxies cut off work that is still underway.
- A dropped connection no longer silently loses the user's submitted request.
- Large document collections are handled in smaller batches, preserving chat and wiki context for projects with hundreds of documents.
- Repeated AI instructions can be cached, which may reduce cost and delay during tool-heavy conversations.
Spotted something wrong? Or know the PR text has fresher detail than the writeup above?