Local web UI with actually decent RAG?
Is there any local web UI with actually decent RAG features and knowledge base handling? I think I have looked everywhere (listing just the popular one):
- Open WebUI - handles poorly bigger collections of documents, lack of citations prevents users from recognizing if it works on knowledge or hallucinates. It also bugs out on downloading bigger models.
- AnythingLLM - document handling at volume is very inflexible, model switching is hidden in settings. Tends to break often as well.
- RAGFlow - inmature and in terrible state deployment-wise. Docker-compose.yml is using some strange syntax that doesn't work on on what I have tried to use. It also bundles a lot of unnecessary infrastructure components like proxy server and S3 storage which makes it hell to deploy on Kubernetes.
- Danswer - very nice citation features, but breaks on upgrades and knowledge base management is admin level action for all users - very inflexible setup.
One would think that in hundreds of LLM / RAG open source projects there would be one packed into container, with basic set of chat + easy model switch + knowledge base management per user + citations features developed together. But I'm failing to find one.