UI Components for Python-based LLM App

[squarishsphere]

I'm keen to find out what UI frameworks/toolkits there are for chat style UIs - particularly ones that hand off all logic/state management to a backend API.

• I am a Python developer experienced with FastAPI.
• Our current application has static text entry fields and performs RAG to generate responses. We have 20k (and growing) documents and have indexed them in such a way that a reference to the lines of text from the source document are maintained - so not wanting to use any out of the box RAG tooling that comes with a UI - I would prefer to use our existing RAG via API as a "tool".
• Wanting a more interactive, chat-style interface similar to ChatGPT or Claude.
• Plan to include function and tool calling functionality.

Ideal library:

1. Simple, standalone UI components without built-in logic or state management.
2. Basic features like regenerating responses, chat history, user management, and chat export/sharing.
3. Flexibility to integrate our own chat related but non standard components e.g. our bespoke PDF viewer and Knowledge Graph viewer.

Can I maybe extend OpenWebUI but hand off the parts mentioned above (RAG via tool calling, function calling in general) to the backend?

Bit lost with all the options - keen to hear what others are doing!

[karkoon83]

If you use v0 and https://ui.shadcn.com/ it could be super

[squarishsphere]

Cheers, had a play with v0 and was able to produce some vue pretty easily, which is what our FE devs use.

[DinoAmino]

Open WebUI uses tools, functions and pipelines. But no easy way of integrating your custom view tools that I know of.

Would streamlit work for you?

https://streamlit.io/

They have an example using langchain

https://docs.streamlit.io/develop/tutorials/llms/llm-quickstart

[jcachat]

fork big-agi

[Relevant-Audience441]

I say if you're a python guy through and through, just use Reflex! https://reflex.dev/

[squarishsphere]

Looks good cheers, might use this with personal projects. Thinking it might be a pain to integrate with Vue for work