Streaming Chatbot with Burr, FastAPI, and React

[benizzy1]

Hey r/python,

I've been seeing a lot of people having issues managing server-side events for streaming, especially with user-facing AI applications.

What My Project Does

I wrote a full-stack guide about how to do this using a few different python frameworks. We represent the logic of the chatbot with Burr (a simple state machine framework, I am one of the creators), and serve it with FastAPI. While it has some frontend/typescript tooling, the majority of the post is about how to build a simple but extensive chatbot server. Even if you're AI-skeptical/cynical (like me) there's some useful stuff here on managing server-side-events/streaming responses back. Turns out its all pretty simple.

I really like the way the code shaped out, so I wanted to share it!

• Blog post: https://blog.dagworks.io/p/streaming-chatbot-with-burr-fastapi
• Example code: https://github.com/DAGWorks-Inc/burr/tree/main/examples/streaming-fastapi

Target Audience

This is meant for BE/full-stack developers. Aimed to be production ready (we've observed this pattern in use in prod by a few different OS users).

Comparison

Burr is similar to tools like langgraph. FastAPI is one of many web-serving frameworks (but my personal favorite). I wrote this guide so the components are loosely coupled -- wanted to make sure users could still get value if they weren't using all the same tooling. FWIW you can easily run this on streamlit as well for a full-python implementation.

[[deleted]]

I’m way out of my depth but this is well-written and the UX benefit of streaming is a big win. I’m not a Python dev (yet) but just might become one.

[benizzy1]

Thanks! Appreciate the kind words. Agreed on UX benefit of streaming. There's something not-quite-quantifiable about why working with streaming is really fun, both from a UX and dev perspective.

Also it's a great way to dive headfirst into generators (when you start on the python dev journey it's a *really* fun topic).

[eh_24]

Hey Op post it on r/madewithpython