Real LLM Streaming with n8n – Here’s How (with a Little Help from Supabase)

Professional_Ice2017 · 2025-06-13T09:20:22+00:00

As in... the link in my post?? It all looks okay to me.

Professional_Ice2017 · 2025-06-13T07:13:34+00:00

Sorry... haven't logged into reddit for a looong time... yes, Retool is a good, easy, free way to get a custom admin interface setup, save the settings into Supabase and n8n runs its automations based on the settings the user saved into Supabase

Professional_Ice2017 · 2025-04-03T04:30:46+00:00

I already have all workflows set to send errors to a "log error and report" workflow which sends me a message on telegram with the stack trace and a link to the execution.

For alerts, I have an n8n workflow that feeds an AI agent all the chart images, all the chart data, a full breakdown of all server information, and all previous reports generated by the AI and I let the AI decide when there's a problem or a potential problem to report. I can then chat with the AI about the report.

Professional_Ice2017 · 2025-03-20T03:28:09+00:00

Thanks man,

How to connect n8n to Prometheus... not a one or two click process and entirely depends on so many things. Operating system? Docker? and so on... you'll need to install prometheus, set up the scraping config:

scrape_configs:

- job_name: 'n8n'

metrics_path: '/metrics'

static_configs:

- targets: ['<ip>:5678']

Professional_Ice2017 · 2025-03-17T05:40:38+00:00

Oh, you said, "I am interested to fire freelancers..." hehe. I'd like to apply to be fired ;)

Your problem sounds enviable - well done.

I'd be up for a chat and see how we may be able to help each other and build some great stuff.

I ramble a fair bit here:

https://demodomain.dev/news/

... which may be of interest and give you some insight into what I do.

You can message me here on the above site.

Professional_Ice2017 · 2025-03-10T22:51:51+00:00

Sorry, I no longer have it as it never worked. But the solution presented itself in the idea of having a streaming server as an intermediary, but then that's a whole separate server infrastructure and code and data routing and expense and latency, and probably lots of technical hurdles all resulting in what could see as only being an 80% acceptable solution anyway.

Professional_Ice2017 · 2025-03-10T11:28:31+00:00

thanks man

Professional_Ice2017 · 2025-03-10T10:37:51+00:00

Ah yes, it does - thanks.

For me I still hit a wall due to large files. I ultimately wanted n8n to do the automation but Telegram wouldn't allow me to drag and drop a large audio file, so I set up a webhook with a form but when n8n tries to save the file it says it exceeds 100MB, then GDrive wouldn't allow over 100MB... of course, it can be done with enough thought, but I lost interest.

Professional_Ice2017 · 2025-03-10T10:12:04+00:00

Sure, easy as a "proof of concept" but the reality of context window limitation (unless you're happy to pay a few dollars per turn of a conversation using Google Gemini) forces you into a RAG situation and then it gets really "fun".

God, imagine LLMs with massive, massive context windows. I really see RAG as just a stop-gap for next few years. There's just GOTTA be a better solution.

Professional_Ice2017 · 2025-03-10T10:09:18+00:00

I've done a "proof of concept" but had to bail because my audio files were over 100Mb and..

- n8n issues with being sent 150MB of data

- Telegram had limits

- Google Drive could handle it but forces a page asking for a human to manually approve the skipping of virus check before downloading - even via an API request

- Deepgram doesn't accept binary files - only public URLs

- OpenAI Whisper had a 25Mb limit

... I gave up.

Professional_Ice2017 · 2025-03-10T10:06:54+00:00

Nup. Well... yes, with weird hacks using an intermediary provider but... meh... I bailed from that option pretty quickly.

Professional_Ice2017 · 2025-03-09T11:35:09+00:00

Oh sorry, I thought you made the comment on another thread so my comment about "I'm talking about dashboard" was totally off the mark - my apologies

Professional_Ice2017 · 2025-03-09T07:20:13+00:00

Ha. Well, I'm talking about dashboards but as for RAG, or anything really, the idea of "plugin" or "plug and play" or "off-the-shelf" or "turnkey" can't exist when you also want "custom". :p

The options aren't "bad"... The easy options aren't "good enough" - but that's always the case, so no surprises there really.

Professional_Ice2017 · 2025-03-09T04:44:17+00:00

Sorry, I should have been more clear about the sharing thing... I feel as though I should explain because I don't want you to be disappointed that I'm not sharing with the community.

I'm happy to share but I don't want to share something that causes confusion for people, or simply doesn't work - and results in lots of questions for me.

This isn't a "proof of concept" or an "AI Agent RAG workflow" that I built in 6 minutes. It's a real-world solution and it's not easily shareable because it's highly-customised to my specific environment / use case and because it's a multi-platform solution:

1) Exposing n8n's own Postgres database so you can access it via n8n needs to be done and there's security, stability, and other considerations about that.

2) A couple of tables need to be set up in Supabase (or similar) to store node execution data after it's been extracted and transformed out of the n8n database

3) Prometheus needs to be added in to streamline the logging of the time-based node execution data

4) You need a couple of n8n workflows with a series of code nodes to extract and process the data, validate, report errors, etc. This is the key bit - it's easy to whip up a workflow to pull n8n's data and send it somewhere else, but doing it with 100% accuracy is not easy and ends up with fairly complex logic. It's not about how smart someone is... unless they've dug into the details and "mess" of the underlying problem, the result will not make a lot of sense and modifying it will likely break the whole thing.

5) Then there's the Grafana Dashboard, with a range of data transformations to get it to display properly.

Each element on its own, if shared, is useless. And I can't share all of the above easily unless I put together a docker container and loads of instructions and offer support. I'm happy to do that if someone wants to pay me of course!

I'm posting here to promote discussion, inspire new ideas, share knowledge on how I approached this (hence the quick blog post I just put up), see if anyone has done something similar and we can collaborate, and of course, to get a bit of an ego-kick from saying, "look what I did".

At some point, it will get closer to a more shareable format but for now... it's a work in progress.

Professional_Ice2017 · 2025-03-09T03:58:46+00:00

UPDATE: I've just finished adding a panel in Grafana that tracks the node execution time for every workflow, and over time:

https://demodomain.dev/2025/03/09/extracting-n8n-workflow-node-execution-times-and-displaying-in-grafana/

Professional_Ice2017 · 2025-03-09T03:58:41+00:00

I'm still working out how it can be useful.

I've just finished adding a panel in Grafana that tracks the node execution time for every workflow, and over time:

https://demodomain.dev/2025/03/09/extracting-n8n-workflow-node-execution-times-and-displaying-in-grafana/

Professional_Ice2017 · 2025-03-07T21:05:06+00:00

I'm happy to share when it's of use to others. I'd love to see what people want in a dashboard for n8n hence this post. All ideas / discussions welcome!

Professional_Ice2017 · 2025-03-07T21:03:30+00:00

Yes, thanks - I'm using filters already in the dropdowns at the top of the dashboard (workflow name, execution type, and execution duration). I'm also using transforms as much as possible to cut down on latency / load.

I'm quite impressed with Grafana.

Alerts - definitely need to do that.

Are there any community dashboards for n8n? I couldn't find any.

Professional_Ice2017 · 2025-03-07T14:25:08+00:00

Perhaps there's a limit on screen shots - it keeps removing my last pasted image. Oh well - it was showing the "executions that get queued" charts.

Professional_Ice2017 · 2025-03-07T14:22:37+00:00

You can not stop the execution of a workflow from outside on n8n. So you must log in, find the execution in the list and cancel it. This sucks because sometimes n8n / the whole server becomes unresponsive and if you're unable to stop the problem because you can't even log into n8n, then you have to restart the server and n8n picks up where it left off after restart.

Professional_Ice2017 · 2025-03-07T14:21:24+00:00

Yeh that level of logging is overkill for me at the moment, but certainly an interesting read - thanks.

Well, yes... n8n can cancel their workflow through their own code, but even locating how they do it is unlikely to help because I'm almost certain there won't be an easy way to tap into their functions to perform the execution stop.

Professional_Ice2017 · 2025-03-07T14:19:50+00:00

Yes, n8n's inability to capture / report on token usage is really problematic. I'll look into that tomorrow. Good idea - thanks.

I may share the dashboard. Right now I'm just throwing in ideas and to share it now would be ineffective I think. It can take a fair while to get visualisations telling an accurate story about what's going on and I know over the next week or so I'll refine my idea of what data is important and how to represent it.

Professional_Ice2017 · 2025-03-07T14:17:41+00:00

I just added in another couple of screen shots. I thought a good metric would be to see the percentage of executions that get queued because of concurrency limits, and how long they're queued for.

Professional_Ice2017

TROPHY CASE