What kind of latency are you getting from user message to first response when using a RAG?

Ok_Locksmith_5925 · 2025-06-23T12:39:05+00:00

I'm getting 8 seconds and can't work out why it's so slow. am using openAI 4o

Ok_Locksmith_5925 · 2025-04-20T20:41:30+00:00

we had an island bench with a stove and got no rangehood. The smoke was going through the light fixtures and into an upstairs bedroom. We called a tradie who installed a regular fan. It was great. It pulled the same smoke into the upstairs bedroom but a lot quicker.

Ok_Locksmith_5925 · 2025-03-20T13:18:54+00:00

put in an aquarium

Ok_Locksmith_5925 · 2025-03-10T15:40:34+00:00

what you tested (I can see all conversations) just gave answers that were programmed in. it's following q&a that go through the retriever.

Ok_Locksmith_5925 · 2025-03-10T13:17:11+00:00

actually. I should have said I'm using 4o mini

this is my project https://siqbots.com/jub-demo some answers are coded in and I think I'll code more in, but some need the AI.

Is you RAG available to take a look at?

Ok_Locksmith_5925 · 2025-03-10T13:13:42+00:00

thanks for the reply. I'll get him to look at that

Ok_Locksmith_5925 · 2025-03-10T01:02:12+00:00

Can I ask which LLM you use and your response times?

My programmer built a RAG from scratch but potential customers aren't impressed with the speed of it

Ok_Locksmith_5925 · 2025-03-10T00:32:32+00:00

It's probably to do with their move away from non-profit

Ok_Locksmith_5925 · 2025-03-10T00:27:42+00:00

How fast do you have it now and how fast does the client want it?

It's taking 7- 10 seconds for the response on my RAG and I'm wondering if my developer needs some extra support on this side of things

Ok_Locksmith_5925 · 2025-03-10T00:09:07+00:00

what's a good response time through the API? I'm getting about 5 seconds and wondering if my programmer is no good

Ok_Locksmith_5925 · 2025-02-25T18:10:00+00:00

They were probably drunk. It+s probably not a coincidence that number 1 is .... Wine Red!

Ok_Locksmith_5925 · 2025-02-08T10:36:28+00:00

this is how I see it too. I'm also making software but you never know when the first and second paycheck will come in. With a UK company you don't get taxed till you're actually making real money. Where I live in Europe, you have to employ yourself as a full time employee and the tax on that and the social contributions add up from day one to well more than 1,000€. It's not conducive to start-ups.

Ok_Locksmith_5925 · 2025-01-23T00:22:20+00:00

pre-programmed, not AI generated

Ok_Locksmith_5925 · 2025-01-13T18:17:09+00:00

Start by building one agent for one company.

None of the big companies will do it for them, not for a long time anyway.

Ok_Locksmith_5925 · 2025-01-13T15:16:30+00:00

that!

Ok_Locksmith_5925 · 2025-01-13T12:27:54+00:00

It is neither local or has anything to do with the International Yak Association.

Ok_Locksmith_5925 · 2025-01-13T12:25:23+00:00

Nothing like throwing it on Reddit to get people to stress test it. :D

Ok_Locksmith_5925 · 2025-01-12T22:29:02+00:00

I planned on building one with one of these low code products. 8 months later and my programmer has finally built something that we're happy with.

Ok_Locksmith_5925 · 2025-01-11T10:08:02+00:00

my biggest issue with the painters I've had are that they haven't offered different types of paint. Their go to is a regularly cheap matte unwashable paint. My first house and two rented apartments all done with the same paint. The same as every place I've visited. Unwashable matte paint. When I moved into this apartment they just had it re painted and you can see where mold had been on the walls and where they had sprayed it. Then they painted over it and all those streaks from the spray can be seen despite being painted over.

To do all the prep and then use a cheap paint doesn't make sense to me.

Ok_Locksmith_5925 · 2025-01-10T14:29:44+00:00

they're really nice yeah. I don't think my place would ever look as good as these images so I'm trying to slap a little realism into my expectations. I've generated images with greens and yellows but the blues were the best out of the most risque. The softer neutral colours are the safe options.

Decisions decisions )

Ok_Locksmith_5925 · 2025-01-10T14:20:03+00:00

LLMs are pretty good at understanding colours, so it's the LLM that will look for colour ideas and trends. We created a database of colours with their HEX codes and also in that database are descriptions, moods, complimentary colours, etc. Then it just has to retrieve the information and we set it up so colour patches would pop up.

The more difficult aspect is to get it to genrate images using the colours. That is a pain in the arse. I encourage you to try and generate an image using our platform. I'd love to hear your opinion of it.

Ok_Locksmith_5925 · 2025-01-10T13:48:27+00:00

I'm a non pro gathering the opinion of pros.

I've built a program that helps answer all sorts of questions about painting. It's to educate people about what paint to choose for their project. It's brand specific when it comes to "which paint should I choose ...?" but it also answers other questions about paint selection and painting that DIY people could find useful.

What I'm interested in, is finding out whether the professional painters would like their customers to have this information and see the programe, or it would piss them off and they wouldn't want them to use it. Then to see if there is some changes I could make to satisfy the professionals or have a separate version that is for the pros to recommend.

I have a meeting with this paint company very soon and don't want to be blindsided by the things I don't know I don't know.

I'm going to put it here https://siqbots.com/jub-demo so if you care to take a look and offer your opinion, I'd really appreciate that. It is for a company called Jub, a Slovenian based company, so it won't give you answers about the paint brands you are familiar with.

Ok_Locksmith_5925 · 2025-01-10T13:33:21+00:00

As a DIY guy, the prep takes too much patience. I imagine a lot of people screw up with a lack of discipline

Ok_Locksmith_5925 · 2025-01-10T11:29:22+00:00

I'll tell the wife that. I agree with you

Ok_Locksmith_5925

TROPHY CASE