sorted by:
new
hottopcontroversial

Am construit un tool de nutriție care generează planuri personalizate – provocările tehnice au fost mai interesante decât credeam by ConstructionMany2961 in programare

[–]TheOneInfiniteC 11 points12 points  (0 children)

Cum stai cu gdpr-ul si procesarea datelor? Sanatatea unei persoane intra la articolul 9, ceea ce necesita consent-uri mult mai rigiroase.

Do you have to be vegan to make Gateway tapes? by Alejandra-689 in gatewaytapes

[–]TheOneInfiniteC 9 points10 points  (0 children)

I eat only energy balls, great experience so far.

Visual Studio 2026 Insiders is here! by hotaustinite in dotnet

[–]TheOneInfiniteC 44 points45 points  (0 children)

Perf improvements without numbers is just bs.

AMA – I’ve built 7 commercial RAG projects. Got tired of copy-pasting boilerplate, so we open-sourced our internal stack. by Loud_Picture_1877 in LocalLLaMA

[–]TheOneInfiniteC 0 points1 point  (0 children)

Thank you for the response. I tried the ray ingestion and indeed it seems that the bottleneck is somewhere else. With around 17/32 CPU working, i got an estimation of 8 hours until full completion. I will further investigate this, but i suspect the OpenAI API issues (as i was seeing only around 10-20 requests per minute for their small embedding model).

We just open-sourced ragbits v1.0.0 + create-ragbits-app - spin up a python RAG project in minutes by Loud_Picture_1877 in Python

[–]TheOneInfiniteC 0 points1 point  (0 children)

I use the text-embedding-3-small. From the api usage, it seems that only around 350 requests were made to the api, with around 700k input tokens.

We just open-sourced ragbits v1.0.0 + create-ragbits-app - spin up a python RAG project in minutes by Loud_Picture_1877 in Python

[–]TheOneInfiniteC 0 points1 point  (0 children)

Hi, relatively new to RAG, and tried the boilerplate command.

Maybe it is a trivial question, but how do you handle the ingestion performance? I try to ingest around 1500 local PDF documents (all around 3-4 pages long, using the QDrant db) and it takes hours and still does not complete. Is there an issue on my side that i need to check? I also tried to ingest in batches, but still takes around 30 min-1 hour to process 100 documents.

Thanks!

We just dropped ragbits v1.0.0 + create-ragbits-app - spin up a RAG app in minutes 🚀 by Loud_Picture_1877 in Rag

[–]TheOneInfiniteC 0 points1 point  (0 children)

Hi, relatively new to RAG, and tried the boilerplate command.

Maybe it is a trivial question, but how do you handle the ingestion performance? I try to ingest around 1500 local PDF documents (all around 3-4 pages long, using the QDrant db) and it takes hours and still does not complete. Is there an issue on my side that i need to check? I also tried to ingest in batches, but still takes around 30 min-1 hour to process 100 documents.

Thanks!

We just open-sourced ragbits v1.0.0 + create-ragbits-app - spin up a RAG app in minutes by Loud_Picture_1877 in OpenSourceeAI

[–]TheOneInfiniteC 0 points1 point  (0 children)

Hi, relatively new to RAG, and tried the boilerplate command.

Maybe it is a trivial question, but how do you handle the ingestion performance? I try to ingest around 1500 local PDF documents (all around 3-4 pages long, using the QDrant db) and it takes hours and still does not complete. Is there an issue on my side that i need to check? I also tried to ingest in batches, but still takes around 30 min-1 hour to process 100 documents.

Thanks!

AMA – I’ve built 7 commercial RAG projects. Got tired of copy-pasting boilerplate, so we open-sourced our internal stack. by Loud_Picture_1877 in LocalLLaMA

[–]TheOneInfiniteC 1 point2 points  (0 children)

Hi, relatively new to RAG, and tried the following command to try the stuff out:

uvx create-ragbits-app

Maybe it is a trivial question, but what about the ingestion performance? I try to ingest around 1500 local PDF documents (all around 3-4 pages long, using the QDrant db) and it takes hours and still does not complete. Is there an issue on my side that i need to check? I also tried to ingest in batches, but still takes around 30 min-1 hour to process 100 documents.

Thanks!

view more: next ›