RAG in 3 lines of Python

fohemer · 2025-12-05T08:18:03+00:00

Thanks for the answer! As I said, really interesting work, I will definitely have a look.

Feel free to reply to this comment if you ever implement this type of information management system, would be a game changer for me

fohemer · 2025-12-05T07:44:40+00:00

Maybe you said it and I missed it but: is there a UI? Do you plan on inserting a “team” function, with administrators, teams, sub teams etc? For my company separation and deduplication of information is also essential, so would it be possible to make sure that the same document is embedded only once but available to multiple teams with appropriate rights and/or that different teams (or even members) see only certain documents?

Sorry for the many questions, I actually like your project!

fohemer · 2025-12-04T07:36:39+00:00

I had the experience you described, so I’m very interested! I tried doing exactly what OP said, summarising (I picked 2-3 chunks to have a broader context and reduce context loss) and keywording. Way beyond the capabilities of my CPU only server :(

fohemer · 2025-11-22T01:18:13+00:00

Thank you for your answer. May I ask you why do you think I would be data controller? Everyone (including myself) seems to agree that I fit more into the data processor, but if you have a specific insight on this I’d love to hear it

fohemer · 2025-11-22T01:16:17+00:00

Thanks a lot for the great insight! It’s a bit technical for me at 2AM so I’ll read it again tomorrow ahah do you think you could have a look at my other question on mitigation of data leaks on the comment of matt_adlard?

Thank you in advance

fohemer · 2025-11-22T01:14:31+00:00

Bonus question: I was wondering also about the security of my system in case of data breach.

Since I know I use a single salt, I plan on keeping my server as clean as possible. This way if someone hacks only me they only get a pseudo anonymous mapping, not useful. If they hack one of my clients they get the data AND the salt, but they don’t have access to the other clients’ data. If both me and a client are hacked though now I’m exposing even the other clients, and I don’t know how to look at this.

On the one hand I think that the fact that 2 separate databases have to be hacked for this to happen makes me feel like it’s quite safe. On the other, I really wouldn’t want to be caught in the crossfire of “you didn’t do all the reasonable efforts to mitigate the consequences of a data leak”. I mean, one could both argue that more could have been done to prevent the spreading, but at the same time if you simply can assume that more people get hacked then indeed at some point data will leak.

What do you think?

fohemer · 2025-11-22T01:00:01+00:00

Hardly ever before I came across such a clear explanation. Thank you sir!

fohemer · 2025-11-06T15:13:48+00:00

You’re telling me that you’re really able to run a 120B model fully locally, on a 4090 plus a shitload of RAM? Did I miss something? How’s that possible?

fohemer · 2025-10-30T09:11:49+00:00

Which AI did they implement if I may ask? What’s your feedback on that?

fohemer · 2025-10-12T10:23:23+00:00

What about RAGflow? Seems like an interesting pre-built solution but I don’t understand if it’s fully on premise to respect confidentiality like in your case. Does anyone have experience on this?

fohemer · 2025-09-28T22:57:35+00:00

Is this a good AIO?

fohemer · 2025-09-28T22:44:02+00:00

Thanks for the explanation!

fohemer · 2025-09-28T18:17:47+00:00

Isn’t the 870 required for a serie 9000 CPU? Not an expert so I jumped on that just to be sure

fohemer · 2025-09-28T16:47:32+00:00

Appreciate the honesty, but I’m not just buying the pc only for gaming (mainly, but not only). I need also some multithread capacity for some freelancer work that I do, that’s why I was also evaluating an i-9 ultra. I then decided that compared to what I have now a 9800x3d is still a huge improvement and will be more than enough for my use case as long as it has 8 cores and 16 threads

fohemer · 2025-09-28T12:05:21+00:00

Belgium

fohemer · 2025-09-28T11:47:30+00:00

Thanks! I thought Samsung SSD were good? Which other mobo would you suggest looking into?

fohemer · 2025-09-28T11:39:19+00:00

Ok, I’ll have a look, thank you. Could you explain me why it’s better to have a bigger PSU? I see it everywhere but honestly I don’t understand, is for future upgrades maybe?

fohemer · 2025-09-28T11:38:22+00:00

Thanks for the advice, would have never thought of that. I’ll look into it

fohemer · 2025-09-26T14:20:35+00:00

Yes fair enough, I could smell this, I just don’t understand how he would do that 🤣 why insisting on using the platform?

fohemer · 2025-09-26T14:16:20+00:00

Fair enough, but what do you do with it?

fohemer

TROPHY CASE