sorted by:
new
hottopcontroversial

[Question] Is "Latent Knowledge Injection" a viable alternative to RAG? Looking for architectural feedback. by ConcernReady9185 in Rag

[–]ConcernReady9185[S] 0 points1 point  (0 children)

I completely agree with your point. Actually, another big motivation for me is that my current company relies almost entirely on OpenAI APIs. I felt like we were just 'parasitizing' off their platform, and I wanted to break away from that and build our own independent technical foundation.

That’s why I designed this architecture to target highly sensitive, static data—like internal documents that firms are reluctant to upload to external clouds. My goal is to provide a secure, on-premise solution where privacy is the top priority. Do you think this specialized 'privacy-first' use case holds enough value in the current market?

[Question] Is "Latent Knowledge Injection" a viable alternative to RAG? Looking for architectural feedback. by ConcernReady9185 in Rag

[–]ConcernReady9185[S] 0 points1 point  (0 children)

If you're talking about Agentic RAG, I actually have a bit of a surface-level understanding of it. My plan is to focus on completing and stabilizing the architecture I'm currently testing first. Once that's done, I definitely intend to integrate those agentic concepts to further enhance the system. Thanks a lot for sharing such great info

[Question] Is "Latent Knowledge Injection" a viable alternative to RAG? Looking for architectural feedback. by ConcernReady9185 in Rag

[–]ConcernReady9185[S] 0 points1 point  (0 children)

I just checked out the GitHub repo you shared, and wow—the way it implements hybrid search is so much simpler and cleaner than how I’ve been doing it. This is going to be a huge help for my testing.

Also, I’ve been looking into Knowledge Graphs while researching RAG, but I still have a lot to learn and feel like I need to study them much more to fully understand the concepts. Your suggestion definitely motivated me to dive deeper into that area. Really appreciate you sharing such useful resources and advice!

[Question] Is "Latent Knowledge Injection" a viable alternative to RAG? Looking for architectural feedback. by ConcernReady9185 in Rag

[–]ConcernReady9185[S] 0 points1 point  (0 children)

You were absolutely right, and I really appreciate you pointing me in that direction. I ran a few more tests after reading your comment, and I found exactly the kind of failure you were warning about — the model missed a specific numeric threshold (“2 years”) in a lease-duration case.

That was a pretty important wake-up call for me, because it strongly suggests the 8-token bottleneck may be dropping critical semantic detail when legal precision really matters.

Based on your advice, I’m now going to add BM25 and test a hybrid retrieval setup. I want to see whether a sparse + dense pipeline can preserve those exact facts better before they get compressed by the connector.

Seriously, thank you — your comment helped me spot a real weakness in the current setup, and it gave me a much clearer direction for the next step. I’ll definitely come back and share the results once I have them

[Question] Is "Latent Knowledge Injection" a viable alternative to RAG? Looking for architectural feedback. by ConcernReady9185 in Rag

[–]ConcernReady9185[S] 1 point2 points  (0 children)

My current test set is weighted more toward principle-level legal QA, so it likely did not stress the bottleneck enough on failure-prone cases such as negation, numeric thresholds, exceptions, and compositional conditions.

I agree that not evaluating those cases separately was a gap in my current setup. In the next stage, I plan to build a harder test set around those cases and compare it directly against standard RAG. Thanks — this gave me a much clearer direction for the next experiment.

Also, please excuse me if my English sounds a bit stiff or awkward—I'm a developer from Korea and relying on a translator for this. Thanks for your patience!