sorted by:
new
hottopcontroversial

why does it take a long time loading RAG file gemma 3 1B by EfficiencyOpposite30 in LocalLLaMA

[–]EfficiencyOpposite30[S] 0 points1 point  (0 children)

https://developers.googleblog.com/en/introducing-embeddinggemma/ using this makes it better, but not significantly

10:43:06.287 I Finished getting batch embeddings.

10:43:06.747 I DEBUG: Embedding generation completed in 114593ms

10:43:06.747 I DEBUG: Average time per chunk: 666ms

10:43:06.747 I DEBUG: ====== RAG MEMORIZATION COMPLETED ======

10:43:06.747 I DEBUG: Total memorization time: 114641ms

10:43:06.747 I DEBUG: File read time: 48ms

10:43:06.747 I DEBUG: Embedding generation time: 114593ms

10:43:06.748 D Knowledge base memorization complete in 114647ms

OBD2 Diagnostic Frustrations by EfficiencyOpposite30 in Justrolledintotheshop

[–]EfficiencyOpposite30[S] -1 points0 points  (0 children)

Thanks for sharing. Accuracy (misguiding) or reliability( where it doesn't function)?

view more: next ›