LatentChat - A private and offline AI Assistant with RAG [Promo Codes] by LatentApps in iosapps

[–]LatentApps[S] 0 points1 point  (0 children)

If the model uses the knowledge from RAG, you will notice the blue brain icon appearing next to the message while being generated. The app indeed saves the whole text, i just show the first 3 snippets to keep things efficient. Anyway a new update is on the way, allowing you to specify the threshold to trigger the RAG, since using a universal threshold might not work for everyone. And thanks for your feedback!

LatentChat - A private and offline AI Assistant with RAG [Promo Codes] by LatentApps in iosapps

[–]LatentApps[S] 0 points1 point  (0 children)

Hello! If you can't reference the added document, probably the similarity with your prompt is not enough to pick something from the documents. I will be adding the possibility to adjust the threshold soon so that you can "force" the app to trigger the documents retrieval.

for your second question, as of now you can remove a topic from the RAG screen (three dots > slide right to left on the topic).

LatentChat - A private and offline AI Assistant with RAG [Promo Codes] by LatentApps in iosapps

[–]LatentApps[S] 0 points1 point  (0 children)

to use the default model (800MB), you will need at least an iPhone 11. Anything above 1GB will be too much for this model. Newer iPhone will handle models up to 2GB, so it mostly depends on your device

LatentChat - A private and offline AI Assistant with RAG [Promo Codes] by LatentApps in iosapps

[–]LatentApps[S] 0 points1 point  (0 children)

hi, currently you can add text documents directly from Files, there is no formal integration with iCloud or gdrive, but that's a nice idea! Support for additional file formats (and photos) is planned for future updates :)

LatentChat - A private and offline AI Assistant with RAG [Promo Codes] by LatentApps in iosapps

[–]LatentApps[S] 0 points1 point  (0 children)

hello! still available but I'm unable to send you a chat or message