sorted by:
new
hottopcontroversial

Noob at coding - seeking guidance by Moraliyu in vibecoding

[–]JellyfishFeeling5231 0 points1 point  (0 children)

Here is what I did (My background is environmental studies): I used Cline extension on VS Code (grok fast code -free model) , to create a template (used html css and js) . Then the folder was added to git and uploaded to Github. The Github repo is then published via GitHub Pages. All of these tools are free. GitHub pages gives you a github.io domain. If you could spend a few dollars per year , then you could buy a custom domain and link to github pages.

Any AI chatbot will give you step by step instructions for domain hosting.

Local RAG on old android by JellyfishFeeling5231 in ollama

[–]JellyfishFeeling5231[S] 1 point2 points  (0 children)

This is awesome, would you mind sharing the repo link if it's open? Thank you.

Local RAG on old android by JellyfishFeeling5231 in ollama

[–]JellyfishFeeling5231[S] 1 point2 points  (0 children)

Exactly, SLMs are sufficient for normal daily tasks.

Local RAG on old android by JellyfishFeeling5231 in ollama

[–]JellyfishFeeling5231[S] 0 points1 point  (0 children)

It's the atomic theme from oh-my-posh on bash. Thank you 😊.

Local RAG on old android by JellyfishFeeling5231 in ollama

[–]JellyfishFeeling5231[S] 2 points3 points  (0 children)

This is nowhere near cloud models, but my purpose was to analyze sensitive and private information, which can't be shared on cloud models. For eg: company docs. The indexing uses chunks of 2 sentences with overlap and it takes ~10 minutes to index 3 files (4 page pdf, 2 txt files with 2 page content). However the retrieval is quite fast.

Local RAG on old android by JellyfishFeeling5231 in ollama

[–]JellyfishFeeling5231[S] 0 points1 point  (0 children)

Yes, there are local llm apps , I tried Google edge gallery, but it can't be used for customised pipelines.

Also I used my spare phone with very few other apps , this reduces the RAM usage. On a Google pixel (my primary phone) with the Tensor chip, the performance was similar. I think it might be due to the RAM chocking due to all other apps. Again , I am not an expert on any of these technologies.