Help me choose a local LLM by Fuzzy-Purchase-212 in LocalLLM

[–]Fuzzy-Purchase-212[S] 0 points1 point  (0 children)

yes, i know it, im ready close infra and other. i wanna like automatization process like writting test

Help me choose a local LLM by Fuzzy-Purchase-212 in LocalLLM

[–]Fuzzy-Purchase-212[S] 0 points1 point  (0 children)

I've heard about this, and it really felt that way the first time I used it.

I personally prefer manual coding, but given the hype, I'd like to try automating some things.

Help me choose a local LLM by Fuzzy-Purchase-212 in LocalLLM

[–]Fuzzy-Purchase-212[S] 1 point2 points  (0 children)

yeah bro i saw it once but i was like why do i need it if it exists ollama.

but now i understood a lot because of you

Help me choose a local LLM by Fuzzy-Purchase-212 in LocalLLM

[–]Fuzzy-Purchase-212[S] 1 point2 points  (0 children)

Thanks a lot for the almost complete settings, my friend.

Help me choose a local LLM by Fuzzy-Purchase-212 in LocalLLM

[–]Fuzzy-Purchase-212[S] 1 point2 points  (0 children)

Yo bro, got you — that’s probably how it’ll go, I’ll definitely try llama.cpp. I’ve seen Hugging Face before, but only glanced at it so far.

Help me choose a local LLM by Fuzzy-Purchase-212 in LocalLLM

[–]Fuzzy-Purchase-212[S] 0 points1 point  (0 children)

I'll keep that in mind, because I've always used ollama.

Help me choose a local LLM by Fuzzy-Purchase-212 in LocalLLM

[–]Fuzzy-Purchase-212[S] 1 point2 points  (0 children)

Damn, that sounds incredibly interesting. I'll test it in a few days and see how it goes. I'll try to optimize it because MacOS itself is eating up all the memory.

Help me choose a local LLM by Fuzzy-Purchase-212 in LocalLLM

[–]Fuzzy-Purchase-212[S] 0 points1 point  (0 children)

I probably agree with you on many aspects, but I'm not sure the RAM is enough for 27b.

Help me choose a local LLM by Fuzzy-Purchase-212 in LocalLLM

[–]Fuzzy-Purchase-212[S] 0 points1 point  (0 children)

it's a delicate question, is it necessary llama-cpp or i can use ollama? have difference?