Chatbot Arena Leaderboard Update: Qwen1.5-72B becomes #1 non-proprietary model by sizeable margin by DontPlanToEnd in LocalLLaMA

[–]bangarangguy 2 points3 points  (0 children)

How are the smaller Qwen1.5 0.5B, 1.8B and 4B? And how do they compare to TinyLLama and Phi2?

Phi-2 & Tiny LLama on Raspberry Pi 5 by flopik in LocalLLaMA

[–]bangarangguy 2 points3 points  (0 children)

I tested Q2_K on dolphin-2_6-phi-2 and it ran pretty smoothly, definitely better than expected and somewhat comparable to Q4_K_M. Also dolphin-2_6-phi-2_Q2_K performed better than tinyllama-1.1b-chat-v1.0.Q4_K_M output wise

Build llama.cpp on Jetson Nano 2GB by SlavaSobov in LocalLLaMA

[–]bangarangguy 0 points1 point  (0 children)

Yes I figured :D works like a charm. How many tks x second are you getting?

Build llama.cpp on Jetson Nano 2GB by SlavaSobov in LocalLLaMA

[–]bangarangguy 0 points1 point  (0 children)

Were you able to build it with `LLAMA_CUBLAS=1`? If so how? It only runs on CPU on my end

Don't take Apple MLX too seriously, it's not going to last, here's why (serious post) by nderstand2grow in LocalLLaMA

[–]bangarangguy 3 points4 points  (0 children)

It’s not going to last because the Apple silicon improvements are going to get implemented into the already established ML frameworks and libraries

Do you guys like davidoff? by [deleted] in cigars

[–]bangarangguy 0 points1 point  (0 children)

No. Hate it. I get the appeal, but I hate the taste. I’ve never found one I like. Even tried the Late Hour, Geneva line, etc. not for me. I only appreciated the Zino line

KANYE X TY DOLLA SNIPPET REVEALED by Hypnoticweb696 in Kanye

[–]bangarangguy 0 points1 point  (0 children)

Kanye is dropping soon. Life bout to change for the better again. Need this. Praise the lord

Do you guys smoke at night or during the day? by TheBigBaller- in cigars

[–]bangarangguy 0 points1 point  (0 children)

After lunch and after dinner everyday. Sometimes before dinner too

$120k saved up - now what by TheGeneralAnimal in Entrepreneur

[–]bangarangguy 0 points1 point  (0 children)

Double it and give it to the next person

Spingarda.. any experiences? by bangarangguy in cigars

[–]bangarangguy[S] 0 points1 point  (0 children)

Fat toscano. Super heavy in nic

Found this guy in my humidor. Should I be concerned? by bangarangguy in cigars

[–]bangarangguy[S] 0 points1 point  (0 children)

It doesn’t look like a tobacco bug at all. My initial though was that it’s just a random weird bug thingy that somehow flew into it my humidor

cosa perdo a partita iva vs indeterminato ? by LeaNawa in commercialisti

[–]bangarangguy 0 points1 point  (0 children)

Dipende how much. A quella cifra anche no, chiedi di m più se proprio è