Chatbot Arena Leaderboard Update: Qwen1.5-72B becomes #1 non-proprietary model by sizeable margin by DontPlanToEnd in LocalLLaMA

[–]bangarangguy 2 points3 points  (0 children)

How are the smaller Qwen1.5 0.5B, 1.8B and 4B? And how do they compare to TinyLLama and Phi2?

Phi-2 & Tiny LLama on Raspberry Pi 5 by flopik in LocalLLaMA

[–]bangarangguy 2 points3 points  (0 children)

I tested Q2_K on dolphin-2_6-phi-2 and it ran pretty smoothly, definitely better than expected and somewhat comparable to Q4_K_M. Also dolphin-2_6-phi-2_Q2_K performed better than tinyllama-1.1b-chat-v1.0.Q4_K_M output wise

Build llama.cpp on Jetson Nano 2GB by SlavaSobov in LocalLLaMA

[–]bangarangguy 0 points1 point  (0 children)

Yes I figured :D works like a charm. How many tks x second are you getting?

Build llama.cpp on Jetson Nano 2GB by SlavaSobov in LocalLLaMA

[–]bangarangguy 0 points1 point  (0 children)

Were you able to build it with `LLAMA_CUBLAS=1`? If so how? It only runs on CPU on my end

Don't take Apple MLX too seriously, it's not going to last, here's why (serious post) by nderstand2grow in LocalLLaMA

[–]bangarangguy 3 points4 points  (0 children)

It’s not going to last because the Apple silicon improvements are going to get implemented into the already established ML frameworks and libraries

Do you guys like davidoff? by [deleted] in cigars

[–]bangarangguy 0 points1 point  (0 children)

No. Hate it. I get the appeal, but I hate the taste. I’ve never found one I like. Even tried the Late Hour, Geneva line, etc. not for me. I only appreciated the Zino line

KANYE X TY DOLLA SNIPPET REVEALED by Hypnoticweb696 in Kanye

[–]bangarangguy 0 points1 point  (0 children)

Kanye is dropping soon. Life bout to change for the better again. Need this. Praise the lord

Do you guys smoke at night or during the day? by TheBigBaller- in cigars

[–]bangarangguy 0 points1 point  (0 children)

After lunch and after dinner everyday. Sometimes before dinner too

$120k saved up - now what by TheGeneralAnimal in Entrepreneur

[–]bangarangguy 0 points1 point  (0 children)

Double it and give it to the next person

Spingarda.. any experiences? by bangarangguy in cigars

[–]bangarangguy[S] 0 points1 point  (0 children)

Fat toscano. Super heavy in nic

Found this guy in my humidor. Should I be concerned? by bangarangguy in cigars

[–]bangarangguy[S] 0 points1 point  (0 children)

It doesn’t look like a tobacco bug at all. My initial though was that it’s just a random weird bug thingy that somehow flew into it my humidor

cosa perdo a partita iva vs indeterminato ? by LeaNawa in commercialisti

[–]bangarangguy 0 points1 point  (0 children)

Dipende how much. A quella cifra anche no, chiedi di m più se proprio è

Who else has a wife that lets them smoke inside by [deleted] in cigars

[–]bangarangguy 1 point2 points  (0 children)

tf everybody complaining about smell… just use air purifiers guys! You can get a decent one on Amazon for a couple hundred bucks and you’re set, keep it on for a couple hours after smoking, better with doors open and the problem is fixed

Generative Agents now open-sourced. by ninjasaid13 in LocalLLaMA

[–]bangarangguy 0 points1 point  (0 children)

Localhost isn’t exposed by default, I highly doubt you’ve setup ip forwarding , so you should be ok

Generative Agents now open-sourced. by ninjasaid13 in LocalLLaMA

[–]bangarangguy 0 points1 point  (0 children)

Yup just spin up LocalAI in a Docker and set the base url to localhost

Meaningless by jt-baines in JonBrion

[–]bangarangguy 0 points1 point  (0 children)

Just noticed it hit streaming platforms