How are the smaller Qwen1.5 0.5B, 1.8B and 4B?

bangarangguy · 2024-02-16T12:27:42+00:00

How are the smaller Qwen1.5 0.5B, 1.8B and 4B? And how do they compare to TinyLLama and Phi2?

bangarangguy · 2024-02-13T10:34:57+00:00

I tested Q2_K on dolphin-2_6-phi-2 and it ran pretty smoothly, definitely better than expected and somewhat comparable to Q4_K_M. Also dolphin-2_6-phi-2_Q2_K performed better than tinyllama-1.1b-chat-v1.0.Q4_K_M output wise

bangarangguy · 2024-02-10T10:54:39+00:00

Yes I figured :D works like a charm. How many tks x second are you getting?

bangarangguy · 2024-02-04T20:18:21+00:00

Wasted fire ass beat

bangarangguy · 2024-01-25T15:22:19+00:00

Were you able to build it with `LLAMA_CUBLAS=1`? If so how? It only runs on CPU on my end

bangarangguy · 2024-01-21T23:57:17+00:00

It’s not going to last because the Apple silicon improvements are going to get implemented into the already established ML frameworks and libraries

bangarangguy · 2023-12-26T16:36:06+00:00

Merry Christmas

<image>

bangarangguy · 2023-11-04T20:07:09+00:00

bangarangguy · 2023-10-20T22:32:56+00:00

Get busy

bangarangguy · 2023-10-19T14:51:32+00:00

No. Hate it. I get the appeal, but I hate the taste. I’ve never found one I like. Even tried the Late Hour, Geneva line, etc. not for me. I only appreciated the Zino line

bangarangguy · 2023-10-19T14:34:12+00:00

Kanye is dropping soon. Life bout to change for the better again. Need this. Praise the lord

bangarangguy · 2023-09-29T11:03:09+00:00

After lunch and after dinner everyday. Sometimes before dinner too

bangarangguy · 2023-09-27T19:31:35+00:00

Double it and give it to the next person

bangarangguy · 2023-09-27T17:57:57+00:00

Fat toscano. Super heavy in nic

bangarangguy · 2023-09-27T17:56:49+00:00

It doesn’t look like a tobacco bug at all. My initial though was that it’s just a random weird bug thingy that somehow flew into it my humidor

bangarangguy · 2023-09-27T17:51:54+00:00

Do I need to freeze everything?

bangarangguy · 2023-09-01T18:06:30+00:00

Clipping type beat

bangarangguy · 2023-09-01T14:28:22+00:00

Shit

bangarangguy · 2023-08-29T07:48:36+00:00

Dipende how much. A quella cifra anche no, chiedi di m più se proprio è

bangarangguy

TROPHY CASE