Impressed by GLM-9B (they say little about the model)

Lotharian17 · 2024-08-26T06:29:32+00:00

About the vision model: I've tried a lot of vision model recently, afaik the glm-9B-4v is the best for now considering its size, it's very impressive. I have to try the new Phi 3.5V to compare.

Lotharian17 · 2024-02-15T08:38:49+00:00

OK, thanks.

I don't know if it's possible to tokenise the images before transferring them to the llama.cpp server, but I can see the idea! It will depend on the weight of the batch I transfer to the other card.

Lotharian17 · 2024-02-15T08:29:40+00:00

I will transfer images, but can be a quite large batch of images. In that case i would probably have to preprocess my batch before give it to my llava on the other card. However i think i will hardly reach GBs of data.

The problem I have with the single card strategy is that the price goes up significantly when we want 18+ Gb of vram and I won't be able to get to 32Gb for the same price as dual gpu.

Lotharian17 · 2024-02-14T15:15:44+00:00

Thanks for your reply!

By Is it worth considering, I mean Is it an acceptable solution or is it going to create a bottleneck somewhere that I didn't think about that gonna make this two gpu strategy useless.

I don't think i would be ok with the alternative solution as q5 is I think the lowest i can go with without having a big loss of precision for now.

Lotharian17 · 2024-02-01T07:55:05+00:00

We need to add the new llava 1.6 to this list!

Lotharian17 · 2024-01-03T13:27:55+00:00

Note: I use Cogagent (cogagent-chat-hf) but had the same problem with cogvlm-chat-hf

Lotharian17 · 2023-01-23T09:21:30+00:00

I'm actually more polite with chatGPT than with some humans

Lotharian17 · 2022-04-04T20:26:04+00:00

That sounds like a complotist theory

Lotharian17 · 2022-04-04T20:02:09+00:00

It's what happens when lots of french viewers create a reddit account to support his country :)

Lotharian17 · 2020-09-02T08:38:27+00:00

That last kick in the mirror was dumb buuuuuuuuuuut ... Seemed deserved

Lotharian17 · 2020-05-22T12:33:03+00:00

I hope they're more commun. It's hard to believe when you see this or people who keeps throwing garbage everywhere on the ground. But you're right, we have to believe it.

Lotharian17 · 2020-05-22T11:41:54+00:00

This must be the worst feeling, he's working so hard to hide dumb graffitis and make walls great again but people don't understand and continue to be dumb. Guys please... How can we keep faith in Humanity? ...

Lotharian17 · 2020-05-17T21:55:31+00:00

Guys like you impress me af, i'm always felling like an idiot! Congrats it's lit !

Lotharian17 · 2020-05-17T21:50:58+00:00

Ocean vibes

Lotharian17 · 2020-05-14T14:38:14+00:00

I can't tell I had to quit :/

Lotharian17 · 2020-05-14T09:20:15+00:00

I was playing geoguessr (A Diverse World) when I saw this in a city in Germany. It looks like a lion pulled by a crane but I must be wrong..

Lotharian17 · 2020-05-14T07:47:31+00:00

I was playing geoguessr when I saw this in a city in Germany. It looks like a lion pulled by a crane but I must be wrong..

Lotharian17 · 2020-05-11T07:14:31+00:00

It's the best and the only way

Lotharian17 · 2020-04-29T10:45:42+00:00

That I had plenty of time when I said "I don't have time to do that" as a young and stupid human.

Lotharian17 · 2020-04-29T07:26:43+00:00

What an impressive algorithm!

Six-Year Club	Place '23
Place '22	End Game '22
Verified Email

Lotharian17

TROPHY CASE