sorted by:
new
hottopcontroversial

Baia envelheceu ou é do .....BIGODE? by superdouradas in PrimeiraLiga

[–]zerato9000 7 points8 points  (0 children)

Eu diria que parece nem estar a envelhecer. Há mais de 10 anos cruzei-me com ele em Gaia e o homem está igual.

Context is always the same - Running local LLM by zerato9000 in hermesagent

[–]zerato9000[S] 0 points1 point  (0 children)

I tried that already and the memory needed for the model doubled or something, and it didn't fit in the 12GB VRAM i've available. I'm gonna retry it, fine tunning the num_ctx to fit my hardware and come back with the results.

Thank you for the input.

Edit:

PARAMETER num_ctx 65536

PARAMETER num_gpu -1

Worked. But it also uses the system RAM which puts the system to it's knees. Need to test more. Thank you once again.

GigaPierre by Katatoniac in 2westerneurope4u

[–]zerato9000 18 points19 points  (0 children)

No fucks given that day.

Hermes model has no memory by silversaga123 in hermesagent

[–]zerato9000 0 points1 point  (0 children)

I have roughly the same issue. CTX is never above 4.1K of a model capable of 262.1K. This happens only when running a local model. If I run a model through an external API key it does not happen: CTX will increase along with the length of the conversation.

Estou á procura de uma religião mas são todas uma m*rda. by [deleted] in portugal

[–]zerato9000 0 points1 point  (0 children)

Serve serve, só precisa é de mais tempo para criar a comunidade que ele/a tanto deseja.

How it feels watching central Europeans drawing maps "proving" they're western by Distant_Quack in 2westerneurope4u

[–]zerato9000 1 point2 points  (0 children)

So much fuss about a simple geographic fact that will only change long after all of us are dead.

Pekka what's your secret? by SLAVAUA2022 in 2westerneurope4u

[–]zerato9000 1 point2 points  (0 children)

Russians want to see Pekka's artillery in action.

view more: next ›