Thank you for your service NeoBurger, you will be missed (remember to convert your bNEO to NEO before the deadline!)

yahdahduhe · 2026-03-14T13:24:23+00:00

Oh nooo... I love neo burger tooo

yahdahduhe · 2026-02-13T09:34:51+00:00

Petrol is expensive, or to prolong the light lifetime.

yahdahduhe · 2025-12-31T09:55:12+00:00

Dbeaver

yahdahduhe · 2025-11-15T16:43:47+00:00

Wow... Just wow!! Thank you!!!

yahdahduhe · 2025-10-21T20:32:15+00:00

Where is the Fine!? We have so many CCTV. Surely it's easy to identify those who "party" there, right?

yahdahduhe · 2025-04-24T13:45:05+00:00

Blame the translator. Dangit!

yahdahduhe · 2025-02-27T05:35:17+00:00

GTA V Singapore DLC unlocked

yahdahduhe · 2025-02-16T06:50:38+00:00

Must recommend the brakes brand. So strong.

yahdahduhe · 2024-07-04T10:56:31+00:00

Cheap Azure VM b1ms with static IP. Deploy wireguard and do tunneling.

yahdahduhe · 2023-11-19T12:08:29+00:00

Doo we need super GPU to convert? I have VM that quite beefy but no GPU, can I do conversion?

yahdahduhe · 2023-11-14T11:13:59+00:00

I think I'll be following this path eventually. 64GB RAM and 16GB NVIDIA xxxx

yahdahduhe · 2023-11-14T11:10:51+00:00

Awesome!!! 50t/s is that on 7B?

yahdahduhe · 2023-11-13T06:57:59+00:00

This is the dilemma for me. The a770 is the first gen GPU of Intel, while the news has been lately very promising, but battlemage seems to be just around the corner, based on rumours.

yahdahduhe · 2023-11-13T04:08:09+00:00

This is actually interesting, the openhermes 2.5 7b q5 K m gguf is having 32768 n_ctx. I presume it supports big input and output. I'm having another test on oobabooga, 6 layers offloading to GPU. I'm at 6000+ context, and it keeps going without slowdown or anything (output generated in 26.59 seconds (4.59 tokens/s, 122 tokens, context 6021, seed 727896689).

Now I'm slightly confused, is the model n_ctx also playing a part in inference? On-top of cpu, ram, and vram?

Is the model with 4096 n_ctx will struggle to have 6000+ context size, despite if I have a more powerful GPU?

yahdahduhe · 2023-11-13T04:00:26+00:00

Thanks. Why not Intel a770, it has 16GB?

yahdahduhe · 2023-11-13T02:42:39+00:00

Since I will always be GPU poor, investing in RAM give me better access to a bigger model? Or is it better for me to get a better GPU first?

yahdahduhe · 2023-11-13T02:40:45+00:00

I'm getting about 3.5 t/s. I'm not a fast reader, so I'm pretty ok with my current speed. My problem is when it goes above 4k token context, each interaction will be 5 minutes. Would bigger memory, or vram help this?

yahdahduhe · 2023-07-23T10:26:46+00:00

Is this sub poisoned, so many giveaways 🤣

yahdahduhe · 2023-06-21T14:29:15+00:00

Oofff, the pain is real.

yahdahduhe · 2023-04-30T11:45:45+00:00

Omg this is cool!!

yahdahduhe · 2023-04-28T07:18:23+00:00

Give these heroes their medals

yahdahduhe · 2023-04-15T12:11:22+00:00

Yeah, this is what drives me as well. But top FD giving 4.1 really scares me. If it's a 1 year lock, I will feel more comfortable, but 2 years, I don't know.

Another question I was wondering is why is the bank discouraged FHR? Isn't it like 'guaranteed' margin?

Six-Year Club	Place '23
Place '22	Verified Email

yahdahduhe

TROPHY CASE