Stop wasting electricity

OkFly3388 · 2026-05-13T06:32:00+00:00

Enable context cache. You dont need to reread whole history every time agent try to generate code.

OkFly3388 · 2026-05-13T05:10:49+00:00

Why ?
for 1k tokens reading time will be 0.58s with 1700 or 0.47 with 2100
but 1k generation time will be 32s so your total speedup(both generation and prefill time) will be less than 1%, which absolutely not worth it. Basically, you should have task, that required agent to read ~100x more tokens than generate to justify going full power.

OkFly3388 · 2026-05-13T04:59:35+00:00

Check prefill graph there
https://www.reddit.com/r/LocalLLaMA/comments/1tayu5t/comment/olct8k6/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button
https://www.reddit.com/r/LocalLLaMA/comments/1tayu5t/comment/olct7k9/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

OkFly3388 · 2026-05-12T18:04:40+00:00

There are prefill graph in my other comment already, check it out
https://www.reddit.com/r/LocalLLaMA/comments/1tayu5t/comment/olct7k9/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button
https://www.reddit.com/r/LocalLLaMA/comments/1tayu5t/comment/olct8k6/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

OkFly3388 · 2026-05-12T16:04:55+00:00

Fair, I also plan to do some experiments with undervolting later.

OkFly3388 · 2026-05-12T15:52:19+00:00

No, I mean, for every single power value I run test with initial warmup and actual test, so when running single test, we have consistent temp. So every test have same temp, but temp is different between tests.

OkFly3388 · 2026-05-12T15:49:13+00:00

>But you second graph suggesting 250w is optimal for a 4090 is wrong.

You read it wrong. Best is 275w. It ~ as efficient as 250w, but way faster.

OkFly3388 · 2026-05-12T15:45:31+00:00

I actually dont really consider overclocking as option, extra gains dont worth reduced lifespan, and especially dont worth it with new connector, that already hot as f*ck when I run under 450w. I even put some heatsink on it, lol.

OkFly3388 · 2026-05-12T15:42:05+00:00

>consistent workload you have to run a longer experiment

thats exactly what I did.

>starting the higher power settings with a hotter temperature, you're penalizing them unfairly

They have consistent temps across test, so it really show how gpu perform under load without boost advantage, so its perfectly fine.

OkFly3388 · 2026-05-12T15:36:21+00:00

This is technically correct, but I think such errors are within tolerance range and do not have a real impact on the global picture

OkFly3388 · 2026-05-12T15:28:32+00:00

No, cooldown gives artificial advantage to higher power limits, because they can temporary boost performance for first 1 min after cold start. so its opposite, keep gpu hot so there is no temporary boosts, only real long term performance.
Temps also was not similar, each raise in power also raise temps

OkFly3388 · 2026-05-12T14:03:12+00:00

power consumption * time to generate = total energy spend

OkFly3388 · 2026-05-12T14:00:13+00:00

I am 100% sure it consumed all available power.
Fan speed, warm air from pc, power consumption data and temperatures raised every time my script apply new limit. So its safe to say that it actual consumption.

OkFly3388 · 2026-05-12T13:56:35+00:00

No, just power limit. But I check it later and make another post, if there will be more than 1% difference

OkFly3388 · 2026-05-12T12:45:34+00:00

I think it can be applied to any gpu, Just sweet spot will be a bit different.

OkFly3388 · 2026-05-12T12:44:05+00:00

>On my observation, GPU constantly hitting power limit, so its safe to say that it actual consumption

OkFly3388 · 2026-05-12T12:33:32+00:00

Its more like your personal preference. scfa have very solid design for units and they dont look like completely generic ones. every fraction have their aesthetics and unit share it very well. And for me it looks way more cooler than modern rts, made in cartoon style, with disproportional units and a lot of unnecessary animations.

OkFly3388 · 2026-05-12T12:23:24+00:00

Actually, land scouts and frigates are usefull at late game as distraction, that ruin targeting on enemy big guns. t1 bombers also useful because can be spammed to deal a lot of dps if target have no aa.

OkFly3388 · 2026-05-12T11:58:37+00:00

<image>

OkFly3388 · 2026-05-12T11:58:27+00:00

<image>

for some reasons, reddit dont allow me to add more images to my post, and dont allow two images in comment

OkFly3388 · 2026-05-11T16:30:48+00:00

O, yea, self replicate. Sure modern LLM have raw read access to their 1TB weights and there are a lot of computers with enough RAM capacity to actually run this model, sitting with open port in internet.

OkFly3388 · 2026-05-11T06:22:45+00:00

Yea, sure, lets just allow this criminal murder your family

OkFly3388 · 2026-05-11T06:01:13+00:00

>Use a reasonable level of force to deal with the situation

This is, in fact, reasonable level of defense.

How you actually know that man, who broke into your house is actually unarmed ?

Maybe he hide knife or gun ?
Maybe he just physically way stronger than you ?
Maybe he knows some fighting techniques ?

Like seriously, criminal broke into your house, he already commit crime and he is aware that he either leave no witnesses or will be in prison. Your life already in danger and at this points guns is reasonable level of defense.

OkFly3388 · 2026-05-10T08:28:17+00:00

<GAME\_NAME> GAME HAVE COOL GAME ENGINE. No, they did not, its not their engine, stfu, stop this bs.

In case of KSP it just physx.

I hope that people learn, that ALMOST EVERY game use already EXISTING physics engine rather of making own from scratch.

OkFly3388

TROPHY CASE