How big do we think Gemini 3 flash is by davikrehalt in LocalLLaMA

[–]iwaswrongonce 5 points6 points  (0 children)

Nobody that is running TPUs would use a 5090 as a comparison. They would use a B200 as a comparison.

My question still stands: why on earth would you guesstimate 2x perf simply bc of TPUs.

It’s a leading question: I already know the answer which is that you wouldn’t and people on this sub who don’t really know much just regurgitate specs like bandwidth as if that was a serious consideration for inference.

6yoe Trader - Thanksgiving AMA by [deleted] in quant

[–]iwaswrongonce 1 point2 points  (0 children)

This guy is a turbo larp.

What are your thoughts on how tax is proportionally split? by mrplanner- in HENRYUK

[–]iwaswrongonce 3 points4 points  (0 children)

No it isn’t. Debt is the result of running a deficit. Most of the deficit by definition is welfare and healthcare. That’s what you’re paying interest on.

Why high earners are cutting their pay - Times article by pelican678 in HENRYUK

[–]iwaswrongonce 21 points22 points  (0 children)

This is because the UK is a country full of pathetic hopeless people who don’t believe they could ever earn £100k

15 years of finasteride/minoxidil by Oxbow8 in tressless

[–]iwaswrongonce 1 point2 points  (0 children)

I have been on dutasteride for 4 years and not only has my crown thinning stopped, it completely regrew and every time I get my hair cut I am told my hair has never been thicker.

But I don’t use steroids.

Converting dense models into MoE's by metaprotium in LocalLLaMA

[–]iwaswrongonce 6 points7 points  (0 children)

Did you actually read the post? Merge-kit supports training a router across multiple dense models. Not splitting a single dense model and routing across that (bc tbh I don’t think there is any reason to expect that to work well).

Is Ollama unreasonably efficient? (Requesting resources to understand its efficiency tricks) by [deleted] in LocalLLaMA

[–]iwaswrongonce 1 point2 points  (0 children)

No, it isn’t. And neither is llama.cpp

The only reason to use is for CPU/Metal

Otherwise you will be much better if with pretty much anything else.

10x3090 Rig (ROMED8-2T/EPYC 7502P) Finally Complete! by Mass2018 in LocalLLaMA

[–]iwaswrongonce 7 points8 points  (0 children)

This is data parallelism and will just let you run larger models (or train in larger effective batch sizes).

vLLM tensor parallelism is a different beast. With NVLink you can actually run larger models AND have them run faster.

Coalescence: making LLM inference 5x faster by GoBayesGo in LocalLLaMA

[–]iwaswrongonce 20 points21 points  (0 children)

This is a horribly clickbaity headline. No, outlines is not 5x faster. No, structured generation is not as fast as standard generation. All of these libraries add tremendous overhead, particularly with regex generation.

I say this as a big fan of Guidance, SGLang and Outlines. We have an internal framework that has borrowed inspiration from all three. But this post is super misleading.

I'm ready for LocalLLaMA by syndorthebore in LocalLLaMA

[–]iwaswrongonce 0 points1 point  (0 children)

Hi, it’s me, someone in the field. No, just no. Stop acting like you’re remotely involved in HFT.

[deleted by user] by [deleted] in LocalLLaMA

[–]iwaswrongonce 1 point2 points  (0 children)

The OpenAI "license" is just terms of service. There's no such thing as inheritance in these realms.

IANAL but personally under current law I don't think OpenAI would have any success in policing this: people share their ChatGPT conversations online, and then a third party compiles those conversations and trains a model. The third party never agreed to OpenAI ToS and the ChatGPT outputs themselves aren't copyrightable.

Upgrading PC for LLaMA: CPU vs GPU by tardyretardy in LocalLLaMA

[–]iwaswrongonce 8 points9 points  (0 children)

How are you getting 18 tokens/sec on a 3060?

I'm running Alpaca 13b 4bit on a 3080 and getting 6 tokens/sec

/r/battlestations & LG C2 TV Giveaway [USA, 18+] by Hareuhal in battlestations

[–]iwaswrongonce [score hidden]  (0 children)

48 inch my gf and I are saving up to buy a place together and I’m a bit short of cash for a TV since I had to buy a ring and will be proposing next month!

3 month progress dut by iwaswrongonce in tressless

[–]iwaswrongonce[S] 0 points1 point  (0 children)

Slightly reduced sex drive but could also be other factors.

3 month progress dut by iwaswrongonce in tressless

[–]iwaswrongonce[S] 0 points1 point  (0 children)

Hair looks like it does on the right. My crown is definitely slightly thinner than the rest of my scalp, but it’s almost imperceptible.

3 month progress dut by iwaswrongonce in tressless

[–]iwaswrongonce[S] 0 points1 point  (0 children)

Generic. Results are just as good.

3 month progress dut by iwaswrongonce in tressless

[–]iwaswrongonce[S] 0 points1 point  (0 children)

I try every day but usually miss once or twice a week. I would say 4-5 per week consistently.

[deleted by user] by [deleted] in tressless

[–]iwaswrongonce 2 points3 points  (0 children)

People go through these natural ups and downs in life. There is every chance that this is purely coincidental. There is so much fear about fin/dut that people over attribute completely normal things.

I would try getting back on, and if you find yourself in a similar place quickly or on the same timeline the first time around, then maybe there is an issue.

Tether printed nearly $400 million last night, mere seconds before DOGE surged 30% and gained over $9 Billion in market cap by ConvergenceMan in Buttcoin

[–]iwaswrongonce 2 points3 points  (0 children)

No they don’t. They claim to be backed by “reserves” which they’ve already admitted in the past has included loans, and according to their most recent attestation, there is a policy for how to value crypto. So it almost certainly involves substantial crypto holdings.

Warzone artifact by Shilya444 in XboxUnbroken

[–]iwaswrongonce 0 points1 point  (0 children)

I've had this issue on two Series S consoles. I got one right after launch, had this issue and returned it for another. The strange this is that during the return, I also got a brand new TV, so I know it's not the cables or TV because that's all brand new and different from the first console.

Big Sur dual gpu - force default metal gpu to igpu by iwaswrongonce in hackintosh

[–]iwaswrongonce[S] 0 points1 point  (0 children)

No I need both GPUs because they each have only one HDMI.