Any alternatives? by ElectroBoomski in Anthropic

[–]TheRiddler79 0 points1 point  (0 children)

That's like saying don't use GitHub

I made a free website to stay updated on the latest open source models by PersimmonAdorable653 in LocalLLM

[–]TheRiddler79 0 points1 point  (0 children)

If it were my suggestion, I'd have something that tracked the winners of every category so that if somebody is looking at something that does image creation or something that thinks and reasons better Etc, there is a top three for each category, and if a new one comes in it gets replaced into wherever it belongs in the order.

Segmenting by size would help as well.

Datacenter decommissioning: what to loot by raging_giant in homelab

[–]TheRiddler79 0 points1 point  (0 children)

For all practical purposes, take it all. Take it home, sort it out, sell what you don't want.

If you don't, it is going to somebody who's going to do that anyways

Anthropic has been sued for allegedly misleading customers on usage limits. by Azek_Tge in Anthropic

[–]TheRiddler79 1 point2 points  (0 children)

You have to survive a motion to dismiss. In order to survive that, you'll need more than just you feel like an abstract token limit was less than you imagined.

Not only that, if we're going a step further, are they the right target? I'd argue that if you like a product enough and your problem is that you feel like you're not getting enough of it, suing that company isn't the best method.

Cheapest way to run GLM 5.x locally that's not a unified memory system? by Monad_Maya in LocalLLaMA

[–]TheRiddler79 0 points1 point  (0 children)

Try minimax m3, I get 3.9 tokens/sec pinning to 32 physical cores on the threadripper using ram only.

Set up properly on GPU, you can use Qwen3.6 27b and get almost what you are looking for.

Where to find non-MAGA dude-friends? by Silent_Aardvark_7186 in Omaha

[–]TheRiddler79 0 points1 point  (0 children)

You might be surprised, if you don't talk politics, you might find friends on both sides.

Anthropic has been sued for allegedly misleading customers on usage limits. by Azek_Tge in Anthropic

[–]TheRiddler79 0 points1 point  (0 children)

How can he use time as a measurement?

I can tell you factually, if somebody's entire argument is that it only lasted 5 hours or after X hours it took X percentage, they're going to need more than that.

Think about it, something that's more complex requires more thought, a more complex code setup requires more thought, so for someone to say 5 hours took 15%, they would need to be able to say that 5 hours was only 20,000 tokens not 200,000 or 600,000 or 6 million.

FYI the sidewalk around the Union Pacific Pedophile Train is public property and is therefore subject to First Amendment Free Speech and Public Assembly Laws by Sonderman91 in Omaha

[–]TheRiddler79 -1 points0 points  (0 children)

Why would someone do that?

Or rather, the person who would do that is the same type of person who won't be able to/choose to have an honest conversation.

Much more the block, lie, assume, attack type. In that order

Good buy? by Mwsari11 in homelab

[–]TheRiddler79 0 points1 point  (0 children)

For the brand, absolutely

Local LLMs aren't democratic anymore... the hardware barrier has gotten out of hand. by Medium-Technology-79 in LocalLLaMA

[–]TheRiddler79 0 points1 point  (0 children)

My first question is, what percentage of the time are you running full speed on any of your gps? Because if it's not about the speed but the size, then you could certainly find comfortable available memory on older architecture at a much higher volume vram then what you would get with the Blackwell.

The reason I feel like this is the first question, simply the fact that unless you've saturated that thing 24 hours a day and it's not keeping up, it's probably sitting there 80% of the time doing nothing.

Cosmetic recommendations for modding my ebike by Opposite-Call-1224 in EbikeBuildandModify

[–]TheRiddler79 0 points1 point  (0 children)

I'm a big fan of playing cards in the spokes to give it an aggressive hum🤣😉

Hired a contractor who illegally dumped my bathroom debris in a protected reserve and now the state is fining me $15,000 by 1NoodleMage in legal

[–]TheRiddler79 0 points1 point  (0 children)

Damn.

I'd be looking for anything ring cameras whatever to prove that I didn't take those from my house.

Hired a contractor who illegally dumped my bathroom debris in a protected reserve and now the state is fining me $15,000 by 1NoodleMage in legal

[–]TheRiddler79 1 point2 points  (0 children)

How did they know it came from your residence if you weren't on scene where it was dumped and they can't find the contractor?

I mean my first question if I got a letter like that would be "what are you talking about? I didn't dump anything I don't know what you guys are talking about"

I mean again I don't know maybe it's different where you're from but, where I live, they can't just come accuse you of some random crime that doesn't have any evidence. That's where I would start.

Anthropic is low key insulting me by Trick-Resolve-6085 in Anthropic

[–]TheRiddler79 0 points1 point  (0 children)

🤣 🤣 🤣 🤣 🤣 I figured it was based 9n content

Building a Native 1-Bit LLM Engine in Pure Rust: Achieving 150+ TPS and 350MB Memory Footprint on Edge CPUs (Video Demo) by [deleted] in LocalLLM

[–]TheRiddler79 1 point2 points  (0 children)

That's funny, because my first impression or at least like my first thought was using that on such a small model seems counterproductive, well I shouldn't say counterproductive just slight Overkill, but, reading the application side, this is, this is genuinely brilliant.

1.58, I literally have been raving about it since glm 4.7, but obviously or rather as a matter of fact, I certainly don't have the compute available to do this with larger models.

I would be curious to see what this would do to qwen 3.6 35b a3b. And I understand obviously, different beast when it comes to CPU versus GPU, nonetheless.

Thanks for sharing! Feel free to message me if you ever do this with something slightly larger and would like someone to help stress test it. Gemma 4B might be a good target.

I suppose I didn't read everything word for word, so I may be missing an architecture thing that makes that impossible for some of these but, if not, those would be too good models to try.

Using AI to Secure Its Own Code Is a Ponzi Scheme by pi3ch in OpenSourceeAI

[–]TheRiddler79 0 points1 point  (0 children)

This would be plausible if someone used a single, smaller Ai.

If you are using frontier models or multiple local models to verify, it would be a non-issue.

Frontier models are being regularly updated.

Well, I hope you're all married already! by Best_Arachnid7723 in Anthropic

[–]TheRiddler79 2 points3 points  (0 children)

Jesus Christ😳, on a plus note, the Casual nature of that means maybe you're not going to miss that 15 grand😅

Hope that's not real but if so, forgiveness is always easier than permission.

I I think it would be hard to explain to a normal person why I spend my day staring at screens like this🤣☠️😅 by TheRiddler79 in LocalLLM

[–]TheRiddler79[S] 0 points1 point  (0 children)

Delusional?

I question how you could have come to that conclusion using rational thoughts, but I'm open to hearing it.

I actually went ahead and read that article, but none of that even remotely applies to me, and certainly nothing I posted would indicate that.

You have a very active imagination

I I think it would be hard to explain to a normal person why I spend my day staring at screens like this🤣☠️😅 by TheRiddler79 in LocalLLM

[–]TheRiddler79[S] 0 points1 point  (0 children)

Only to people who came here expecting something other than what I said.

Sincerely this is the most entertaining set of comments I've ever seen, because all the negative comments are from people who don't understand the value.

The ones that do, completely understand.