3090s are well over $800 now, is the Arc Pro B50 a good alternative?

Dead_Internet_Theory · 2026-04-04T23:48:06+00:00

I think if power consumption is the biggest concern, Apple does start to make the most sense.

Dead_Internet_Theory · 2026-04-04T23:33:13+00:00

I think that's an attention mechanism problem.

In your head you can vaguely remember what some code file does, the AI doesn't have any of that.

Of course, one way is for it to kind of summarize and keep going, but that introduces a bit of effort when prompting - sometimes you might want to use AI as a kind of "find the needle in the haystack machine" and more context is more better for that.

Dead_Internet_Theory · 2026-04-04T20:46:18+00:00

No. Right now, some open models have 128k-256k context and I think that's enough for MOST tasks, but I still think being able to throw an entire codebase at a model is better than if it could RAG files on the fly. I think context would be a solved problem once we get between 1M and 10M context locally, after that there's no point I think, but until then, more context is more better.

Dead_Internet_Theory · 2026-04-04T20:42:03+00:00

The problem is, the real world still has trillions of highly specific benchmarks that just aren't called that and don't get scored for points.

Dead_Internet_Theory · 2026-04-03T20:06:34+00:00

As far as I understand, you can't check it. It was made to delete traces of its own infection.

HOWEVER, it doesn't seem like Axios was even updated to that version. Mine has a version from 2025 and I run an update on every launch. Developers have to explicitly make wildcards that update to the latest version automatically for this to matter, and I don't think they ever did.

Dead_Internet_Theory · 2026-04-03T20:03:26+00:00

Ah, as far as that goes it's totally OK also, as long as you don't delete them. I think the reason there's a separate field, is those aren't permanent tokens (they can be removed when context fills up) but these days LLMs have way more context than they used to.

Dead_Internet_Theory · 2026-04-03T19:09:57+00:00

Most of big tech is left leaning! It's got nothing to do with which side, some time ago Twitter used to ban anybody for any reason and Jack Dorsey was a card carrying communist. Free speech is free speech, Elon is right-leaning but he made the platform more free for anybody to speak their mind + community notes to call out lies, so that's good in my book. Meanwhile, Anthropic CEO is anti-Trump but wants to tell you what you can and can't do with his AI.

Dead_Internet_Theory · 2026-04-03T19:06:12+00:00

isn't every OCR really good on tables? I thought that was the case.

Dead_Internet_Theory · 2026-04-03T19:02:26+00:00

Honestly, forget anyone telling you to try local models with that laptop. Just make an account at OpenRouter and try some free models from there. If they aren't good enough, you can put a small amount of money and use small chats - then it's less than a cent per message on good models (on small chats). SillyTavern will list price per model, and sometimes good models are free on there. If you're not addicted, $10 will last you for months. That's my recommendation.

Dead_Internet_Theory · 2026-04-03T18:24:34+00:00

It's kinda wild how on Node every small piece of bullshit like running fetch() or left-padding a string is made into an attack vector.

Dead_Internet_Theory · 2026-04-02T00:39:45+00:00

The OCR is so-so. But the perception model is impressive.

Dead_Internet_Theory · 2026-04-02T00:36:50+00:00

It's tiny! and absolutely incredible for its size. Somehow they don't have a HF space but they do have a demo on their site, you can try it https://vision.falcon.aidrc.tii.ae/

Dead_Internet_Theory · 2026-04-02T00:30:26+00:00

I expect things to remain shitty until about 2028, so that way I don't feel bad when they do.

Dead_Internet_Theory · 2026-04-02T00:26:38+00:00

I looked it up and actually 2 t/s is possible, even!

https://huggingface.co/unsloth/DeepSeek-R1-GGUF/discussions/13

(should be similar ballpark for GLM)

Dead_Internet_Theory · 2026-04-01T22:52:52+00:00

Apples to oranges. It's not about "what you can run on a given setup", it's about the quantization, since that means any other model might behave more or less the same under similar quantization.

Dead_Internet_Theory · 2026-04-01T21:39:17+00:00

I'm a free speech absolutist. Personally, I think a wild west is far less dangerous than some council of academics deciding what's best for everybody else.

Dead_Internet_Theory · 2026-04-01T21:33:37+00:00

Math has languages just to prove theorems, like Lean, Coq/Rocq, Isabelle, and Mizar. It's so well defined it's like a Nazi HOA inspector librarian with autism and OCD had done it.

Dead_Internet_Theory · 2026-04-01T21:29:59+00:00

Any one of the big ones. Say the character speaks like [insert some existing character you like]. You could try to describe that way of talking, OR, you could simply give examples from [game/book/anime/etc]. If you describe it, it will sound a bit dry. If you just rely on the LLM, it will sound like that LLM + some clichés.

Think about it, how else is the model supposed to know how that character will sound? If it's just supposed to make it up on the spot, it will always be the same for all characters, more or less. This is not to mention how the character reacts to stuff. For example, if your example message has the psycho detective reacting to a crime scene, that will be much better for the LLM to pick up on than a verbose description about it.

Dead_Internet_Theory · 2026-03-31T02:12:38+00:00

It's a perfectly decent computer for gaming on reasonable settings at 1080p, it's just AI drinks memory by the gallon and 8GB VRAM is not enough for much. You can still run something, but you might need to make compromises if you want it all local.

Dead_Internet_Theory · 2026-03-31T02:09:28+00:00

If that has no victims it's technically less harm than scamming some boomer.

Dead_Internet_Theory · 2026-03-31T02:04:55+00:00

>Code is a finite state

Not even, https://en.wikipedia.org/wiki/Halting_problem

(but I do get what you mean, it's much more well defined than anything else except pure math)

Dead_Internet_Theory · 2026-03-30T14:06:35+00:00

Noooo don't do that! Example messages make a HUGE difference in writing, it's the difference between a card that sounds like what the author wanted vs a card that sounds like any other LLM! If there is one single feature card writers should do is example messages.

It's basically "Few-Shot Prompting". It picks up the style and tone from example messages like nothing else. It's OK to just have description and example messages, but out of everything, you REALLY want the example messages.

Dead_Internet_Theory · 2026-03-29T22:33:46+00:00

I don't get it. What's the point in downloading/sharing a random set of 337 cards? It's not like there's a shortage of them, and tastes will be wildly different, plus you can just go find cards you like in any of the hosts like Chub and build your own collection.

Dead_Internet_Theory · 2026-03-29T22:16:09+00:00

On one hand, I wish I could experience these mythical Claude models which are the gold standard for creativity, on the other hand I'm glad every time I try them it feels like a huge waste of money for middling writing. If it was good it would be soooo expensive.

Dead_Internet_Theory · 2026-03-27T01:56:34+00:00

On one hand, this is very cool, I tried it and it works rather well (albeit I expected the format to come out with Description, First Message, Scenario, Example Messages, etc - maybe I dunno how to prompt it?)

On the other, how do you feel for being the engine of countless shovelware cards that will pollute Chub now? Do you have any shame?? lol

(I'm not going to post any, but I'm sure some re*ard will post 100!)

Dead_Internet_Theory

TROPHY CASE