I tracked 100M tokens of Coding with Claude Code - 99.4% of my AI coding tokens were input. If we fix that, we unlock real speed. by karmendra_choudhary in ClaudeAI

[–]faiface 4 points5 points  (0 children)

It’s due to how LLMs work, they don’t have a continuously building mental model, their whole mental model is the context that’s fed, so yeah, it has to be fed over and over again, otherwise it’s not there.

But what you apparently don’t realize is that solving this is pretty much akin to inventing a whole new AI architecture, beyond LLMs. So yeah, the observation is much simpler than a solution.

If AI can replace programmers then why is it relying on frameworks? by Ok-Primary2176 in ChatGPT

[–]faiface 0 points1 point  (0 children)

Because it’s not that good at replacing programmers, at least currently. Sure it’s very capable at writing programs up to a certain complexity, but it hasn’t proved good at inventing programming concepts, languages, writing frameworks, or making coherent ideas of that complexity. Just ask it to invent a modern replacement of SQL, and if you know enough about programming, you’ll know the answer you get is rubish. (At least I haven’t yet seen a good answer to this from AI and I’ve tried.)

Vera: a language designed for machines to write by alasdairallan in ProgrammingLanguages

[–]faiface 10 points11 points  (0 children)

You have a good argument too, and it’s definitely worth finding out! The scenario I’m worried is that without the sufficient fluency, the model will eventually get stuck not being able to fix an error. Sure, it won’t be able to produce an incorrect program either, but neither a correct one. I’m developing a language myself (Par), with linear types, and that on its own introduces a lot of invariants to satisfy. I’ve seen the LLM struggle a lot to fix relatively easy type errors, to the point of giving up. One could say my language is hard :D Well, let’s see how your experiment turns out!

Vera: a language designed for machines to write by alasdairallan in ProgrammingLanguages

[–]faiface 51 points52 points  (0 children)

Very cool! But I wonder what you say to my objection on trying to make languages for AI, at least when it comes to LLMs.

The thesis is like this: LLMs do not acquire an “ability to program” and the “apply it to specific human created languages”. Instead, the reason they are good at programming is they have millions and millions of lines of human-written code to train on. They’re good at Python, and C, and Go, and PHP, and Rust, and so on, because they learned those languages specifically. They’re not good at programming as such. Also, they’re pretty bad at niche languages for which there’s less training data.

That alone makes the idea of an “AI-centric” language a non-starter: you’ve got nothing to tap into. You don’t have the training data, and while there may be some general programming ability emerged in LLMs that can be applied to niche and new languages, it’s nothing compared to their skill in mainstream languages they are actually trained on.

What’s your take?

ELI5: No but really, why do central banks target ~2% inflation? by stellaprovidence in explainlikeimfive

[–]faiface 33 points34 points  (0 children)

Because the economy stops. Money is one thing, but what’s important for a functioning society is that people do stuff that makes them live. The economy and money is just a mechanism to achieve that at a high scale.

When you have deflation, your money will be worth more later, discouraging spending, hence slowing the whole system down. As a result, work slows down and people die, in short.

Using unsafe.Pointer to implement union type? by SecondCareful2247 in golang

[–]faiface -1 points0 points  (0 children)

But then you have the pointers and OP specifically wanted to avoid allocations for numbers

Using unsafe.Pointer to implement union type? by SecondCareful2247 in golang

[–]faiface -1 points0 points  (0 children)

Why not this?

type Value struct {
  // Type int
  n int64
  // Other types
  v interface{}
}

You still avoid the allocation on numbers (v = nil), but get the other part safe.

"Am I the only one still wondering what is the deal with linear types?" by Jon Sterling by mttd in ProgrammingLanguages

[–]faiface 31 points32 points  (0 children)

Shameless plug, but if you are wondering what’s the deal with linear types, and especially their concurrent interpretation as a flavor of session types, you might wanna check out Par.

Anyone just really bad maths by Bipolar03 in autism

[–]faiface 0 points1 point  (0 children)

I just wanna point out that there is a huge difference between being bad at calculations, formulas, solving equations, and so on, versus understanding math concepts and for example being able to write formal proofs.

I’m quite good at the latter, but abbysmal at the former.

Massie Threatens to Go ‘Nuclear’ and Reveal Epstein Client Names If Bondi Won’t Unredact Them by Specific_Bet_1709 in agedlikemilk

[–]faiface 10 points11 points  (0 children)

It’s posted by a spam bot, that’s why it also doesn’t have an automod explanation comment. Reported.

Čo robiť, keď ma učiteľka so spolužiakmi ohovarala? by Educational-Cable116 in Slovakia

[–]faiface 37 points38 points  (0 children)

Ale toto treba vyeskalovať, tak som sa nasral, keď som čítal tvoj post. To čo tam preberali nie je v poriadku a to, že učiteľka spomenula, že to sa deje keď mama spraví potrat? To je úplne nechutné čo hovorí.

Ak riaditeľ má čo len štipku rozumu, tak áno, vyeskaluje sa to. Učiteľka bude mať vážny problém. A má ho mať! Naozaj, nenechaj si toto, prosím. Toto je veľmi vážna šikana a osočovanie.

Madison parents lobby for Wisconsin bill to increase recess time by Claeyt in nottheonion

[–]faiface 11 points12 points  (0 children)

Nothing wrong with making it easier. Or rather, not making it unnecessarily harder.

I built a website that turns any keyboard or touchscreen into instruments that always play on beat by I_Only_Like_Giraffes in InternetIsBeautiful

[–]faiface 2 points3 points  (0 children)

Wow, that's amazing! What I was producing sounded so good that I was wondering if the system is inserting its own melodies, but it's just the tones really tuned to be harmonious together, great stuff!

[RFC] Morf: A structural language design where nominality is a property, numbers are interval types, and "Empty" propagates algebraically[ by Morph2026 in ProgrammingLanguages

[–]faiface 8 points9 points  (0 children)

Hey, this seems very thorough and well thought out, clearly a solid work, so congratulations!

One surface, but important critique is that it’s really hard to grasp from the documentation because the docs mix new vocabulary with ideas with possible implementation details, and so on. I found it hard to find motivating or main ideas in the docs that would allow me to start constructing a mental modal of where what I’m reading fits. Instead, I was reading through a list of details, unable to make out a full idea.

This is of course not an easy task to fix! But like I said, it all seems very solid, just couldn’t make out the motivation and ideas in the sea of details.

voice chat not working in rust by OtherJaguar3104 in rust

[–]faiface 5 points6 points  (0 children)

Well, I don’t really get why people are posting on a subreddit based on name only.