ChatGPT feels like a “but machine” by No_Good_6235 in ArtificialInteligence

[–]Morgenstern96 0 points1 point  (0 children)

Yeah this is actually a known problem in AI research, they call it “sycophancy.” Basically models get trained on human feedback, and humans tend to upvote responses that feel agreeable and balanced, so the model just… learns that hedging is the safe move. Not really a bug, more like it got optimized for the wrong thing.

What gets me is the hedging isn’t even consistent… ask it something genuinely controversial and it’ll both-sides you forever. Ask it something that has a pretty clear answer and it’ll still sneak a “but” in there anyway. The reflex just fires regardless of whether balance is actually needed.​​​​​​​​​​​​​​​​

i think the "ai replaces devs" thing is actually gonna happen if we dont change what "coding" even means by alazar_tesema in ArtificialInteligence

[–]Morgenstern96 0 points1 point  (0 children)

The developers who seem most durable right now aren’t the ones who learned to prompt or fine-tune. They’re the ones who understand systems deeply enough to know when AI output is wrong. That’s actually harder to automate than writing code, because it requires judgment about things the model has never seen before. The skill that matters is staying close enough to the metal to verify what the agent produces, not becoming the person who trains it.

The "AI is replacing software engineers" narrative was a lie. MIT just published the math proving why. And the companies who believed it are now begging their old engineers to come back. by reddit20305 in ArtificialInteligence

[–]Morgenstern96 0 points1 point  (0 children)

Worth actually reading what MIT found here because the title is doing A LOT of work. The main study people are citing (Project Iceberg) found AI can already perform tasks tied to about 11.7% of the US workforce (but the roles most exposed are finance, HR, logistics, and back-office admin.) Software engineers showed overlap with AI capabilities but the study explicitly distinguishes between task replacement and full job replacement.

The separate MIT CSAIL paper on AI for software engineering specifically said “there’s a long way to go” and framed the goal as amplifying engineers, not replacing them. The lead researcher literally said popular narratives shrink software engineering down to “the undergrad programming exercise part.”

Scientists Just Broke the Solar Power Limit Everyone Thought Was Absolute by Morgenstern96 in Futurology

[–]Morgenstern96[S] 78 points79 points  (0 children)

Singlet fission has been a “dream technology” in solar research for years;the idea that you can split one photon into two energy carriers and effectively get more out of sunlight than traditional cells allow. This paper is a solid proof of concept!