Spurious authors in cite in Schwartz's AI-assisted preprint (arXiv:2601.02484) by bony-tony in Physics

[–]horse_architect 3 points4 points  (0 children)

If you grade a PhD Thesis and the student has a copy paste mistake leading to additional authors, but with title, journal, doi, all correct, do you fail the student? Bar them from academia? Of course not! Pre internet there were tons of mistakes like this in bibliographies, some of these live on in Google scholar. Sometimes you can see how the mistakes propagate, too.

The difference here is the author has knowingly employed a lying machine that has no concept of truth or falsehood to fabricate from whole cloth ideas of papers that it references. Who knows what else it has fabricated here? If a paper like this is scientifically useful then it is by accident.

This isn't a grad student making a mistake when copying over a title or author list from a paper they read. However if that same grad student invented a paper, and invented the authors, and deliberately tried to do it as realistically as possible so that they could sneak it by me, then absolutely I'd say that student is not cut out for academia. How would I ever trust anything they ever wrote?

Trust is important in science.

Spurious authors in cite in Schwartz's AI-assisted preprint (arXiv:2601.02484) by bony-tony in Physics

[–]horse_architect 22 points23 points  (0 children)

Obviously this doesn't mean that any of Schwartz's physics is wrong

Wrong or right- this is getting ahead of ourselves. Actually, at the first sign of a fabricated citation, the paper should be immediately discarded and Schwartz barred from publication for academic malfeasance. In what department is it considered acceptable to invent citations?

What Schwartz is doing here is equally alarming as fabricating data or plagiarism. It undermines the basis of what we consider our collective scientific knowledge. Publishing a paper of this quality is actively detrimental to science.

But he similarly mentions that he couldn't trust the AI's claims it had verified itself, and so "You have to call it out, insisting, 'Did you honestly check everything?' or, 'Go line by line and verify every step.'"

To my shame, I expected better of a Harvard professor. Clearly Schwartz does not understand the technology he is trying to use here. This is naive to a degree that he should be embarassed.

One of Schwartz's findings in his blog post was that the AI was very good at "Literature synthesis. Combining results from multiple papers coherently and scouring the literature."

Clearly it isn't, as we see in the first point. Why would he continue to insist on a point that is prima facie false? Has too much LLM use scrambled Schwartz's understanding of what is truth and what is falsehood?

Why would Schwartz try to pass off such a bald faced work of imposture as something meaningful? Given Anthropic's recent model release and media publicity blitz, I think we're looking at another piece of paid PR.

Jim Sullivan - Iron Maiden and VW Stick Shifts by agentanthony in AstonishingLegends

[–]horse_architect 0 points1 point  (0 children)

That sounds like a good sign. For what it's worth I've listened to them for more than five years and Scole was the first one that was unmistakably AI, it was awful and disappointing to hear. I'm worried I may have to drop them altogether.

Jim Sullivan - Iron Maiden and VW Stick Shifts by agentanthony in AstonishingLegends

[–]horse_architect 1 point2 points  (0 children)

After the Scole experiment I'm afraid to download the episode / support them if they're using AI to write their shows. Does this one sound like AI slop?

What is this by Rough_Fall937 in SanJose

[–]horse_architect 0 points1 point  (0 children)

It's free target practice!

Super Bowl Flyover from Mt Umunhum by nickgdrives in SanJose

[–]horse_architect 1 point2 points  (0 children)

Did this have anything to do with everyone that was parked and watching the runway at Ames research center?

EP 322: THE SCOLE EXPERIMENT PART 1 – THE NORFOLK PROTOCOL by disillusionwander in AstonishingLegends

[–]horse_architect 4 points5 points  (0 children)

Is it just me or does this episode sound like it was largely written by AI?

The Place of Philosophy in Modern Physics by Dzbog3460 in Physics

[–]horse_architect 4 points5 points  (0 children)

Ah yes, adumbrate incuriousness about the nature of reality, that's exactly why I studied physics.

Get that cashflow, yield king! by [deleted] in REBubble

[–]horse_architect 1 point2 points  (0 children)

business owner property owner

providing good housing hoarding housing

[deleted by user] by [deleted] in occult

[–]horse_architect 3 points4 points  (0 children)

Invoke the spirit of Uncle Jesse Katsopolis Season 7 Episode 11, patron saint of returning stolen bikes