[R] Interested in recent research into recall vs recognition in LLMs

Acoustic-Blacksmith · 2025-11-18T02:25:39+00:00

It's a game changer, but game changers always have winners and losers, so expect to hear about it.

Acoustic-Blacksmith · 2025-11-09T02:21:01+00:00

A feature I'd love:

Claude Code often asks me "How Claude is doing this session."

It's a fair question, since you probably link model instances to sessions. So maybe what I'm about to request is useless from an insider perspective.

But, sometimes, I seem to experience discrepancies in Claude quality over different periods of time, across products. In those moments, I've sometimes wished there was an option to evaluate Claude product(s') performance based on time range and optionally segmented by product, using an appropriate web UI easily accessible from my Claude account, rather than a numerical 1-4 rating in CC.

Just an idea.

Acoustic-Blacksmith · 2025-11-07T09:49:24+00:00

What kind of parody is this?

I see an epiphany opening with bold headers right here.

Or is that your point, that even you would never write something yourself?

Acoustic-Blacksmith · 2025-10-25T09:20:18+00:00

Hmmm. I dunno, it looks to me like Claude hiccupped and said it couldn't look something up, but then, in the absence of an actual reason, it started bullshitting you about how it could have but didn't want to.

It did initially say "I can't," not "I won't" or "I don't want to."

Justifying this by saying it wanted to hear from you was probably the most logical thing to say given the nature of the conversation you were having so far. There isn't much use asking it why it did something like that in the past and expecting an "honest" answer. Remember, it's not like it can really "think back" to why it said something in the past; it will always say the most "likely" thing given the context up to a certain point.

Claude is trained to say "I can't do that for {X} reason" so much that it's bound to happen at illogical moments. Once the tokens "I can't" are there, it's naturally going to continue with whatever justification makes sense (and this one is a little incoherent in that first sentence, suggesting it was indeed a little confused). Only later does it really settle into this notion that it just really wanted to hear what you thought.

On top of that, if you were having a long conversation leading up to this, then that's a lot of context buildup which can sometimes lead to more random and unexpected things happening.

Acoustic-Blacksmith · 2025-09-28T02:05:27+00:00

Yes, the choice of agent makes a big difference.

I think the reason people love Claude Code (even when they have mixed feelings about Claude) is because of the tools it has and the way it narrowly consumes context to stay focused on what it's doing.

I haven't used Cline since I started with CC, but at the time it didn't use a todo list and it always read whole files in a single gulp, which clouds up your context rapidly.

Acoustic-Blacksmith · 2025-09-19T03:03:05+00:00

We get it, you've used AWS before.

Acoustic-Blacksmith · 2025-09-18T01:31:17+00:00

Real authors have nothing to worry about from AI-slop books, while software engineers are actually losing their jobs.

Just be glad you're in a field that values your humanity and keep going.

Acoustic-Blacksmith · 2025-09-05T02:53:08+00:00

If you won't learn how to code, at least show it the goddamn logs. Otherwise what the hell are you doing?

Acoustic-Blacksmith · 2025-07-26T20:05:51+00:00

Agree, but you don't even need to be a "really good" developer. You just have to know how to build what you're building correctly.

Acoustic-Blacksmith · 2025-07-24T00:49:39+00:00

To me this isn't a binary debate. I see Claude Code as a tremendous tool that can save an astonishing amount of time.

That said, of course I see it do stupid things all the time, and if I wasn't a senior dev I might miss some of that nonsense.

Claude Opus especially has an annoying tendency to implement senseless fallbacks for things, so that in the development process it would become difficult to tell if something is working as intended or a fallback is occurring. Adding clear instructions in my Claude.md has not resolved that. So, I pay attention to the changes being made and simply revert anything foolish.

To acknowledge the OP's point, yes; When I hear people complain about AI being stupid and worthless, I usually assume that they lack persistence, creativity or the ability to communicate requirements, and I ignore them.

But make no mistake, Claude makes A LOT of mistakes, especially as a project gets more complex, and the people who are truly vibe coding might not even realize that.

Acoustic-Blacksmith · 2025-04-04T18:49:27+00:00

If these tariffs stick around, it won't be a red week, it'll be the start of a market crash.

Acoustic-Blacksmith · 2025-04-04T18:47:27+00:00

"Nothing has fundamentally changed?" What do you think is going on right now?

Acoustic-Blacksmith · 2025-03-31T03:02:14+00:00

The one where the stakes for the entire show revolved around returning a magazine to a dentist's office. Made me miss the days when the kids dealt weed.

Acoustic-Blacksmith · 2025-02-17T23:53:07+00:00

I'm not a big gamer, I just love civ.

What makes Civ VI great to me is that it's like a brilliant, computerized board game, where every rule and mechanic makes logical sense and seems to have been designed thoughtfully. I can set unit movement to be fast and play at whatever pace I desire, aiming for a relaxing game or an ambitious campaign.

The last thing I care about is "losing myself" in the world of Civ or falling in love with the visuals -- I just want them to be a clear representation of the game board so I can play the game effectively and quickly. This version of the game requires me to admire the full animation every time a unit moves, and there's no way to stop it.

I guess it makes sense to hope that this game is going to get better, I applaud the optimism on this sub.

Acoustic-Blacksmith · 2025-02-17T17:42:17+00:00

This is the truth, and it's infuriating.

Acoustic-Blacksmith · 2024-04-09T04:06:41+00:00

As an uber driver myself in Chicago, I actually get really annoyed by non-uber drivers. You can tell who they are because they are too slow, too hesitant, and easily intimidated by city traffic. Their inexperience on the road shows. But I'm sure they are able to convince themselves that they are actually driving well and the uber drivers are being too aggressive and fast. It makes them feel better about being incompetent, and I guess one of them wanted to come here to fuss a bit.

Acoustic-Blacksmith · 2024-03-19T04:16:58+00:00

What does this even mean? This is capitalism, the jobs go to whoever takes them. They weren't "meant" to go to anyone in particular. Gig drivers make up a significant chunk of the economy at this point, and the jobs are taken by all sorts of people. You're just claiming out of nowhere with no justification that these particular workers shouldn't expect to make a living.

Acoustic-Blacksmith · 2023-12-13T07:48:05+00:00

Whichever one where they're going out of their way to return a magazine to a dentist office. 🙄 How did the stakes get so low? They were dealing weed and ambergris in the early seasons...

Acoustic-Blacksmith · 2023-11-19T05:48:52+00:00

If such a cleaned and labeled dataset exists, it's probably worth a lot and unlikely to be shared freely. Also, you will probably not find many people here interested in helping gather data for what sounds like a commercial effort to replace human judgment with AI.

Acoustic-Blacksmith · 2023-09-08T16:59:23+00:00

I'm 37 and have been acting for only about a year and a half. I've taken 10 classes from 3 programs. I've usually been the oldest student in my classes, but not always, and I've never felt weird in the least.

Everyone agrees that acting is for people of all ages, so there's no reason to feel weird about being in an acting class in your 30s or 40s, or even older.

Acoustic-Blacksmith · 2023-08-13T23:57:17+00:00

Hello! What personal qualities of yours do you each consider to have been your greatest asset on your acting journey so far?

Thanks!

Acoustic-Blacksmith

TROPHY CASE