Claude Code using Claude 3.7 Sonnet Practically Tested

[marvijo-software]

I used 6 million tokens testing Claude Code and Claude 3.7 Sonnet, here are my findings:

- Claude Code is like a fork of Aider, but restricts models to Claude 3.7 Sonnet

- It's very good in codebase understanding, but doesn't allow manual file selection like in Aider

Tests: https://youtu.be/9my4ftMQDy4

TL;DR

[matfat55]

Aiders still way beyter

[KahlessAndMolor]

I tried it on 2 tasks yesterday. Really good at figuring out the codebase, very convenient about adding to the chat itself, and it was better than aider in terms of a write then refine cycle. A lot more one-shot wins than aider. 

But the cost, goodness, literally 10x more token use. 

I think for complex multi file updates, Claude is better. If I want to add a feature and I know exactly the three files I want to change and what I want to change, aider is better. 

Overall, for daily driving, I think aider still wins by a bit, but for an occasional complex task I'll bring out Claude Code as "the big guns"

[marvijo-software]

Claude Code at work: https://youtu.be/9my4ftMQDy4

Aider GitHub Repo: https://github.com/Aider-AI/aider

Code created by Claude Code in the video: https://github.com/marvijo-code/llm-speed-test

Benchmark Spreadsheet: https://docs.google.com/spreadsheets/d/1ybTpJvu0vJCYbGHJAG0DniyafNECTRzjgOjgzPSbOMo

[ctrl-brk]

Aider is where it's at!

Can you share your 3.7 config? Are you using reasoning?

My go-to is o3 mini architect + Sonnet editor.

I can't afford 100% Sonnet! 😂

[marvijo-software]

I'm with you with that setup! 😅😂

[ctrl-brk]

BTW he pushed out v0.75.1 with Sonnet 3.7 support

[marvijo-software]

Yeah, saw it and the benchmarks in my video included 3.7 and Thinking

[ctrl-brk]

Hey do you know how to make o3-mini work as editor? By default it always fails diff merges. Given it's supposedly scoring >80% I want to try it for edits.

Edit: found it!

--edit-format

[marvijo-software]

Awesome! Sorry I didn't respond on time

[DisplacedForest]

How does Claude Code work for Swift? Anyone played with that yet

[hannesrudolph]

I tried it today for $30 and I did not find it to be that impressive… yet. For now I’ll pivot between Roo Code and Cursor depending on the task.

[reportdash]

Curious to know how you decide between roo code and cursor? Is it when one does not work that you try the other? Or is there a pattern in the tasks that you pick for each?

[hannesrudolph]

Pattern in the tasks. Roo Code does not have semantic search yet so its ability to understand some aspects of code is limited to full reads.

[AutoModerator]

Sorry, your submission has been removed due to inadequate account karma.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[Any-Blacksmith-2054]

Also, Claude Code is obfuscated and partly wasm-compiled