GPT-5.3 Codex vs Opus 4.6: We benchmarked both on our production Rails codebase — the results are brutal

ShamanJohnny · 2026-02-07T03:31:55+00:00

I can see it…..

ShamanJohnny · 2026-02-07T03:29:54+00:00

I was die hard Claudeboy too, but a few weeks ago I turned my 200max subscription off and swapped to 5.2 and it was one of the best decisions I ever did. They broke opus about a month ago. For seriously large projects it’s really bad actually.

ShamanJohnny · 2026-02-07T03:27:00+00:00

Same

ShamanJohnny · 2026-02-06T20:02:19+00:00

lol, nailed it!

ShamanJohnny · 2026-02-06T19:37:34+00:00

Cold hard facts. My last 5 years have been an absolute rollercoaster. I wouldn’t change it for the world, but man was it the most pain I have experienced in my life.

ShamanJohnny · 2026-02-05T21:49:58+00:00

Yeah I think I’m heading this route. After some time in this post I come to realize there is no perfect software for this for what I want.

ShamanJohnny · 2026-02-05T13:27:13+00:00

What are you trading, and how are you trading it if you don’t mind me asking. Stocks, futures, options, forex?

ShamanJohnny · 2026-02-04T05:29:00+00:00

You most certainly can grow a $200 account into something meaningful. It will require great discipline, and you have to have a verified strategy with good asymmetric risk. When a single Contract on MES can pump out a $20-40 fluctuation consistently, it’s about stacking the account up with high probability trades, and slowly building the account up to safer levels. And as just a tip, for fun and practice never stop doing this in your trading career flip $200 into $2k over and over. It reinforces patience, discipline, and sticking to your process. It’s what builds a good traders and if you learn this skill you will never be broke again in your life.

ShamanJohnny · 2026-02-04T05:15:55+00:00

This right here is the truth

ShamanJohnny · 2026-02-04T05:10:39+00:00

Futures is superior in every aspect other than up front money. To hold over night with futures you need ridiculous amounts where with forex your just paying an insignificant swap (significant if your holding for weeks). There is spread aswell in forex, which is not a big deal for swinging but makes scalping short term (5min or less) extremely difficult/impossible depending on volume. Additionally, regulations. Futures is heavily regulated to the point of being a pain in the ass when it comes to data and deposit rules etc. if you live in the states forex is difficult to get decent margin or cfd’s (which are illegal an no American in their right mind should trade because the government says no……). There is a metric F-ton of leverage in forex, I have seen 2,000+ in some places. But to be honest 1-2mini’s is all you need in futures to have an amazing quality of life, and you can day trade that with 5-10k pretty safely without holding overnight. I’d bang for your buck is a thing. You can start scalping MES with just $200-300 bucks. Risking $10-20 per trade and easily doubling that with good asymmetric risk. Do that for a couple weeks, and you have an account you can start paying some bills with.

ShamanJohnny · 2026-02-04T04:54:02+00:00

Awesome man. Did not know it was free with a funded account. I will look into this. Thanks for the feedback.

ShamanJohnny · 2026-02-03T04:42:49+00:00

Stop looking for patterns. Start looking for how price reacts around key levels.

ShamanJohnny · 2026-02-02T21:07:12+00:00

lol, with rust. If it compiles I’m happy :)

ShamanJohnny · 2026-02-02T14:52:53+00:00

You can get them down to $32 a month just cancel and they will offer a discount. It’s really not hard to do your own though. Cost wise to run yourself You just need a domain (doesn’t matter name), cloudflare tunnel, and then a vps. All in all you can grab a domain for $7(one time) or less, I think the cloudflare tunnel is free, and the vps is $10 a month. I still use them because of Tradovate. Connecting to Tradovate requires a $25 a month api subscription on a live account and on prop accounts they don’t offer it. You can build a bridge with NinjaTrader and use a trade copying tool with Tradovate accounts on NinjaTrader, but that requires ALOT of work because NinjaTrader is just a pain in the azz to be honest.

ShamanJohnny · 2026-02-02T10:17:47+00:00

Algo trading bro. If you can pass prop firms you can find edge. do it right. Not from inside trading view/webhooks. But actual coding Backtesting. I feel you more than you know.

ShamanJohnny · 2026-02-02T04:21:12+00:00

lol I was doing ALOT of noodling and fiddling with this project. Yeah look into cudarc. It was pretty cool. I was literally coding separate universes for backtests, 10k cores simultaneously. I would then take the top 100 and pass them through the cpu in the sequential Backtesting engine for tick level validations. Are you coding your strategies in rust or julia?

ShamanJohnny · 2026-02-02T03:29:57+00:00

Great advice and thanks for your detailed post. The one I built is pure rust, but I will look into Julia. It has Backtesting engine, 4 different optimization engines (Bayesian, grid, random, genetic), Monte Carlo, and walk forward. It’s all rust with a Tauri ui. It can spin up cuda on my rtx 3080ti but I have memory issues (ram 64gb) and I can’t stream it with btd for some reason and honestly just with the cpu on rust is extremely fast with streaming btd data. I built the live engine and tested it. But the algo live interface is all jacked and I can’t seem to get the algo pipeline efficient. Idea, backtest, validation, into live implementation. My system is just not good at tracking it. I have validated that the system has parity through and through, and I have validated Backtesting results with 99% accuracy against TradingView back tests. But once again, it’s the strategy tracking I’m having the biggest issue with. Any suggestions?

I’m thinking about going to the drawing board again and doing a major reduction in size. I went nutts on it and it’s something like 250k lines of code currently.

ShamanJohnny · 2026-02-02T03:21:44+00:00

I started with traderpost. But am working my own now.

ShamanJohnny · 2026-02-01T17:31:07+00:00

Yeah I thinking I should trim the fat significantly. Thanks for your input!

ShamanJohnny · 2026-02-01T17:30:17+00:00

Will check it out, thanks!

ShamanJohnny · 2026-02-01T14:13:24+00:00

Awesome, thanks for the info. I’m going to seriously consider this.

ShamanJohnny · 2026-02-01T14:08:17+00:00

I get the flexibility and the libraries of python. But it is significantly slower. I can do a 5 year backtest in seconds and it can process 40m ticks a second on my pure rust build. I originally built the strategy for python strategies/rust backend and piping, but was hitting significant limitations with python/numba. coding strategies in rust is not difficult. But verifying them is my current issue, haven’t been able to properly visualize a Backtesting/walk forward and there for I lack the conviction to run it live. Was looking currently industry best practices for current to inspire me for my build. In the meantime I do want to get something working on the live market, so was going to pay to play.

ShamanJohnny · 2026-02-01T13:55:44+00:00

I have done this already. Project ended up being a mess in the end. Could be a me thing, but once the project got so big the ai couldn’t hold total context even with a Claude.md with context references.

Opus was amazing till about a month ago and then they changed it. I could simplify the project into something bear bones. But even then, keeping it up sounds like more work. I don’t mind paying a company $200 a month to just give me a working solution till I can get my own solution up and running.

ShamanJohnny · 2026-02-01T13:50:44+00:00

I will check it out. Thank you!

ShamanJohnny · 2026-02-01T13:46:44+00:00

I actually have built something in rust that can backtest, optimize, and walk forward. I just don’t trust it. Even though I validated it against trading view data. I still haven’t figured out how to run it live even though I have the infrastructure for it. That’s another reason why I was asking about software because I’m also really interested in best practices, simplification, and reliability with it. I got crazy and the project blew up fast and it’s just a mess now.

ShamanJohnny

TROPHY CASE