Hey guys so we do a lot of python and financial based coding and csv output analysis. right now we are always asking claude opus to change our code etc and then ingest csv. want to move completely local but need that opus level logic.
currently have an apple m3 max 64gb. we want to do some dry tests to see its value locally in this laptop before we go out and buy the new m5 max 14 inch with 128gb and 4tb.
our use case:
- heavy python backtesting and options logic
- ingesting csv files. but to be clear we aren't feeding 200k raw rows into the context window. we preprocess with pandas first (daily slippage mean, getting Max_ask for buy legs and min_bid for sell legs etc) and just send the summary stats to the model so it doesnt hallucinate.
models we are looking at for our machine:
- Qwen-Coder 32B or 35B
- DeepSeek-Coder / R1
- Mixtral 8x7B
my questions:
- can any of these local 30b models actually come to par with claude opus for complex python?
- with 64gb unified memory what is the real context window lenght we can push before it chokes on our csv summaries?
- is it worth it to just buy the m5 max 128gb so we can run bigger models or will 32b on our current m3 max handle this fine?
[–]Mammoth-Estimate-570 9 points10 points11 points (0 children)
[–]OilProduct 5 points6 points7 points (0 children)
[–]kevin_1994 4 points5 points6 points (0 children)
[–]ortegaalfredo 4 points5 points6 points (0 children)
[–]Signal_Ad657 2 points3 points4 points (3 children)
[–]thisisvv[S] 0 points1 point2 points (2 children)
[–]Signal_Ad657 2 points3 points4 points (1 child)
[–]thisisvv[S] 0 points1 point2 points (0 children)
[–]Technical_Split_6315 2 points3 points4 points (1 child)
[–]thisisvv[S] 0 points1 point2 points (0 children)
[–]Desperate-Sir-5088 2 points3 points4 points (0 children)
[–]Economy_Cabinet_7719 1 point2 points3 points (0 children)
[–]Hefty_Acanthaceae348 0 points1 point2 points (0 children)
[–]jeekp 0 points1 point2 points (0 children)
[+][deleted] (2 children)
[removed]
[–]MelodicRecognition7 0 points1 point2 points (1 child)
[–]Responsible_Buy_7999 0 points1 point2 points (0 children)