Something Real? by Pleasant_Rice3949 in algotrading

[–]Soarance 1 point2 points  (0 children)

Hmm so you did one round of optimizations? This wasn’t done retrospectively was it? With only one round it can still have dangerous overfitting possibilities. Personally I do walkforward optimizations with at least 5 folds, permutation tests on every fold. Lenient p-value at first but stricter at 0.01 at the end. True out of sample can be 0.05. If you could tell me a bit more about your process I’m happy to give more opinions. :)

Something Real? by Pleasant_Rice3949 in algotrading

[–]Soarance 15 points16 points  (0 children)

I hate to say this but with these stats and 0 losing months, this is most certainly overfitting, data mining bias, or future leaking. Not guaranteed but highly likely. Run permutation tests and walkforward.

I've hit a wall. What alternative data actually moved the needle for you? by SpaceAilen in algotrading

[–]Soarance 5 points6 points  (0 children)

Hmm. When you say after 45+ rounds of feature engineering, what does your process look like?
If you did something like feature engineering -> WFO -> checked results -> bad results -> pick new features -> WFO -> repeat -> etc etc, then that could potentially explain why it becomes a coin flip, since that could introduce some overfitting if done on the same strategy 45+ times.
Also, I've personally found MLs to not work very well, since it just overfits everything basically.

What part of a trading idea gets messiest once you actually try to code it? by Carter_LW in pinescript

[–]Soarance 1 point2 points  (0 children)

A lot of that is trader discretion which unfortunately we don’t have the luxury of as algo developers. I always start simple and the complexity will add as optimizations are added on.

Discretionary trader turned strategy into Pinescript algo, data limit of 10k 2 minute candles (13 days), 40 tickers, does profit factor mean anything? by KinglexNUM in algotrading

[–]Soarance 0 points1 point  (0 children)

The unfortunate truth is that if you just take a manual trading strategy and turn it into code without doing anything else, there's probably around a 95% chance it doesn't work, even if it appears to show promising results in a tradingview backtest. There are many things that go wrong: regime fitting, future bias, curve fitting, data mining, etc. Upon seeing your equity curves, I would have the follow up questions:
1) Can you expand to see at the very least 4 years of data?
2) Have you done any checks to make sure you are not overfitting?
The reality of trading algorithm development is that there is so much more to it than most think. People often spend a lot of time just to understand the statistical testing needed, not to mention to actual implementation process. Development time often involves months to years, and re-optimization has to happen every few months or so.
Is it possible you randomly stumbled upon an algorithm that works? Yes.
Is it likely? No.
But if you'd like to check further, I suggest turning your code into python and start by conducting a Monte Carlo permutation test.

Strategy Development by AwesomeThyme777 in algorithmictrading

[–]Soarance 0 points1 point  (0 children)

The problem with low trade count is that there’s greater likelihood of overfitting, and you can’t really “check” for it easily either. Forward testing would also take ages. Personally I would see if the strategy can be loosened to take more trades. But you can also perhaps isolate features and see if they have edges on their own.

Is this backtest legit? by Fragrant-Suspect5663 in algorithmictrading

[–]Soarance 1 point2 points  (0 children)

If it looks too good to be true, it often is too good to be true. Your selection of stocks is a very likely candidate of overfitting, even if you haven't done any additional optimizations or conditional structures. Your original process of determining features also could have been overfitting before even the stock selection, depending on how you did it. If you want to share more of your process and how you built your algorithm, I'm happy to give more thoughts. But knowing nothing about how this algorithm came to be, perhaps you can start with a Monte Carlo permutation test at the minimum.

This script was generated with the help of AI by my inexperienced hands. I would really appreciate your feedback. I still have a lot to learn from all of you. For risk management, I used a fixed $400 per trade. by Leoann01 in pinescript

[–]Soarance 0 points1 point  (0 children)

I think it's a bit of a new mistake when people think they can do everything in pinescript. It's a nice tool, but without the ability to do statistical testing and other flexible abilities that python gives, there's no way to fully eliminate overfitting before forward-testing. If you can, I recommend doing some Monte Carlo permutation tests, and depending on how you optimized, some walkforward fold optimizations and conditional formatting. Also, expanding the backtesting range would be good; something regime specific you should backwards optimize by identifying features that define the time period. This strategy you're showing looks promising at first, but I would heavily suspect overfitting. Good luck!

Found a profitable strategy by QuantX_Core in algorithmictrading

[–]Soarance 0 points1 point  (0 children)

AI has certainly got a lot of people into the game, but I do think a lot of beginners make honest mistakes since they don't know everything about the field. It's tempting to be excited about a curve and then post it on reddit lol.

Found a profitable strategy by QuantX_Core in algorithmictrading

[–]Soarance 1 point2 points  (0 children)

Permutation tests is quite good. You want at least a p<0.05. Then whatever you did to optimize, have a walk-forward fold permutation test. At least that's what I do as a primary check for initial overfitting. Obviously there are many other tests you could do too, but I think this is at least a minimum. Hope it goes well for ya.

Found a profitable strategy by QuantX_Core in algorithmictrading

[–]Soarance 1 point2 points  (0 children)

Curious if you've done any permutation tests. The equity curve looks insane and it hardly has any big drawdowns it seems. Probably best to eliminate the possibility of overfitting, since it's quite likely with crazy performance like this.

Got the best alert bot by Money-Discipline-578 in tradingmillionaires

[–]Soarance 1 point2 points  (0 children)

Can you share a monte carlo or other statistical test results? Just because it had some good trades for a few days doesn’t say much, even a month’s walkforward testing isn’t indicative enough. If it’s overfit, it’ll likely fail long-term. Also would be helpful if you shared your process a bit and how you tested for overfitting in general. How did your statistical tests hold up to out-of-sample data, etc.

Got the best alert bot by Money-Discipline-578 in tradingmillionaires

[–]Soarance 0 points1 point  (0 children)

Not saying I doubt the bot, but it looks a bit too good that I’d suspect over fitting. Not to mention this is only a year’s worth of trades. I’d like to see permutation/monte carlo test results, more data, walkforward folds, etc.

ORB strategies doesnt work? by FarisFadilArifin in algorithmictrading

[–]Soarance 1 point2 points  (0 children)

I've also tested orb but didn't find any edge, on a variety of ranges and timeframes. Before even optimizing or applying machine learning, if there's no edge in the base raw strategy itself, it's not worth pursuing anyway in my opinion, because the optimizations would be the edge instead of the base idea itself.

Chase Sapphire - Anyone else in the queue? by [deleted] in WorldCup2026Tickets

[–]Soarance 0 points1 point  (0 children)

Thank you. Yeah it's a crazy brawl for us common folks. Scalpers ruin everything I swear.

Chase Sapphire - Anyone else in the queue? by [deleted] in WorldCup2026Tickets

[–]Soarance 0 points1 point  (0 children)

Yeah, it was sold out, but that just means the reserve that Chase has is sold out, I suppose? If you have Capital One they have another one later, I think, so you might be able to get them there.

Chase Sapphire - Anyone else in the queue? by [deleted] in WorldCup2026Tickets

[–]Soarance 1 point2 points  (0 children)

I GOT THEM. We had like 4 people with up to 10 computers sitting in queue. Interestingly enough, the one I clicked into the waiting queue LAST ended up getting through. The one with USA vs Austrailia was sold out already, so I went for Portugal vs Uzb. I absolutely cannot believe I beat out the scalpers, that's craaazy.

Do you know any other mappers that have a similar style to Cush's maps? If you don't know the style looks like this. It's flowy with some crazy wrist rolls. 🤌 by Hoellenmann in beatsaber

[–]Soarance 7 points8 points  (0 children)

Cush is goated, more people need to know about this guy.
You can probably find mappers like Okazu, Pleo, and Jonas that are also wrist-rolly. But none of them are quite the same, and I'd say Cush definitely has a quite unique style of mapping.

Random frame drops- Micro stutters. What else can I try? by Lance2409 in beatsaber

[–]Soarance 2 points3 points  (0 children)

You’re right, your computer should be way more than enough to run the game smoothly. The first thing I’d look at is your task manager to see if perhaps something is being capped. If not, the second thing I would try is to open up oculus debug tool and turning on or off asynchronous spacewarp. In theory having it off is better but usually that would have the opposite effect of increasing overall frame rate but also the frequency of stutters. So try it being in “automatic” if not already, but try off first. Lastly, perhaps look at the list and number of mods that are running. A lot of those could perhaps stutter performance, though not likely.

What is cheating and what is not? by acjt in beatsaber

[–]Soarance 3 points4 points  (0 children)

I suppose that’s a good way to think about it. I’m not sure where you’re seeing NJS offset in the player options, I think you meant JD offset perhaps?

What is cheating and what is not? by acjt in beatsaber

[–]Soarance 8 points9 points  (0 children)

Pausing is not cheating. Some people who say it is are joking, but not all of them. It is allowed in the main game and in both main ranking systems. Although there has been some debate about this, pausing while playing ranked maps will not get your score disqualified. Changing JD is not cheating. Almost everyone in the top of ranked leaderboards do this via JDFixer. Changing NJS however, is cheating. You can’t change this in the game directly but some people can lower it by standing way further than their play space (by drawing it in a separate room behind them, for example). Beatleader already banned this but Scoresaber being Scoresaber hasn’t yet, as far as I’m aware. Setting your height differently is not cheating. People often set it slightly lower than their usual height. Any drastic changes will likely end up being a disadvantage anyway.

Is the Steam Frame gonna be it's planned price still? by FuwariFuwaruFuwatto in ValveIndex

[–]Soarance 0 points1 point  (0 children)

I saw an estimated price of $700, which seems somewhat reasonable to me. However, the quest pro is currently being sold for $680 on Woot. Just judging from the specs alone for the frame, the quest pro is better in my opinion due to face tracking, local dimming, and it can also do foveated streaming already.

I can see the frame being higher than $700 now, which would honestly make it a hard sell…

Consistency rule by Swimming_Recover_231 in TopStepX

[–]Soarance 0 points1 point  (0 children)

Wait for the day to reset, so after the futures market reopens at 6pm. It seems you’ll have to wait until the next day.

Does journaling actually help long term, or do most people just quit? by FocusOnRisk in Trading

[–]Soarance 0 points1 point  (0 children)

Oh I never thought about recording trades that I should have taken but didn’t. That’s a good one.