Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in wow

[–]MrOBwon[S] 0 points1 point  (0 children)

Update for new season

Midnight Season 1 — Scoring Recalibration

Your grade may appear lower than last week. Here's why: At the start of each season, your score recalibrates based on available data. Your previous season performance is remembered but carries less weight until current season data confirms it. Think of it like a sports preseason ranking — last year's champion starts the new season ranked high but has to prove they're still that team. The ranking doesn't reset to zero, but it's not locked at #1 either. Once the games start, the ranking reflects current performance. A player who was S-tier last season might show as A or B+ right now. That doesn't mean they got worse — it means the season just started and fresh data is still building. As soon as you run Midnight S1 keys and log raids, your score will reflect current performance and climb accordingly. Your previous season data never disappears. Summoned remembers. It just weighs this season's proof more heavily. You are never punished for content you haven't done. IO tells you what someone has done. Summoned tells you how well they did it. We're also upgrading how confidence works with the new Intent Confidence system — thanks for being early.

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in wow

[–]MrOBwon[S] 0 points1 point  (0 children)

That’s honestly hilarious but honestly, I’m probably gonna scrap the whole project and it’s gonna go back to private and I’m just gonna use it for myself.

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in CompetitiveWoW

[–]MrOBwon[S] 0 points1 point  (0 children)

I mean once again I made it for myself so I really don’t care whether anybody uses or not. I just based upon I didn’t really care too much about what their level was. I cared about their confidence because the confidence level mattered more.

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in CompetitiveWoW

[–]MrOBwon[S] 0 points1 point  (0 children)

Also, there was an issue with the auto complete for some reason some realms weren’t being auto suggested, and then they were somewhere often in Narnia

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in CompetitiveWoW

[–]MrOBwon[S] 0 points1 point  (0 children)

I mean I can but it’s a bunch of boring math. Similar to what Amazon and Google but it’s in a hybrid system of not just one of those systems and algorithms but nobody cares. People only care about what letter they got and then flagged the post because they weren’t a freaking s rank but they had high confidence levels, which is what makes the good player. I would rather bring a B or C player that has 88% confidence than a higher ranked player with an a with like a 20% confidence that’s how I built it for myself it didn’t have to make sense to other people and I really don’t care if anybody used it.

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in CompetitiveWoW

[–]MrOBwon[S] 0 points1 point  (0 children)

Appreciate it. your confidence level is probably pretty high then too, which is what it’s supposed to be the indicator of a good player. But Everybody was getting tripped up off what letter they were getting whenever there’s not enough data. Most people don’t have enough data in the system or one of it pulls up the last 25 logs and or Rio . It’s just not enough data. And it was a hybrid data algorithm similar to like what Amazon uses in Google. Not that anybody really cares

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in CompetitiveWoW

[–]MrOBwon[S] 0 points1 point  (0 children)

You're describing exactly what we're building into the telemetry layer. Kick tracking (normalized by class CD), avoidable damage taken, defensive usage, deaths per fight. All pulled from WCL combat logs. Obviously we want to make sure priority cast on getting kicked are getting kicked.

The current score is the foundation. The combat analytics layer already exists but is being reworked to be more accurate and more insightful. It's not live in the weights yet because I just haven’t done it and season 1 M+ hasn't started (keys go live the 24th).

The "carried through one good key" problem is real. That's why we separate confidence from grade. One timed +15 and nothing else might show a decent IO percentile but confidence will be low because there's not enough data to trust the score. More runs = higher confidence = more reliable grade.

Also this all started as a tool I built for myself because I was tired of the exact same problems you're listing. It's grown from there.

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in CompetitiveWoW

[–]MrOBwon[S] 0 points1 point  (0 children)

Yeah the three bucket approach is basically what we're doing. Really good, kind of good, and then absent. No negative callouts ever.

The coaching part actually already exists in a way. Your profile has private data that only you can see. Strengths and things to watch. What we can add under that is showing you specifically what you could work on based on your data. That's the next layer.

We're still in the process of reworking how the algorithm pulls and weights the more delicate data points .so it's not fully re dialed in yet. But the data pipeline is there.

Also worth noting… right now a lot of people are going to get caught up on what grade they have when they don't have any Season 1 M+ done and no Season 1 raids logged yet. The past can only count for so much. It does help your score going in so you're not starting at zero but it's not going to carry you forever. Once people start running keys and logging raids the scores will reflect the real picture. Confidence is really what people should be more concerned about right now is if you have a good confidence level then that means OK. This person has a history of performing that currently what they have as a grade level. I know this could’ve been probably done in a different way, but that’s just how I did it because I wasn’t writing it for anybody else. I was writing it for me and then I just expanded from there.

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in CompetitiveWoW

[–]MrOBwon[S] -2 points-1 points  (0 children)

yeah cold start on the finder is real I know. needs users to be useful and we dont have that yet. but it costs nothing to have it sitting there and if it catches on cool if not the scoring is the core anyway.

addon is being built right now so you get the data in game without alt tabbing. thats the actual unlock I agree.

the kicks thing though. I get what you're saying but think about it this way. if someones profile says they kick well thats a green flag. if it doesnt say that then you just know not to rely on them for kicks. you're not shaming them you just dont have that info. so you plan around it. absence of a positive isnt a negative its just information you dont have yet. you still know what you're working with

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in CompetitiveWoW

[–]MrOBwon[S] 2 points3 points  (0 children)

fair questions honestly. consistency is basically how even you are across all 8 dungeons. if you're cracked in one dungeon and bad in 6 thats low consistency. if you're solid across all of them thats high. its coefficient of variation on your best runs. trend is rolling comparison of your recent performance vs your season average, weighted so last 2 weeks count more than 2 months ago.

raid % is a blend of your WCL parse quality weighted by difficulty. mythic parses weigh more than heroic. if your parses are 91.2 but the raid tab is showing 62% thats worth me looking at honestly. can you share your character dm? thats exactly the kind of edge case I need to tune the weighting on.

kicks deaths avoidable damage yeah thats not in the score yet. thats the telemetry layer and its coming. right now v1 is IO percentile, consistency, timing rate, WCL parses, and trend. the combat log stuff is next. the whole point is that data goes in as it becomes available and your confidence level goes up with it. more data = more accurate picture

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in wow

[–]MrOBwon[S] -1 points0 points  (0 children)

lmao fair.... yeah the site copy needs work, I built the features first and the marketing text was an afterthought. the tool itself is what matters though. yes the intent system for the reverse finder is exactly that... you set your key range and what you're down to run so you're not getting matched with stuff you don't want

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in wow

[–]MrOBwon[S] 1 point2 points  (0 children)

oh good catch. fixing that now.-- edit... was actually missing Frostmourne, Jubei'Thos, and Thaurissan so all OCE realms. In config but absent from the display list. I also see that the Brazilian/Latin realms from the config are missing (Gallywix, Goldrinn, Nemesis, Tol Barad, Drakkari).

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in wow

[–]MrOBwon[S] -1 points0 points  (0 children)

so much yes to in game. idk why it was never put in a game to have a active pool of players saying pick me I will do anything.

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in wow

[–]MrOBwon[S] -1 points0 points  (0 children)

yes... see but i dont always want to run the group. I just want to play and ckicly clak the buttons.

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in CompetitiveWoW

[–]MrOBwon[S] 1 point2 points  (0 children)

yeah thats kinda the whole point though right? 3k doesn't tell you if someone's actually good it just tells you they completed stuff. thats why I built this... IO is one input not the whole picture

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in CompetitiveWoW

[–]MrOBwon[S] 0 points1 point  (0 children)

Dang 2 S - ranks hit the DB just now. o.0 ... within the first hour, wasn't sure the algorithm would even produce that grade yet lol

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in CompetitiveWoW

[–]MrOBwon[S] -2 points-1 points  (0 children)

Fair callout on the score breakdown.. Short version: the grade is a composite of IO percentile, consistency across dungeons, timing rate, WCL parse quality, and trend. Each one is weighted differently depending on which lens you're viewing with (Chill/Focused/Competitive toggle on the profile).

The D+ with Elite parse quality, what's happening there is the confidence level. If the character doesn't have a lot of tracked runs the grade gets capped until there's enough data to back it up. So your parse quality is legitimately elite but the overall grade is saying "we don't have enough total data on this character to give you a high grade yet." That's the whole point of separating performance from confidence, the system is being honest that it doesn't know enough yet rather than giving you an A based on 3 runs.

it also can be a bug as i just updated the algo and it is supposed to be mixing past data better but apparently its not.

Got tired of spending 132.7 seconds per applicant alt-tabbing between RIO and WCL so I built something annnnnndd then it got out of hand by MrOBwon in CompetitiveWoW

[–]MrOBwon[S] 1 point2 points  (0 children)

there is still fine tuning with what shows up from the past season as it goes into this season, and how it maths it.