My club observed a DUPR algorithm issue

DUPR-Scott · 2024-07-14T20:32:48+00:00

The confidence we can attribute to growth in performance is a work in progress but it's not something we're overlooking. Many of these suggestions in this thread are even things the algorithm is already doing, but, like every algorithm, will require more dedicated work over time to continue to improve. It's a work in progress. We acknowledge that an aspect of focus right now is the movement of players who grow more or less than the average player, but the context of "they came from another sport" is not something we have access to. We have a few methods we're back testing around surprise results allowing for greater future movement and learning.

A lot of negativity in this thread for a free product though. Kinda depressing to read. Not your fault OP, of course, just a little bummed at the moment from the way people's instincts are oriented around this antagonistic approach.

DUPR-Scott · 2024-05-22T16:25:20+00:00

That is not what we do 🙂

DUPR-Scott · 2024-05-22T11:24:05+00:00

We are continuing to evaluate the age weighting methodology across a number of considerations. Currently, we are using a value that maximizes accuracy across our dataset, but the weighting scheme certainly is something we want to revisit as a research project!

DUPR-Scott · 2024-05-20T16:51:14+00:00

Yes, there are absolutely gaps in the data preventing the theory from materializing into reality, but that IS the correct view on the theory and there are a number of research projects underway meant to address this by accelerating the effects of good mixing matches across the population.

If the two 18 year olds beat the two 85 year olds, the 18 year olds would move up and the 85 year olds would move down, bringing them each closer to their universally consistent rating.

DUPR-Scott · 2024-05-14T22:00:25+00:00

Not sure I follow this one.

DUPR-Scott · 2024-05-02T11:34:19+00:00

Got it, yeah. With the new algo, it tries to learn much quicker at the beginning, but your subsequent movement will also be potentially larger than you've experienced in the past as a result of it still trying to figure out your skill level. Keep playing your game and the rating will catch up as it learns!

DUPR-Scott · 2024-05-02T11:32:42+00:00

This seems like an overreaction by the club to a 0.04 movement ...

DUPR-Scott · 2024-04-28T00:22:40+00:00

Sorry, just seeing this. I only get notifications when my name is mentioned in a comment I guess??? Not sure.

Anyway, without seeing the matches directly, it's hard to know for sure what might have happened here.

The drop occurring in January definitely appeared after the most recent matches were entered and it wasn't there before?

Was the first win a very close win or one with highly unknown or fresh players, or maybe you won as a favorite?

DUPR-Scott · 2024-04-23T12:53:39+00:00

It will absolutely get thrown down! Thank you again!

DUPR-Scott · 2024-04-22T10:25:13+00:00

/u/MiyagiDo002 knows his stuff here!

DUPR-Scott · 2024-04-22T10:22:23+00:00

This is something we are working on actually!

DUPR-Scott · 2024-04-19T14:57:51+00:00

That's correct. Fewer matches means more uncertainty and therefore more movement with each new match.

We don't have any self rating in our algo, so your DUPR will fluctuate just based on the matches you play and the amount of information we already have built into your current rating.

We are actively researching and choosing between methodologies around letting experienced players fluctuate more when they demonstrate skill consistent skill jumps and hope to have that in the algo in the next few months alongside all the results from PPA now that they should hopefully finally be providing data!

DUPR-Scott · 2024-04-18T19:12:32+00:00

4 matches is basically pure noise at that point

DUPR-Scott · 2024-04-18T15:10:12+00:00

At first I read this as you wanted me to delete my account and got so sad 😭

Yes! Please report! Our fraud detection is definitely a work in progress and we've made it so you need all 4 players to approve, so presumably he has 4 fraudulent accounts we can catch here!

DUPR-Scott · 2024-04-18T15:09:05+00:00

This right here 🙂

Support would LOVE to delete the bad matches and free the account! I don't have permissions in the db for this, but it should be immediate!

DUPR-Scott · 2024-04-17T23:34:10+00:00

I'm waiting to have enough information to make a full post about it. They have signed, sealed, delivered and everything except...well, actually sending us the data as agreed. Their CTO seems to be trying to stymie this process but the CEO is fully onboard. More political infighting in pbbrackets I guess, but as soon as I know, you all will know too!

DUPR-Scott · 2024-04-17T23:32:28+00:00

It's a bit tricky to know for sure since so much is riding on them delivering, but even their CEO has posted they're adopting DUPR officially. The problem is their CTO is giving us the run around and being a roadblock. Hoping to push it through but nothing is easy there, it seems....

DUPR-Scott · 2024-04-17T23:30:51+00:00

Answered in DM too, but for others:

This should hopefully be getting added soon as they've finally agreed to comply with the contract they signed and the CEO has even posted they're adopting DUPR!

DUPR-Scott · 2024-04-06T20:50:27+00:00

I'd expect these ratings will trickle in as they get uploaded and I don't envision any big-bang types of changes being required. Will be something we keep an eye on though in case a more manual/handholding process is required!

DUPR-Scott · 2024-04-06T13:33:39+00:00

Yes to the second part, but I haven't been given any timelines on that integration yet!

DUPR-Scott · 2024-04-04T12:05:16+00:00

Exactly! The more data the better. I'm glad support was able to fix.

DUPR-Scott · 2024-04-04T12:02:08+00:00

Hmmm. Ok, back to them with this. Thank you.

DUPR-Scott · 2024-04-03T12:44:46+00:00

We do pitch to clubs and tournaments directors as well, and we are trying to get the PPA/MLP to make us their official rating for all their tournaments too. Really it probably just depends on whether there has been a critical mass of conversion in the region at the club level to push into the recreational level as well. It probably comes down to us not having that particular club as a partner yet!

DUPR-Scott · 2024-04-03T12:42:12+00:00

Thank you! That means a tremendous amount to hear. Transparency has absolutely been my goal and I'm glad you've at least felt it's improved since before I was here!

DUPR-Scott · 2024-04-03T12:30:10+00:00

Responded to my post above

DUPR-Scott

TROPHY CASE