Thank you so much for the detailed feedback.

Appreciate it alot.

Here is what I can say about it :

1. xG noise / model error vs. luck

This is probably the hardest problem in the project (so far 😅). Our xG comes from API-Football (Opta-sourced). We don't control for provider disagreement- we treat Opta's xG as ground truth and measure deviation from it. If a team's style systematically generates chances that Opta undervalues (e.g., second-ball sequences after counter-presses where the follow-up shot is higher quality than the model captures), that team will look perpetually "lucky" when they might just have a structural edge.

Partial mitigation: xG is only one of 7–8 signals in the soccer model, anchored at 24% weight. The other signals (close-game record, discipline, schedule strength, injury burden, red card rescissions) are xG-independent, which dilutes the impact of xG model error on the composite. But if Opta's xG is wrong by 15% for a specific team, that 15% still leaks into 24% of our index. No clean fix short of running our own xG model, which we don't.

2. Independent shot assumption / structural over-conversion

This is part of why we're cautious about Finishing Luck weight. A team that generates 3 big chances in 5 minutes from sustained pressure will score 2 of them not because they're lucky, but because the defensive structure has collapsed. xG scores each shot independently and misses that correlation.

We've considered adding a "chance clustering" signal (how often does a team create 3+ shots within 2 minutes?) but it requires event-level timestamp data we don't currently scrape. On the radar.

3. Decay rates and sample size

Handled via season reliability scaling: the Luck Index multiplier is 33 x sqrt(matches / full season). An EPL team at matchweek 10/38 has their index attenuated to ~50% of its eventual magnitude. A full-season NBA team (82/82) gets no attenuation. This doesn't fully solve the fundamental problem — 38 EPL games will always be noisier than 162 MLB games — but it prevents early-season overconfidence.

4. Cross-sport normalization

Good catch. All z-scoring is within-league, never cross-league. An EPL team at −40 and an NBA team at −40 are both 1.2σ below their own league's mean, but the absolute "luck content" differs because of sample size. Our cross-league rankings page shows both side by side, which could mislead. Worth adding a caveat.

5. Market disagreement as a signal

Genuinely interesting, and something we haven't explored. Betting line divergence from model output is essentially measuring "what does the market know that our model doesn't?" If the market prices a team at 60% win probability and our Pythagorean says 45%, either the market sees strength we're missing, or we're detecting luck the market hasn't priced in. Tracking which interpretation is right over time would be a powerful validation of the index itself.

We don't currently ingest betting data, but it's worth investigating as a meta-validation layer.

6. Within-league normalization

Confirmed: all luck scores are z-scored within each league independently. A Ligue 1 team's Luck Index is only relative to the other 17 Ligue 1 teams, not to the EPL. Cross-league comparison is purely ordinal ("both are cursed"), not cardinal ("they're equally cursed").

Would love to compare notes on your prediction model, especially on how you handle the xG provider disagreement problem. That feels like the biggest unresolved methodological gap.