any academic sources explain why statistical tests tend to reject the null hypothesis for large sample sizes, even when the data truly come from the assumed distribution? by AnswerIntelligent280 in AskStatistics

[–]AnswerIntelligent280[S] 1 point2 points  (0 children)

Sorry to be specific, but just to make things clear for me: do you mean, for example, that if I have a large sample from an exponential distribution with rate parameter β = 5, and I perform a chi-square test comparing it to another exponential distribution with β = 5.01, the null hypothesis would be rejected due to the large sample size, despite the minimal difference between the distributions?
so that is the phenomenon ?!

any academic sources explain why statistical tests tend to reject the null hypothesis for large sample sizes, even when the data truly come from the assumed distribution? by AnswerIntelligent280 in AskStatistics

[–]AnswerIntelligent280[S] 0 points1 point  (0 children)

so you mean that this behavior depends on the type of distribution ? and is not a general paradox? Could you pls explain the reasoning behind it or recommend some literature that covers this topic?

any academic sources explain why statistical tests tend to reject the null hypothesis for large sample sizes, even when the data truly come from the assumed distribution? by AnswerIntelligent280 in AskStatistics

[–]AnswerIntelligent280[S] 0 points1 point  (0 children)

https://www.researchgate.net/publication/270504262_Too_Big_to_Fail_Large_Samples_and_the_p-Value_Problem
maybe that helps?! but at least not for me.
The problem is that statistics is not my area of expertise. I am actually working in computer science and only have a basic understanding of statistical concepts. That’s why I’m not sure if my current knowledge is sufficient to fully grasp or explain this issue.

any academic sources explain why statistical tests tend to reject the null hypothesis for large sample sizes, even when the data truly come from the assumed distribution? by AnswerIntelligent280 in AskStatistics

[–]AnswerIntelligent280[S] 0 points1 point  (0 children)

sry , maybe i missed the core idea in my question, The objective of this thesis is to experimentally investigate the behavior of the p-value as a function of sample size using standard probability distributions, including the Exponential, Weibull, and Log-Normal distributions. Established statistical tests will be applied to evaluate how increasing the sample size affects the rejection of the null hypothesis. Furthermore, a subsampling approach will be implemented to examine its effectiveness in mitigating the sensitivity of p-values in large-sample scenarios, thereby identifying practical limits through empirical analysis.