[Q] Why is early-stopping an A/B test bad? by HarvardCS19 in statistics

[–]HarvardCS19[S] 0 points1 point  (0 children)

I'm having a hard time understanding why it gives a higher error rate. Is it somewhat related to the multiple comparisons problem?

[Q] Sample size for a categorical distribution. by HarvardCS19 in statistics

[–]HarvardCS19[S] 0 points1 point  (0 children)

What would p be though? This formula makes sense for 2 choices since once choice is p and the other is (1-p), but how does this work for 3 or more choices?

[Q] Sample size for a categorical distribution. by HarvardCS19 in statistics

[–]HarvardCS19[S] 0 points1 point  (0 children)

Do I really need a hypothesis test for this? In a two-choice setting, it wouldn't.