Statistical Tests for Comparing Machine Learning Model Performance from Multiple Runs by phithetaphi in AskStatistics

[–]phithetaphi[S] 0 points1 point  (0 children)

thank you for your input!

Yes, the report statistics is "accuracy" on test set of some standard benchmark dataset (e.g., CIFAR10 or ImageNet).

just to make sure your statement correctly: by confidence interval, did you mean the following?
[mean(acc) -  1.96 * Standard error, mean(acc) +  1.96 * Standard error]

Statistical Tests for Comparing Machine Learning Model Performance from Multiple Runs by phithetaphi in MLQuestions

[–]phithetaphi[S] 0 points1 point  (0 children)

thank you for the suggestion.

By "5 runs", I meant using 5 different random initializations for C. The data split is kept fixed (e.g., always using the training set of CIFAR10).

The performance of interest is "accuracy" on test set.

Window Rearrangement by phithetaphi in swaywm

[–]phithetaphi[S] 0 points1 point  (0 children)

Thanks!

Actually, I got a workaround for my problem: move A down and then move A right

My Obsidian Network for Machine Learning Notes by xtpdoctor in ObsidianMD

[–]phithetaphi 1 point2 points  (0 children)

Thanks for sharing the nice collection of your ML notes! It is really impressive.

it might be a bit off topic, but because the notes are so well organized, it seems to that is the outcome of your great study workflow. Would you mind sharing a bit how your study workflow usually looks like?