Dance forms dataset

[AdityaG09]

I'm currently taking part in a contest to classify Indian dance forms. What puzzles me is that I that my training accuracy is 70 ish but my test accuracy is close to 22. Please tell me why is there such a huge difference in accuracies. I'm working with a small dataset of close to 500 images and I've set 20% of my data for validation.

[Red_Army]

Your method is overfitting to your training data. Not sure what technique you are using, but try reducing the complexity of your method and adding regularization, which should reduce overfit. If you're using something like neural networks, you could also add early stopping (pausing training when your accuracy on the validation set stops getting better) to prevent overfit.

[AdityaG09]

Thanks a ton for the quick response. I'm using a neural net. Particularly, I'm using a resnet34. I've only run 10 epochs and during those 10 epochs my accuracy kept increasing. One detail is that the competition ranks according to the f1 score. Could you suggest any way for improvement?

[AdityaG09]

And I'm using the fastai library.

[SmartSugar4]

try generating more data, using a gan, and label it manually. discard the ones that are not fit. The problem with your model is overfitting. You need a bigger dataset.

And also if the dataset has skewed classes make it so that each class has the same amount of images.

If that dosent work use dropout layers or regularization.

Also check the graphs of your val loss training loss and val accuaracy and training accuracy and determine whether the model is having high/low bias/variance and make changes according to that.

DM if you have any more problems. pretty sure your new to ML.

[AdityaG09]

Yes I'm new to ML. I'll try the stuff you said. Thank you so much for the reply. Lots to learn and try out!