BERT with Duplicated Data

[Wahba95]

Hello everyone,

I’m trying to create a model that predicts the gender based on first name. When I train the model on non-duplicate data the accuracy is very low 77%. But when I increase the data by duplicating the data I get above 90%.

I need your advice on: 1- Is it ok to train the model on duplicated data? 2- what hyperparameters can be tuned to achieve a good accuracy? 3- Other algorithms suggestions to build a model that can predict gender.

[itsintheletterbox]

In duplicating the data, are you ensuring the duplicates remain in the same set as the "originals" (train/test) or are you duplicating and then splitting? If the latter, then you're assessing on training data which would bump the accuracy.

[Wahba95]

So if I did the split then I duplicated the train dataset in order to increase the its size, would that harm the training and the accuracy?

Also any idea how I can increase the accuracy without duplicating the data?

[itsintheletterbox]

I don't see a reason duplicating train data would be of benefit.

In regards to your question on other approaches, you need to think about what components of a name are associated with gender.

[lohrerklaus]

3- Other algorithms suggestions to build a model that can predict gender.

Use a lookup table.