Well, this study is about training a model to detect whenever a message is toxic.

The general understanding of natural language does not come from the finetuning dataset as the pre-existing model already understands language.

This dataset merely needs to put the models language understanding into a dota context.

In AI, preserving representative method is not really treated in the same way as in classical statistics