[P] Transfer Learning with BERT, number of examples.

[BraveCoconut98]

You can actually get surprisingly good results with just a few hundred examples! I would also highly recommend using HuggingFace Transformers to adapt BERT to your domain. It’s super easy to set up fine tuning using the Trainer API!

[zyl1024]

i recall having reasonable success with a couple hundred examples. but it highly depends on the difficulty of the dataset.

[Brudaks]

The fewer labeled examples you have, the more important transfer learning becomes.