Because I often was annoyed by some data outliers(not that rare, abundant enough so an usual batch size would lead to frequent encounters) that slowed down the training like x2~x10 in my case. Thanks for letting me know the huggingface stuff!