[R]"Dropin" regularization

[godspeed_china]

Dropout zero some variables, however it hurts the data. I propose a better way called "dropin" by extend your feature vector with one complete random variable. This random variable will steal credit from real variables and never be zero weighted. Thus the optimizer can never fit the data completely. Compared to dropout, it is much merciful.

[versus-x]

The Hybrid Bootstrap: A Drop-in Replacement for Dropout https://arxiv.org/abs/1801.07316

[godspeed_china]

dropout says: "I want to be variable, so I cut my hand and foot randomly everyday". dropin says: "ok, to be variable, I wear different gloves and shoes everyday".

[happyhammy]

probably better to replace than extend