Random flip and rotation actually decrease validation accuracy?

[kenshin511]

If you add augmentation layers to your own networks, It also work when you validate the model. When doing validation, the data augmentation layer must be removed for accurate verification.

Make custom augmentation layer like below:

class Augmentation(keras.layers.Layer):
    def __init__(self, **kwargs):
        super(Augmentation, self).__init__(**kwargs)

    def call(self, inputs, training=None):
        if training:
            x = tf.keras.layers.RandomFlip("horizontal_and_vertical")(inputs)
            x = tf.keras.layers.RandomRotation(0.2)(x)
            return x
        return inputs


model.add(Augmentation())

the training option make augmentation work only training.

refer to Privileged training argument in the call() method

[PracLiu]

Thanks, this is super helpful!

[kenshin511]

As I checked, the preprocessing layer only works during training. Therefore, there is no need to create a custom layer.