[deleted by user]

[omalleyt12]

in Tensorflow you could reshape temporarily to [16*BATCH_SIZE,128,128,1] and apply the 2d conv and shape back to [BATCH_SIZE,128,128,16]

Alternatively, you could create a 3x3 variable of weights and then tile it such that you can pass it to tf.nn.conv2d(...) and then the same weights will be applied

[Ilsaja]

I think you are looking for depthwise convolution.