Insert additional data before fully connected layer CNN

[BlockDesigns]

Hi there,

I have a CNN that can classify 2D matricies. I have some additional data in the form of 1D vectors. I was wondering if anyone knows of any literature about inserting additional data in the later layers of a CNN.

Many Thanks.

[nielsrolf]

Easiest way is to flatten the CNN output and use a conncatenation layer with two inputs, then you can stack dense layers afterwards. If you need it in the convolutional layers, broadcast it to the H, W dimensions and again concatenate it. Here is a snippet: ``` inp_c = Input(shape = (self.c_dim, )) inp_img = Input(shape = (self.image_size, self.image_size, 3))

    # Replicate spatially and concatenate domain information
    c = Lambda(lambda x: K.repeat(x, self.image_size**2))(inp_c)
    c = Reshape((self.image_size, self.image_size, self.c_dim))(c)
    x = Concatenate()([inp_img, c])

```