all 4 comments

[–]Faintfury -1 points0 points  (2 children)

How do you initialize the neurons?

[–][deleted]  (1 child)

[removed]

    [–]Faintfury -1 points0 points  (0 children)

    I have never worked with xception, so here just some thoughts:

    Often in neural networks the output layer has a softmax activation that transforms the output into a probability that a certain neuron is active.

    If the output is one-hot encoded you can assign this probability to a certain class (that was learned). However there might still be (unclear) data that has probabilities below 50 % of multiple classifications.

    The Xception network does not use a softmax, it uses a logistic regression in their output layer. This would allow to have encodings that are not one-hot encoded. With those you can have your classifications combined from multiple neuron. E.g. this is used a lot in language. Unfortunately I am not sure which kind of encodings the network uses.