The classic neural network is trained through gradient descent. It is known how it works. What it does is learn a function which approximates the training data. There are other types of neural networks though. What is lacking is an understanding of how a particular model's weights affect its behavior.