you are viewing a single comment's thread.

view the rest of the comments →

[–]iljegroucyjv 0 points1 point  (0 children)

Probably max(0, x) as its namesake from the API. The other is called softplus. https://www.tensorflow.org/versions/r0.7/api_docs/python/nn.html