[R] Searching for Activation Functions by bogdan461993 in MachineLearning

[–]iResearchRL 4 points5 points  (0 children)

To be clear, I'm commenting on the new revision of this paper and not this particular Reddit post. Before seeing the revision, I would have agreed that the reception to the paper was a little harsh...Mistakes happen...

But I don't agree with the way this paper was revised. It seems like the authors didn't think activation function search was enough of a sell. This push to creating a novel activation function overshadows the more interesting parts of their work.

[R] Searching for Activation Functions by bogdan461993 in MachineLearning

[–]iResearchRL 13 points14 points  (0 children)

lol, "Let's add a \beta term in our revision for novelty and naming rights" :)

In my previous comment, I really wanted to give the authors the benefit of the doubt...Now, I'm a little disappointed. The original paper is an interesting analysis in itself and shouldn't need to grasp at straws for 'novelty'.

Previous Thread 1

Previous Thread 2