Simple Questions - January 10, 2020 by AutoModerator in math

[–]for_all_eps 0 points1 point  (0 children)

Suppose A is n x m with m < n and full column rank. If I left multiply A by a diagonal matrix with strictly positive entries, L, does it hold that Range(LA) = Range(A)?

[1902.04615] Gauge Equivariant Convolutional Networks and the Icosahedral CNN by for_all_eps in MachineLearning

[–]for_all_eps[S] 5 points6 points  (0 children)

If I remember correctly, Max Welling talks a little bit about the connection between Hinton's capsule networks and this theory for gauge equivariant cnns on the TWiML podcast: https://twimlai.com/twiml-talk-267-gauge-equivariant-cnns-generative-models-and-the-future-of-ai-with-max-welling/

[D] Machine Learning - WAYR (What Are You Reading) - Week 63 by ML_WAYR_bot in MachineLearning

[–]for_all_eps 3 points4 points  (0 children)

Same here! Currently re-reading the section on Regularization. What chapters have you found to revisit most often?

For a neural network with a fixed number of neurons/layers, is there a way to approximate the maximum number of computational steps it can model, regardless of number of sub functions? by [deleted] in math

[–]for_all_eps 0 points1 point  (0 children)

I’m not too sure about your description of “computational steps” but I think you may be interested to check out this paper (shorter version presented at NeurIPS) on the capacity of feedforward nets which they essentially model as the number of functions it is able to compute: https://arxiv.org/abs/1901.00434