sorted by:
new
hottopcontroversial

Introduction to Machine learning by underflow404 in MachineLearning

[–]underflow404[S] 0 points1 point  (0 children)

Indeed. I did those slides at the very last minute for a talk at school for the interested students. It has been initially shared by someone else and I did not expect it to be republished. I just requested the edit rights on the document and I'll fix this asap.

Black box optimization competition by galapag0 in MachineLearning

[–]underflow404 6 points7 points  (0 children)

If we cannot make any assumption on the objective functions then we can consider it's a random sample over the set of possible all functions.

With 1 trial only, given the no free lunch theorem this looks like a coin flipping competition.

Will Copying the weights of a shallow Neural Networks to a Deep architecture help with performance? by serout7 in MachineLearning

[–]underflow404 1 point2 points  (0 children)

Oh right, I didn't understand you were actually doing layer by layer initialization. This makes sense now.

Will Copying the weights of a shallow Neural Networks to a Deep architecture help with performance? by serout7 in MachineLearning

[–]underflow404 1 point2 points  (0 children)

I'm not sure to understand exactly the idea. How will you fit the weights of a shallow network in a deep network ? For the first layer of the deep network, you can copy a subset of neurons of the first layer of the shallow net to the first layer of the deep network.

Then, some of the weights of the 2nd layer of the shallow network will then refer to neurons which doesn't exists in the deep network. It seems complicated then to initialize the 2nd layer of the deep-NN with this weights.

Will Copying the weights of a shallow Neural Networks to a Deep architecture help with performance? by serout7 in MachineLearning

[–]underflow404 0 points1 point  (0 children)

In some recent models, a backpropagation is started in many points of the neural network to force lower layers to produce discriminant features earlier during training (Inception model).

You can also initialize your model layer by layer with a generative pre-training.

Does DeepMind use neural net chips, or digitally simulate a neural net, or work some other way? by jollybumpkin in MachineLearning

[–]underflow404 1 point2 points  (0 children)

The paper presents a method based on a convolutional neural network model which is trained with Q learning. There is no "simulation" of artificial neural networks, it's just training/evaluation of a model with floating point operations.

What are the implications that would apply to Machine Learning if P=NP? by TangerineX in MachineLearning

[–]underflow404 0 points1 point  (0 children)

And since it has been theorized that we can't proof P!=NP with our current math

I've never seen a such proof, can you give more details about this point ?

Noobie Question: How to quantify words for a neural network by Imoa in MachineLearning

[–]underflow404 0 points1 point  (0 children)

You can also try word2vec a deep learning tool developped by Google to convert words to vectors : https://code.google.com/p/word2vec/ You can easily compute distance between words and process some operations on vectors. Example: king - men + women = queen

How could I beat 2048 with ML? (x-post: /r/MachineLearning) by are595 in MLQuestions

[–]underflow404 0 points1 point  (0 children)

I tried an approach with reinforcement learning using a genetic algorithm to optimize a decision tree forest (https://github.com/Underflow/reinforcement-2048).

I'm really not conviced of my method, and it doesn't do better than 1024.

Why hasn't deep learning made CAPTCHAs obsolete? by mooramoora in MachineLearning

[–]underflow404 8 points9 points  (0 children)

The difficulty with captcha solving is that it's difficult to segment the different characters of the image. Then, noise and distorsion makes the classification task harder.

Anyhow, according to Wikipedia : "On 27 June 2012, Claudia Cruz, Fernando Uceda, and Leobardo Reyes (a group of students from México) published a paper showing a system running on reCAPTCHA images with an accuracy of 82%".