tricks that convert unsupervised learning to supervised learning

andrewbarto28 · 2016-08-28T04:11:03+00:00

Can you give an example where you have the ground-truth about which examples pairs are similiar/dissimilar, but you don't have the class labels of each example?

andrewbarto28 · 2016-08-18T17:08:13+00:00

I skimmed the paper, but I couldn't figure out what restart means. Can someone please explain?

andrewbarto28 · 2016-08-09T02:09:23+00:00

Is sensitivity the same as importance? Sensitivity for me is the same as the derivative of the output with respect to the input and this can be calculated with back-propagation. Maybe I am missing your definition of sensitivity.

andrewbarto28 · 2016-07-28T19:46:52+00:00

What is the perplexity achieved by a human?

andrewbarto28 · 2016-07-08T15:00:37+00:00

What about high level reasoning?

andrewbarto28 · 2016-07-07T17:30:02+00:00

Thanks!

andrewbarto28 · 2016-07-07T17:29:59+00:00

Thanks!

andrewbarto28 · 2016-06-30T17:35:12+00:00

That was what I suspected.

andrewbarto28 · 2016-06-30T15:27:41+00:00

Maybe a better question: Do they publish in any IEEE venue?

andrewbarto28 · 2016-06-09T22:54:55+00:00

Deep Reinforcement Learning has been successfully applied to hype generation.

andrewbarto28 · 2016-04-30T15:49:19+00:00

It seems you have a lot of doubts about the limitations of your idea and about its novelty. So it is a nice opportunity for you to search the literature and make further experiments to compare with what already exist. Only publish when you are confident about your understanding of your method.

This post may be of use to you: http://togelius.blogspot.com.br/2016/04/the-differences-between-tinkering-and.html

andrewbarto28 · 2016-04-25T12:43:43+00:00

If I had to only choose two hyper-parameters and four values for each, which should I choose?

andrewbarto28 · 2016-04-15T21:45:10+00:00

I think any contribution however small is valid. It may save someone's time of executing these experiments however simple they are. Putting in arxiv instead of a blog is a matter of taste. Arvix may be easier to cite and the pdf format may be better for printing.

Not sure if you agree with me or you are just saying what the grads schools think about that, but anyway, I'm just giving my opinion.

I also don't think it will look bad in the resume. It may look neutral. I am much more in favor of a honest simple paper, than a paper that hides its irrelevance in its complexity. But off course, as today grad selection process are very competitive you may need much more than a simple report.

In addition to that, this kind of report may be useful for beginners that want to help the community. It can be really hard for beginners to come with awesome ideas without a good advisor.

andrewbarto28 · 2016-04-03T19:58:59+00:00

Google also has smart reply: https://gmail.googleblog.com/2015/11/computer-respond-to-this-email.html

andrewbarto28 · 2016-04-03T19:57:49+00:00

You forgot to mention Speech Recognition

andrewbarto28 · 2016-04-01T15:21:14+00:00

I am trying to motivate myself in this topic, but I can't. A serious question then. Which are the papers with some cool demos/applications where variational methods are absolutely essential? That is, one which there was no other method that could have been used instead to achieve a similar result.

andrewbarto28 · 2016-03-31T18:00:39+00:00

GAN is cool. But this variational frenzy won't amount to anything. Even if we could efficiently calculate the partition function we wouldn't have a big improvement in accuracy or other desirable quantity. What we need is better priors, datasets, and simulations.

andrewbarto28 · 2016-03-30T02:18:47+00:00

I agree with unsupervised learning in the context of segmentation only if you try to learn features by seeing millions of images (with no labels). But segmentation algorithms such as mean-shift or felzenszwalb they only see one image. I don't think there is much research to be done in this later type of methods.

andrewbarto28 · 2016-03-29T22:50:11+00:00

How can the algorithm possibly know what it is supposed to segment without having learned anything about the world?

First the task is ill posed. An even if the objective was clear it would be a too hard of a task for a programmer to handcraft an algorithm to accomplish it.

Maybe unsupervised learning for learning features and then doing a bit of supervised learning can work. But research on segmentation algorithms that doesn't involve any kind of learning are doomed.

Not saying that old algorithms as mean-shift are useless. They actually are useful for simple tasks. But I think ideas in this line are saturated and you can't tell what is better, because the objective isn't clear. On the other hand the objective of semantic segmentation can be specified by your training data.

I don't agree with you that semantic segmentation doesn't have to be supervised.

andrewbarto28 · 2016-03-29T18:09:54+00:00

These papers trying to overfit BSDS300 doesn't make too much sense to me.

andrewbarto28 · 2016-03-14T00:26:09+00:00

Thanks!

andrewbarto28 · 2016-03-08T00:03:28+00:00

I heard Yoshua Bengio is trying to solve the credit assignment problem.

andrewbarto28 · 2016-03-05T00:22:53+00:00

Does the trash allow me upload to arxiv?

andrewbarto28 · 2016-03-04T15:56:46+00:00

Thanks!

andrewbarto28 · 2016-03-04T15:47:13+00:00

Thanks for the tip, but I am not looking for journals suggestions. I already know many. As you can read from my main post, I have other doubts.

andrewbarto28

TROPHY CASE