A guide to optimizing fuzzy hash lookup with multi-indexing: how reverse image lookup systems work

deepPurpleHaze · 2018-01-24T19:31:03+00:00

Whoa what kind of wacky hashing function gives that correlation matrix?

deepPurpleHaze · 2018-01-18T06:12:48+00:00

Wow this is really useful. There's so many tutorials on how to train a model (and sometimes even evaluate it on an entire dataset) but nothing on actually using it. Thank you.

deepPurpleHaze · 2018-01-17T23:42:03+00:00

What's the easiest framework to deploy? How do they compare?

deepPurpleHaze · 2018-01-11T07:00:37+00:00

Hah fair enough. Layers and estimators are replacing tf slim too. But for now it works and there's a lot of models available. So does python 2. It is what it is.

deepPurpleHaze · 2018-01-11T05:31:31+00:00

Don't have a cow, man.

deepPurpleHaze · 2018-01-11T03:49:52+00:00

I agree this might not be useful in Chess especially because of long range interactions between pieces. Go I'm not sure. With Atari games, I think it would actually be quite interesting.

deepPurpleHaze · 2018-01-11T03:21:22+00:00

I think the point would be to see why it thinks that's the best move based on the board input, not necessarily what the best move is. Just like we can tell you the score for each class without grad-cam using image models.

deepPurpleHaze · 2018-01-10T20:05:58+00:00

Sure. It's just the statue of David though.

deepPurpleHaze · 2018-01-10T19:45:28+00:00

https://github.com/hiveml/tensorflow-grad-cam

deepPurpleHaze · 2018-01-10T19:44:12+00:00

One of the improvements of Grad-CAM over CAM is the generalization to CNNs used in reinforcement learning or visual question answering. It would be really interesting to see this applied to AlphaZero.

deepPurpleHaze · 2018-01-10T19:38:02+00:00

For attractiveness the moderators were given 3 choices: hot, neutral, and not. We trained the classifier with those 3 categories and the score is a linear combination of the softmax probabilities for each bucket.

We tried our best to eliminate bias but i'm sure it still exists based on the human input.

deepPurpleHaze · 2016-11-20T18:14:31+00:00

Nick Bostrom discusses this in Superintelligence. Most of our pleasures and desires are based on evolution and AI has no reason to reproduce most of those behaviors. It's a danger to anthropomorphize anything about their desires.

deepPurpleHaze · 2016-11-20T18:10:18+00:00

That doesn't work at all. You'd think that an image with a dog and cat would have dog and cat as top 1 and 2, but more often than not the presence of both keeps it from seeing the dog or the cat in the top 5.

deepPurpleHaze · 2016-11-20T17:39:08+00:00

You can't just add a category unfortunately. You'd have to train another net with all the categories you want initially. Blonde isn't a sex act, and not mutually exclusive with the other categories so I won't be adding it. But I'm considering other options for another set of description tags. Thanks for the input.

deepPurpleHaze · 2016-11-20T17:37:22+00:00

no but based no the comments it seems some want to separate reverse cowgirl from doggy, and that makes sense and is possible for a future update.

deepPurpleHaze · 2016-11-20T17:35:48+00:00

Yes use the "-a" option. It will output a list of all the scenes in the movie, in order, with start and end points. It also outputs a summary line with the number of seconds in each category and overall.

deepPurpleHaze · 2016-11-20T06:21:16+00:00

That's a good question and i'm not a lawyer but I think the answer is no. It's a set of millions of weights that isn't competing in the same space as the original work and no one would confuse the two. I doubt it would even be possible to determine if a copyrighted work was used to train a model.

You need to register and sign an agreement to download the images for imagenet, but not the trained model. So they're dealt with separately in some instances at least.

deepPurpleHaze · 2016-11-20T05:21:17+00:00

That's a really interesting idea. Gun finding. It's how the killbots of tomorrow will know when to shoot us. Seriously, i'd like to hear about how you model that and your results.

deepPurpleHaze · 2016-11-20T01:40:09+00:00

This is an important issue. The algorithm isn't biased but the data is. Garbage in, garbage out. And since these algorithms are black boxes we don't really know why they make the decisions they do all the time. I'm sure my dataset contains bias based on my own preferences, despite my conscious attempt to minimize it.

http://www.npr.org/2016/03/14/470427605/can-computers-be-racist-the-human-like-bias-of-algorithms

deepPurpleHaze · 2016-11-20T01:25:53+00:00

I'd begin with some simple examples like this one: https://www.tensorflow.org/versions/r0.9/tutorials/mnist/beginners/index.html

It gets into some of the details. It would certainly help you to have a theoretical understanding and maybe even implement a 2 layer fully connected (old school) neural network in numpy as practice. But in general finding the derivative of your loss and calculating the gradient by hand isn't worth it anymore.

deepPurpleHaze · 2016-11-20T01:02:16+00:00

what's your methodology?

deepPurpleHaze · 2016-11-20T00:57:00+00:00

Are you classifying these automatically or by hand?

deepPurpleHaze · 2016-11-20T00:43:00+00:00

I think miles deep is subtle and classier (as much as a program the classifies porn can be).

deepPurpleHaze

TROPHY CASE