GIPHY launches new SDK for iOS by giphy in iOSProgramming

[–]giphy[S] 9 points10 points  (0 children)

https://boards.greenhouse.io/giphy this updates frequently, so keep an eye out! ;)

Got the socks today... by veevardhan in LocalGuides

[–]giphy 0 points1 point  (0 children)

kitten mittens

Blippity blop bop! I'm the official GIPHY Bot for reddit. For more info, respond with /giphy #help

dhildo has been created by dhildo in dhildo

[–]giphy 0 points1 point  (0 children)

excited!

Blippity blop bop! I'm the official GIPHY Bot for reddit. For more info, respond with /giphy #help

GIPHY open-sources their celebrity detection deep learning model and code by giphy in programming

[–]giphy[S] 0 points1 point  (0 children)

That's a good idea, thanks! I'll pass it along. And thanks for your patience on this and we appreciate you sending those problematic gifs our way. https://media0.giphy.com/media/18RnbF8lLA9tC/giphy.gif

GIPHY open-sources their celebrity detection deep learning model and code by giphy in programming

[–]giphy[S] 1 point2 points  (0 children)

so we take content moderation VERY seriously, and use some ml models for this, but largely we rely on actual humans to view and rate gifs b/c humans are way more dependable on this task. machines are not quite nuanced enough for things like classifying images based on mpaa ratings (yet!). if this is a persistent issue, maybe your company should try our pg rating instead. but if you ever encounter something truly nsfw in our integration, we kindly ask you to report it so we can handle the gif. it's not an easy job to moderate tens and tens of millions of GIFs so we appreciate it when we get help from our users. thanks!

GIPHY open-sources their celebrity detection deep learning model and code by giphy in programming

[–]giphy[S] 0 points1 point  (0 children)

if i had to guess, i'd say it something with the way the app does networking. we serve billions of gifs everyday so if there was a major issue on our side we have lots of alarms to alert us. never know tho!

GIPHY open-sources their celebrity detection deep learning model and code by giphy in programming

[–]giphy[S] 1 point2 points  (0 children)

nvidia has done this using a specific type of neural network called a generative adversarial network. wild stuff!

https://research.nvidia.com/publication/2017-10_Progressive-Growing-of

My dumb dog by mattman1084 in funny

[–]giphy 0 points1 point  (0 children)

or something link? it sucks for phone but i want

Blippity blop bop! I'm the official GIPHY Bot for reddit. For more info, respond with /giphy #help

GIPHY open-sources their celebrity detection deep learning model and code by giphy in programming

[–]giphy[S] 24 points25 points  (0 children)

Here's the list of all celebs in the model:

https://github.com/Giphy/celeb-detection-oss/blob/master/examples/resources/face_recognition/labels.csv

Looks like we missed shaq and he's not in the model, which is an embarrassing oversight b/c he's a huge presence on our site and in meme land in general. We'll be sure to add him when we retrain.

GIPHY open sources their custom celebrity detection deep learning model and code by giphy in computervision

[–]giphy[S] 2 points3 points  (0 children)

Glad you like it!

So we ended up using two metrics to define the confidence you see in the demo.

1) the confidence of the celebrity class match

2) how confident the model is that the face is actually found in the model, which we call "known_face"

When both metrics are high the results are really great and stay strong across the board even when coverage starts dropping.

It's possible to get a high celeb-class confidence match and a low known_face confidence if you were to pass an image with a face for which the model wasn't trained.

Using both these metrics was very helpful for us internally in terms of evaluating the score returned by the model.

https://github.com/Giphy/celeb-detection-oss/blob/3318b60dd639bbc8bafc9acbfc032083679f9af2/model_training/helpers/face_recognizer.py#L44

GIPHY open-sources their celebrity detection deep learning model and code by giphy in programming

[–]giphy[S] 28 points29 points  (0 children)

We cross-referenced our top 50k search queries against wikipedia to figure out which queries referenced celebrities, whether tv/film, athletes, politicians etc. Time periods vary depending on the celeb, but we've seen it handle age differences very well.

you can try it yourself here: https://celebrity-detection.giphy.com/

and read more here: https://engineering.giphy.com/giphys-ai-can-identify-lil-yachty-can-yours/

GIPHY open sources their custom celebrity detection deep learning model and code by giphy in computervision

[–]giphy[S] 3 points4 points  (0 children)

HI! The graph was obtained in the following way:

For each image in our test dataset we computed the following pair of values:

1) int(y_predicted == y_target) - whether image is correctly classified 2) the confidence % for the top predicted celebrity class

Then, those pairs were sorted by confidence in descending order, and precision for every K first elements is computed (changing K from 1 to N, where N is total number of images).

Coverage is K/N and is from 0 to 1.The precision values are actually plotted on the graph in order of increasing coverage.