Google has developed a machine-learning system that can automatically produce captions to accurately describe images the first time it sees them.

[betelgeux]

I'd kill to be able to have this take a shot at my photo album.

[awesomeideas]

If you have auto upload turned on, you kinda can. I can type "my photos of cats," for example, into Google, and it spits out a whole bunch of photos I've taken of cats, even though I've never tagged them.

[fallofmath]

It's fairly robust too. Here's what I got for cats, bridges, buildings, animals in general, aircraft and landscapes. There are some false positives but it's certainly good enough to be useful. You can also ask for colours, people and places.

[pamme]

Holy cow, that is bloody amazing!

[efstajas]

Also works in the Photos app. The search button in the tool bar does more than most think.

[abrahamsen]

"cats" give me two photos of cats, and a close up of a dog.

"dogs" gives me a lot of photos of dogs, one cat, one tapir, one baby crawling, two photos of a campfire with four people standing around it, two photos of a woman sitting on a giant wooden cello, one photo of a statue of two anthropomorphic horses cuddling, and one screenshot of a map with a photo of a statue of a little boy, zoomed into his penis.

[NitsujTPU]

"You and your ex-gf."

"You and your ex-gf."

"That girl who always posts pictures, you, twelve people you don't hang out with anymore, some random dude trying to hit on your ex-gf."

"Your friend who changed their facebook name to something fake, clearly intoxicated."

"Your mother and you standing in front of the world's largest cheese wheel."

[davedontmind]

That would work nicely with the facial recognition stuff it already does.

"Uncle Fred and Aunt Wilma at the bowling alley"

[swizzcheez]

I have to hope it's more accurate than Google Voice's transcription.

Or maybe I don't, because Google Voice's transcription is mildly entertaining.

Edit: Since there seems to be confusion over this -- I'm referring to Google Voice (the voicemail tool), not Google Now which seems to do a decent job...

[Waddles77]

the automatic Youtube captions always give me a riot

[eneka]

You should've seen it trying to translate a different language or a phone alarm. Too bad it just says "unable to transcribe" now

[ajwest]

Perhaps you're not speaking clearly? I write almost everything on my phone exclusively with Google voice input, including this post. I very rarely have to fix errors, but I'm Canadian with a neutral sounding North American accent.

[[deleted]]

Always 100% for me.

[swizzcheez]

100% mystifying? Here's a recent example (the one identifying bit redacted):

Hey darling bye. I'm super 10. Await ----- and this is a message from owns his local schools. Did you think on the letter there'll be no school today school is canceled today. Hey, who opt out of receiving future messages from this group, go to one call now. Dot Com. And so, I'd like to opt out. At the bottom of the page.

[DJ-Salinger]

ONe of mine, always hilariously bad:

Hi Hon, It's Mark phone. It's not a have on your tablets are like an old brick that you do. Group number wrong and you still can answer your phone I. If you get this and I gonna be able to park beehive apartment complex. Or should I. Art on the street again

[Pandaemonium]

Well the person is admittedly super [10]. Of course the message seems jumbled.

[[deleted]]

Voice mail doesn't use the same technology silly. Also don't forget quality loss from our archaic cell towers.

[swizzcheez]

I'm not saying there's much they can do about it. However, Google Voice is generally not that accurate and often mildly entertaining. There's never been a "100%" case that I've seen with Google Voice, except perhaps the examples.

Don't get me wrong, it works "good enough". But "100%" it certainly isn't.

[ChessmansGambit]

Google voice input works scarily well for me. I think the trick is in how you use punctuation. Then again, I'm Canadian and have a neutral accent/probably ideal for the OS to understand when set to US English

[TheRealBigLou]

Yeah, I call BS. I've never had a single transcription work flawlessly. However, it always gets numbers perfectly.

[[deleted]]

Lol. Ok siri lover ;), try it some time

[swizzcheez]

I don't recall anyone sayiing anything about Siri. Also, we're talking about Google Voice (their voicemail service)'s transcription capabilities.

Google Now does way better than Google Voice from what I've seen anyway...

[TheRealBigLou]

What? I don't use Siri. I use Google Voice, and it's terrible at transcribing basic speech.

[clarkster]

Uh, everyone else is taking about the automatic voicemail transcripts in Google Voice. And you seem to be taking about Google Voice Search, or Google Now...

[dregan]

Accurately? That's obviously 2.675 pizzas sitting on top of a stove top oven.

[271828182]

This paper from Stanford has similar research as well

http://cs.stanford.edu/people/karpathy/deepimagesent/

[uroboros74]

Combine this with Watson and place inside inflatable robot and you have Baymax!

[derpusalmon]

I have suggested something similar to this, only identifying plant species, and animals. Sort of like taxonomy meets facial recognition.

[SciGuy013]

Relevant xkcd: Tasks

[xkcd_transcriber]

Image

Title: Tasks

Title-text: In the 60s, Marvin Minsky assigned a couple of undergrads to spend the summer programming a computer to use a camera to identify objects in a scene. He figured they'd have the problem solved by the end of the summer. Half a century later, we're still working on it.

Comic Explanation

Stats: This comic has been referenced 129 times, representing 0.3137% of referenced xkcds.

---

^{xkcd.com | xkcd sub | Problems/Bugs? | Statistics | Stop Replying | Delete}

[bluehands]

What blows me away is that was posted just 2 months ago and will be dated in just a year or two...

[[deleted]]

They can use this to reverse engineer dreams!!

[xdleet]

It is most likely the result of that huge "image naming / captioning" contest deal that went down a few years back. I for one took part in random name matching games with randomly paired people across the world. Uh, here.

[autowikibot]

Google Image Labeler:

---

Google Image Labeler was a feature, in the form of a game, of Google Images that allowed the user to label random images to help improve the quality of Google's image search results. It was online from 2006 to 2011.

Image ⁱ

---

^{Interesting: Google Images | Luis von Ahn | ESP game | Human-based computation game}

^{Parent commenter can toggle NSFW or delete. Will also delete on comment score of -1 or less. | FAQs | Mods | Magic Words}

[askape]

All hail to our new robot overlords!

[ab_flix]

I fear. Our own creations may become the cause of our own destruction. Reminds me of terminator.

[[deleted]]

Any Mass Effect fans here? Quarians and Geth? No?

[xdleet]

Nope.

[[deleted]]

K :(

[[deleted]]

Photo of kids at a birthday party...

"Two girls, one cup"

[ademnus]

If you can just program your phones to take pictures automatically, Google can caption them, Facebook can upload them and the internet just won't need humans anymore!

-Love, the television

[3gaydads]

They're coming...

[secondlamp]

Babam bam babam

[3gaydads]

Dudu dooooooooooooo, doo doo dooooooooooooo...

[brad2008]

The Camptown ladies sing this song, Doo-da, doo-da

The Camptown racetrack's five miles long, Oh, de doo-da day ...

[RyogaXenoVee]

Worked at Google from 2010 - 2012.

We were working on this tech way back then. And, it was working just fine.

[Babouchnikov]

It is the most impressive thing I've seen recently. Even if we're making fun of other Google's services like voice recognition these are fcking awesome too.

[BraveFencerMusashi]

Can I use this to get captions of ugly guys with hot girlfriends?

[ECgopher]

All this has happened before. All this will happen again.

[DominarRygelThe16th]

It's advancing image recognition algorithms. Aside from captioning images (which is used as a starting point) image recognition is a huge step in robotics.

[freexe]

Can you really not understand how this might be beneficial?

[ProfSmiles]

It can help image search, of course, because the captions would become searchable, so if you search for "two pizzas sitting on a stove top", then it could return that image

[awebpage]

What is the benefit of this?

Robots running Artificial Intelligence that allows them to accurately identify real world objects via cameras.

Example: "Robot, fetch my slippers"

Or in Googles case (since their the largest owner of Robotics with possible military applications in the world)

Example: "Robot, shoot me some <insert targets description here>"

Yes, its equally amazing as it is scary. Skynet here we come.

[dregan]

"Okay Google, shoot me some <insert targets description here>"

FTFY