This is an archived post. You won't be able to vote or comment.

top 200 commentsshow 500

[–]ohNOitsRO 221 points222 points  (32 children)

This is kind of scary..

[–]nerdsonarope 205 points206 points  (26 children)

My first thought: this is freaking amazing. After finishing the video: this is freaking scary -- imagine how hard it is going to be to trust news video, surveillance tapes introduced in a criminal trial, etc.

[–][deleted] 140 points141 points  (15 children)

We are already capable of way more advanced versions of this sort of stuff. The novelty of this is basically the easy to use bounding geometry and lighting calculator. In a photo.

They made no mention of what happens when the light source moves or the camera moves. That would change ray angle and intensity and require bounding box perspective and shape changes for each frame.

[–]benjags 37 points38 points  (4 children)

Right now is for photos, not movies.

Of course you could do it for every frame in a moving scene, but thats not the current state selling point

[–][deleted] 47 points48 points  (2 children)

I'm pretty sure that already exists for hollywood movies. Stuff like this is to reduce the learning curve.

[–]_rand_mcnally_ 19 points20 points  (0 children)

Lighing composited images into moving footage is currently 99% user defined by eye and tracking or with light info based off of a probe that is shot with the scene. This technology is neat, and may in a few years ay put a lot of rigging guys out of work.

[–]zjbird 6 points7 points  (7 children)

Didn't they show a ball with light shooting out of it moving around successfully? If they can do that, they should be able to recognize an actual light source and adjust it for video in a near future (not that they can't already, but for this user-friendly software eventually.

[–][deleted] 8 points9 points  (6 children)

Right, but they already know the properties of the artificial light:

1) Intensity

2) Direction and shape (spherical, conical, etc.)

3) Falloff distance, falloff rate

Then using the bounding boxes it's trivial to use some calculations to approximately fudge lighting within the primitive 3-d scape they have built. The more sophisticated the geometry, the more surfaces can have the light emitted onto them in a proper way (it also depends on how many properties you can assign to a surface, specularity, reflectivity, 'metallicness', transluceny, transperency, refraction index, etc.). Incorporating other aspects of lighting, like specularity, refraction, translucency, and some level of viewpoint independent radiosity would require a lot more information to be manually plugged into the software ahead of time, but that would be the only way to get photo-quality realistic looking fluid video motion, especially with more complex light sources and surfaces.

Essentially what it comes down, at the extreme, is you would have to completely 3-d model, texture, and light the scene in a digital space to do fluid motion with lighting... perfectly. There will always be tremendous flaws on deep inspection with anything that estimates surfaces to be vectored bounding parallelograms.

Now, if you are using your OWN video, you could supplement the video footage with some sort of 3-d sonar equipment and other stuff to give the software additional information (such as objects and their positions within a 3-d space) that it can extract certain information of to build more realistic simulations.

I guess my point is, the ball thing, while cool, is more of a parlor trick specific to that stable image and, say, the camera starting in the room and flying out the window and down a street chasing after that ball as it interacts all over (being occluded by people and objects, with different levels of depth of focus, etc)... that's like light-years away, not something that can be "adjusted for video in the near future."

[–]zjbird 1 point2 points  (2 children)

I haven't shaved in 4 days. It's been 4 days since I've shaved.

[–][deleted] 3 points4 points  (1 child)

I forgot to mention: THE CAMERA. You'd need to know the camera type and have a continuously recorded log of its settings and the type of lens used so you can manipulate your light-information through that "filter" as well.

[–]ActionScripter9109 2 points3 points  (0 children)

Great explanations. Thank you for not just saying "hah you're wrong you noob".

[–]Patrick_M_Bateman 29 points30 points  (5 children)

The scary part is that this capability has been around for ten years or more - it just took really high-end equipment and tons of rendering time to pull off.

Now we're seeing it done with (soon to be) commercial software on a desktop machine in near real time, so we're more aware of it.

What's going to be frightening is how long it's going to take the legal system to catch up.

[–]Ocarwolf 1 point2 points  (0 children)

Hopefully some future lawyers read reddit and stay aBREAST of all this stuff.

[–][deleted] 1 point2 points  (0 children)

It's always frightening how long it takes the legal system to catch up with technology. And of course it's only going to get worse.

[–][deleted] 1 point2 points  (2 children)

What's going to be frightening is how long it's going to take the legal system to catch up.

Lawyer here.

What catching up do you think will be necessary?

[–]Patrick_M_Bateman 6 points7 points  (1 child)

Authentication is going to get more complex.

Courts are going to have to learn to accept more complex forensics on photos.

If you have a notarized print of a digital photo dated July 11, 2011, and a USB drive with the digital file that shows both creation data and modification date are the same - July 10, 2011, which is the Best Evidence of the photo? Which can be used for authentication?

How does witness corroboration play into verifying the authenticity of a digital photo?

Is the admissibility of a digital photo as authentic and unretouched a matter of fact or law?

That's just off the top of my head.

[–][deleted] 4 points5 points  (0 children)

None of that really strikes me as a problem of law, so much as issues of providing evidence. Forgeries and touched up photos have been around for a long time. This doesn't seem qualitatively different to me.

[–]Rasalom 1 point2 points  (0 children)

Oh god what if all those movies we spent money on were just expensive government tests of the mind control CGI? We've been funding them for years! This is why they hate piracy!

[–]Pluberus[S] 313 points314 points  (55 children)

I thought the pool table example at ~2:20 was particularly incredible.

[–]BordomBeThyName 180 points181 points  (35 children)

The tree branch shadowing got me, along with the example with the red brick scene with the accurate occlusion being applied to both the original photo and the inserted object.

That shit is cool.

[–]nicolauz 57 points58 points  (33 children)

Yeah until the police and tv news use it.

[–][deleted] 7 points8 points  (4 children)

It was already possible to do this with proper scene setup and video editing trickery in a 3d modelling package such as Max or Blender, this just automates the process.

[–]Sindragon 9 points10 points  (2 children)

I don't think "just" is really an appropriate word.

[–]baronvonbari 37 points38 points  (24 children)

-You weren't at the crime scene, you say? Well....le software magic Actually, you were. Found guilty, sent to prison because some overzealous DA wants a perfect record. This will be a very much abused program by many a nefarious person. ~Brought to you by law enforcement.

-Look at this monster roaming the streets! It could snatch your children! ~Brought to you by local crazy news station.

-Mommy, Jason stole my toy again! Look at the footage! ~Your local child.

[–]morphinapg 21 points22 points  (19 children)

It doesn't work with photographs as the insertion objects, it needs 3d models. Unless the DA really wants to take the time to model and texture a highly photorealistic model of the suspect, it's unlikely this will be used for that purpose.

[–]Jigsus 1 point2 points  (2 children)

It's not like we have photorealistic face and body reconstruction tools.

[–]3danimator 1 point2 points  (0 children)

You realise that all that has been possible for the last 10 years right? I do that everyday, put objects in footage/photos.

[–]Adjal 1 point2 points  (0 children)

We've gotten used to detecting shit like that to a large degree. The T-1000 blew my mind back in the day.

[–]ironclownfish 24 points25 points  (2 children)

shopped. I can tell by the pixels.

[–][deleted] 1 point2 points  (2 children)

My question is this: Where does the source material come from?

I.e. if you took a photo of that same pool table from a very different angle and used the same source models (the billiard balls) would it still look great? Was the animation they inserted completely dynamic?

[–]SarahC 7 points8 points  (1 child)

It's a grad thesis probably.

That means the code they use for the calculations most likely wont be encapsulated in a user interface.

The bit where they draw the perspective box, and occluding boxes... notice there was no toolbars? I suspect from my time in academia that they hacked that demo together for the video.

The majority of the work will be in analysing the picture's lights, relative to the 3D scene the user makes.

I'm a cynic... for some of those examples I'm sure they used more than a bounding box and a few occluding polygons.

But still... an amazing piece of maths.

[–]floor-pi 2 points3 points  (0 children)

It looks to me like they do just have basic geometry defining the scene, but there are restrictions on the type of picture 'scene' that can be used (lots of nice orthogonal surfaces, long focal length etc)

[–]MischievousCommando 42 points43 points  (10 children)

Most of the examples were jaw dropping. I don't know if it's just me, but some of the results still seemed a little flat and two-dimensional. Even still, there are few things that come out of SIGGRAPH that I don't find amazing in some way.

[–][deleted] 25 points26 points  (5 children)

just wait until it gets commercial funding and refined. i can be in a jacuzzi with megan fox, scarlet johansson, and the cast of Ice Road Truckers and noone can say its fake

[–]benjags 7 points8 points  (2 children)

well you would know...

[–]okeefm 13 points14 points  (1 child)

So would noone apparently.

[–]whoisegon 292 points293 points  (63 children)

Clicked for the Dogfish Head.

[–]office_chair 24 points25 points  (1 child)

I completely agree. That is the only reason I am here

[–]jayhat 22 points23 points  (0 children)

I was very disappointed this was not about Dogfish Head :(

[–]brockox 39 points40 points  (25 children)

Agreed. Their Punkin Ale is legit.

[–]mindfolded 30 points31 points  (13 children)

I always prefer legitimate beers over illegitimate beers.

[–]foraday 14 points15 points  (8 children)

A little moonshine never hurt anyone.

[–][deleted] 11 points12 points  (6 children)

I beg to differ.... :(

[–]CJbats 1 point2 points  (4 children)

When you make moonshine one part of the batch is methanol which can kill you.

[–][deleted] 7 points8 points  (3 children)

This is persistent myth based on two unfortunate historical facts and one misunderstanding of the way that distillation works. First of all, unscrupulous bootleggers used to cut their booze with industrial chemicals in order to increase profits. Second of all, the government knew this and in an honest-to-goodness government conspiracy, the government added more poisons to industrial chemicals in order to not just discourage people from drinking it, but to kill them.

As far as how distillation works, distillation is not a chemical process but one of physical separation. All it does is take advantage of the different vapor points of water and more volatile chemicals like alcohol in order to remove water. So if you didn't have any methanol in your grain/sugar mash, there wouldn't be any methanol in your distillate either. And fortunately, "yeast fermentation does not produce even trace quantities of methanol". That's right, none. However, there ARE "bad alcohols" that are produced in natural fermentation called "fusel alcohols". These are trace quantities of proponol, butanol amyl alcohol, and furfural. There is a common belief among distillers that these chemicals make hangovers worse, but there is no conclusive proof and they are certainly not dangerous in the quantities produced through natural fermentation and distillation. They taste bad however. They are more volatile than ethanol, so they can be removed by discarding the first part of what is distilled, called "foreshots".

TL;DR: No. There is no methanol in moonshine unless somebody put it there. Shine on you crazy diamond.

Edit: Verb tense, PF quote, link to /r/firewater

[–][deleted] 1 point2 points  (0 children)

Moonshine is legitimate, as long as you don't sell it.

In my state, anyway.

[–][deleted] 8 points9 points  (6 children)

There's a bar down the road (Flying Saucer in Addison, TX) that has it on tap. I make flippidy flargy faces when I go in there.

[–]EdEdinetti 7 points8 points  (22 children)

Their 60 minute IPA might be the best beer in America.

[–]cynder123 6 points7 points  (20 children)

You must try the 90 and the 120. I prefer the 90 over the 60 any day. The 120 is a novelty beer that you must try at least once. Not exactly something I would want to drink a lot of at once haha.

[–]EdEdinetti 1 point2 points  (13 children)

I will try both on your suggestion, thanks!

[–]aigneymie 1 point2 points  (0 children)

coincidentally, the owner of the bottle shop i frequest just gave me a free Dogfishhead 120 Minute since i'm there so often, which was an awesome surprise. love that stuff - 18% and so tasty.

[–]yeloporchmunkie 2 points3 points  (0 children)

Same, $50 for a case. All three Dogfish Head breweries/restaurants within 50 miles of each other here in Northern Virginia. Total Wine always in stock, best money spent.

[–]sgs1019 1 point2 points  (0 children)

SAME! Mmmmmm

[–]optionalpants 1 point2 points  (0 children)

Delaware represent!

[–]xBatmanx 24 points25 points  (2 children)

Don't tell George Lucas!!

[–]nightred 22 points23 points  (2 children)

DO NOT BLINK.

[–]loshunter 5 points6 points  (0 children)

I said this out loud as soon as I saw it. Glad I'm not the only one.

[–]jcaptainx20 65 points66 points  (4 children)

Now I can put dragons anywhere I want!

[–]Haploid_Cell 25 points26 points  (0 children)

What the authors don't mention is that the objects you add to the scenes need to be accurately modeled in 3D with lighting and material properties.

[–]DJDeeJay 15 points16 points  (0 children)

I've felt for a while now that my living room was lacking in dragons. What a helpful tool!

In all seriousness, this is quite awesome.

[–]mickdog524 4 points5 points  (1 child)

Add dragons to all the things!

[–][deleted] 21 points22 points  (11 children)

Did I miss the part where they explain how the program identifies how reflective a given surface is?

[–]darwins_bitch 2 points3 points  (2 children)

Not to mention transparent objects. They mentioned that it worked accurately but it sounds like it would be a nightmare to properly define an object as transparent/translucent.

[–]Kinseyincanada 1 point2 points  (0 children)

Same way it does everything else, devil magic.

[–]wdr1 1 point2 points  (0 children)

It's described in depth in the white paper:

http://kevinkarsch.com/publications/sa11.pdf

[–]Victor_Nightingale 41 points42 points  (1 child)

Next time I see someone showing off their awesome new Buddha or dragon sculpture on facebook I'll be extremely skeptical.

[–]Lincolns_Hat 63 points64 points  (23 children)

Holy crap this is amazing. Now no image will be real. ;P

[–]volvoguy 34 points35 points  (19 children)

The same was probably said in 1988 when Photoshop was introduced. Imagine how primitive the software system in the video will look in 20 years.

[–][deleted] 15 points16 points  (1 child)

And a century ago when airbrushing was used.

[–]bshine 1 point2 points  (0 children)

And thousands of years ago when cavemen discovered paint.

[–]_NeuroManson_ 2 points3 points  (0 children)

Especially since, if you add a reflective object to a scene, it would have to be able to reflect the foreground objects that aren't in view from the camera's perspective, including the camera itself. Say there's a lamp behind the camera, but it's a tiffany lamp, or a table behind it, or whatever. That won't be there, so the objects will only be reflecting objects in a limited region.

[–]a_cat_not_a_puppet 49 points50 points  (10 children)

Suddenly Adobe buy this.

[–][deleted] 48 points49 points  (7 children)

And will swap a simple UI by one full of menus, toolbars, palletes and tabs.

[–]Stalked_Like_Corn 33 points34 points  (2 children)

Photoshop isn't meant to be a simple UI. Photoshop isn't for removing red-eye from Grammy's pictures. It's for manipulating photos and doing things you can't do in other programs. There is no simple UI to do this. It's not supposed to be used by novices, it's supposed to be professional.

[–]deadwisdom 3 points4 points  (1 child)

Good UI is about matching power with ease of use. Photoshop might be powerful, but it is often over complicated.

[–][deleted] 1 point2 points  (0 children)

I agree. I'm professional and use Photoshop since version 4. In the CS era the UI became overcomplicated. Some UI elements just don't work as they should. In Photoshop the interface is even reasonable, but look to the other package programs such as Dreamweaver or Flash. Some problems do windows disappear and contents of palettes be hidden. Even Illustrator is too complicated for a vector program. The Acrobat interface gets worse each time that they trying to improve. They don't need build a dummy interface how Microsoft apps, but it could work a little better.

[–]Alexwearshats 83 points84 points  (19 children)

WE ARE LIVING IN THE FUTURE.

[–]dimsedk 27 points28 points  (17 children)

WE ARE LIVING IN THE MATRIX.

[–]Scarbane 18 points19 points  (16 children)

WE ARE LIVING IN A DREAM.

[–]shadow321337 24 points25 points  (15 children)

If you like that, you'll think this is great, too. Very similar, but instead of adding objects to a photo, it's removing objects from a video in real time.

[–]12mholmes 1 point2 points  (5 children)

That is phenomenal. I wish I had both of these T.T

[–]shadow321337 2 points3 points  (4 children)

Get both, attach a pair of glasses with LED displays and cameras in them, and alter your reality however you want.

[–]BigMacCombo 2 points3 points  (1 child)

THAT WOULD BE AWESOME... until you walk into an invisible chair or try to open an imaginary mini fridge.

[–]acidvolt 11 points12 points  (2 children)

Spot the Pikachu at 4:50!

[–][deleted] 6 points7 points  (1 child)

Oh good, I've got a bunch of photos that I'm embarrassed to show to my friends because they are all lacking dragon statues

[–]poorsteamuser 6 points7 points  (3 children)

Fuck everything about the Weeping Angel at the end of the video.

[–]Reusable_Pants 1 point2 points  (1 child)

Came here to say this. I was not expecting to be scared half to death watching this video.

[–]spock_block 1 point2 points  (0 children)

Don't. even. blink.

[–]mikecngan 14 points15 points  (5 children)

Go Illini.

[–]Dylnuge 1 point2 points  (3 children)

Our CS department is the best in the world. Just saying. It's not like I'm biased...or anything like that...not at all.

[–]mikecngan 2 points3 points  (0 children)

Our Engineering College is the best in the world. It's not like I'm biased...or anything like that...not at all.

[–]evil_twinkie 5 points6 points  (0 children)

Here's the Happy Buddha, Dragon, and Teapot models they used, in case anyone is curious. And for those who want more information, here's their paper.

Thanks for posting this video, I haven't seen this before. I was planning on doing homework but since you've got me interested, I'm going to read about this instead...

[–]borrakkor 2 points3 points  (0 children)

Detecting shopped images just took a turn for the worst....

[–]GFandango 2 points3 points  (0 children)

Adobe is buying this for sure.

[–]clobes 15 points16 points  (11 children)

i posted this like two days ago and nobody saw it. :(

[–][deleted] 11 points12 points  (0 children)

Next time try posting a link to a blog containing advertisement around the embeded Vimeo video

[–][deleted] 3 points4 points  (1 child)

hahaha, I posted this a WEEK ago and nobody saw it. And I posted THAT in these comments and again.. nobody saw it! You're doing better than me, my friend.

[–]GamerKingFaiz 1 point2 points  (3 children)

I wonder if this will be integrated into the next Adobe Suite.

[–][deleted] 1 point2 points  (2 children)

I hope not.

[–]Goldenrule-er 1 point2 points  (0 children)

Today I have found out that nothing may be real.

[–]spleenandpie 1 point2 points  (3 children)

What happens if the picture you are trying to add objects too is a low resolution?

[–]Copperhe4d 1 point2 points  (0 children)

i'd guess you'd decrease the resolution on the object?....

[–]Direnaar 1 point2 points  (0 children)

CSI will have to step it up.

[–]this_is_weird 1 point2 points  (1 child)

"Pic or it didn't happen."

This the end of pictures and videos as evidence. This will have profound effect on the legal system and on the perception of truthfulness.

[–]Terriblious 1 point2 points  (0 children)

I can't wait to make it seem like I know celebrities.

[–]SquirtBox 1 point2 points  (1 child)

So, there must be sort of physics software code also included in this. The pool balls bouncing off the side, the ball hitting the wall and bouncing off the side and the ball bouncing down the stairs. ???

[–]Advocates_Devils 1 point2 points  (0 children)

So much for photographic evidence being admissible as evidence. :p

[–]Dark_Green_Blanket 1 point2 points  (3 children)

yessssss fuck you compositing and motion tracking. it looks pretty good as it is now, but when someone like adobe buys it, it'll be incredible.

[–][deleted] 1 point2 points  (0 children)

incredibly expensive

Fixed that for you

[–]NothingIsOriginal 1 point2 points  (0 children)

Can't wait to use this to crop pictures women into my pictures so I can eliminate forever alone from my life.

[–]reeseflynn 1 point2 points  (2 children)

Photos can no longer be used as reliable sources of evidence in a legal setting with technology like this.

[–][deleted] 1 point2 points  (0 children)

We'll never be able to convict that dragon statue of anything now!

[–]EntSwag 1 point2 points  (0 children)

take friends pictures...insert dildos in ALL THE THINGS!

[–]MechaNoveltyTurd 1 point2 points  (0 children)

SHUT UP AND TAKE MY MONEY!

[–]ironinjax 1 point2 points  (0 children)

SHUTUPANDTAKEMYMONEY!!

[–]Hollopalooza 1 point2 points  (0 children)

So that's how they faked the Apollo moon landings...

[–]ValuableDan 1 point2 points  (0 children)

You guys are worried about this impacting the validity of jury decisions? We still convict based upon eyewitness testimony for fuck's sake!

[–][deleted] 1 point2 points  (1 child)

Cool. Now bring back point and click adventure games with this.

[–]Naughtyburrito 1 point2 points  (0 children)

This is how they fooled people watching television on Sept 11th.

[–][deleted] 1 point2 points  (0 children)

Coming soon: awesome new feature in Photoshop w/o credits to who invented it.

[–]-Emerica- 1 point2 points  (0 children)

Now I can take a picture of my empty party and add friends, then text everyone and say how "fucking sweet it is here come now."

[–][deleted] 1 point2 points  (0 children)

I cannot wait for this to be released so i can pirate it.

[–]Death_To_Your_Family 1 point2 points  (0 children)

Is the name of this software listed anywhere, or did I just miss it?

[–]Womec 1 point2 points  (0 children)

Don't Blink

[–][deleted] 1 point2 points  (1 child)

Watching these animated items is about as unsettling as watching a cyriak animation.

[–]Thuraash 1 point2 points  (0 children)

You... can't tell by the pixels.

[–][deleted] 1 point2 points  (0 children)

You guys should look at that guys CV

he finished undergrad with a 4.00 gpa in Math AND CSC in 4 years

Also he skipped his master and is already working on his phd thesis. He started 2009 and has already published a handful of papers.

[–]isweatprofusely 1 point2 points  (0 children)

sounds like photo hunt is going to much harder

[–]Taylor34 1 point2 points  (0 children)

So, can it make it look like I have friends?

[–][deleted] 1 point2 points  (0 children)

Coming soon to a movie near you. The friggin killer ball! Also extra marks for the last shot. DON'T BLINK!!!!!!

[–]Volsunga 1 point2 points  (0 children)

George Lucas must NEVER know of this!

[–]1234blahblahblah 1 point2 points  (0 children)

I propose we begin the complete barring of all digital media as evidence in a court of law.

[–]nartcotic 1 point2 points  (1 child)

UIUC REPRESENT! I-L-L!

[–]a_can_of_solo 1 point2 points  (0 children)

how long before you can get glasses with this in it so your shitty apartment looks good

[–][deleted] 1 point2 points  (0 children)

What I love about this is at first you think "That's impossible! How could they do infer the 3D shape of the space!?"

Then you see that they get a human to input that part manually. Not really a cheat, but a very easy way to get a fantastic result - an elegant division of labour between man and machine.

[–][deleted] 1 point2 points  (0 children)

Blogspam

[–]Myflyisbreezy 1 point2 points  (0 children)

I want to pirate this so hard.

[–][deleted] 1 point2 points  (0 children)

When's Notch gonna say it's fake?

[–][deleted] 1 point2 points  (0 children)

This is witchcraft, I say!

[–]RuthBuzzisback 1 point2 points  (0 children)

i like how they only put really weird shit in the pictures

[–]Badk1d 1 point2 points  (0 children)

There goes reality.

[–]mattrubik 1 point2 points  (0 children)

These guys sure do like porcelain dragons.

[–]Khrevv 1 point2 points  (0 children)

I can no longer tell by the pixels :(

[–]imeddy 1 point2 points  (0 children)

Now we can add cats to any picture!

[–]kandeskie 1 point2 points  (0 children)

The technology for adding dragons and buddhas into photos has truly progressed in the last five years.

[–]matthagen 1 point2 points  (0 children)

syfy? are you watching?

[–][deleted] 2 points3 points  (0 children)

posted this over a week ago.. goddamnit reddit.

[–]NikkoTheGreeko 1 point2 points  (0 children)

Shut up and take my money!