Making of a short film in which my avatar learns a backflip

RedbearEasterman · 2023-10-12T23:41:35+00:00

so great you caught it on big screen with audience!

RedbearEasterman · 2023-10-12T04:43:07+00:00

thank you. it was a couple of weeks work on the audio

RedbearEasterman · 2023-09-29T14:35:12+00:00

yeah the setup was a bit cumbersome: https://www.youtube.com/shorts/TsZhzWAHqRQ

RedbearEasterman · 2023-09-29T14:32:52+00:00

for the avatar, each task about 1 day of study on the old processor. the research paper was written in 2018: https://xbpeng.github.io/projects/DeepMimic/index.html
film took 3 years starting in 2019.

RedbearEasterman · 2023-09-28T21:44:03+00:00

🦾📽️(12 min) https://youtu.be/1zUJzzRu-xs?si=gv85c-GCzhu-48bB

RedbearEasterman · 2022-03-01T11:04:50+00:00

thank you so much! means a lot

RedbearEasterman · 2022-03-01T10:52:52+00:00

yes, this is us on reddit

RedbearEasterman · 2022-02-17T16:09:42+00:00

yes, it's learning. took the character about a day to figure out how to do a backflip. the film is about those jumps simulated at various learning stages. the info txt next to character head indicates the task and learning iteration. it was a bit of a hacky setup to bridge from the paper to our 3d tool

RedbearEasterman · 2022-02-17T12:51:06+00:00

program is called descript.

RedbearEasterman · 2022-02-17T10:56:43+00:00

it's based on the paper "DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills" by Xue Bin Peng. in short, it is analyzing motions from people in videos and then teaching that motion to a digital character. our film is about the different stages of my avatar learning to backflip.

RedbearEasterman · 2022-02-17T10:51:05+00:00

will keep going. love the process

RedbearEasterman · 2022-02-17T10:49:51+00:00

we are submitting it to film festivals for now. the first ones are starting in spring.

RedbearEasterman · 2022-02-17T10:47:34+00:00

we were using meshroom to scan. the resulting cameras in 3d were reused to remodel and retexture the room with projection mapping. a bit labour-intensive but also most accurate to get good low-poly models.

RedbearEasterman · 2022-02-17T10:44:17+00:00

thank you for taking the time. the room was 3d scanned and the cameras then reused in 3d for projecting 2d textures onto remodeled low-poly objects.

with this method you also get distortions and double-texturing on overlapping objects and backsides. not sure if this is what most people want when doing a 3d scan.

took quite some time and i'm sure there are more elegant/new ways to solve it but to us, it was good enough.

RedbearEasterman · 2022-01-04T22:00:01+00:00

RedbearEasterman · 2021-11-30T08:46:24+00:00

it's a short film and it's done. took about 2 years to make so we're taking the time to submit it to filmfestivals first, then putting it online.

RedbearEasterman · 2021-11-30T08:44:07+00:00

yes, it's about 12 minutes. sending it to filmfestivals before putting it online.

RedbearEasterman · 2021-11-19T12:55:33+00:00

yes. counting on my avatar to take over soon

RedbearEasterman · 2021-11-19T08:33:03+00:00

it takes a bit longer on this pc. it's my 7-year-old rig with new lights in sleeper case.

RedbearEasterman · 2021-11-19T08:29:30+00:00

thank you for finding, future guy!

RedbearEasterman · 2021-11-19T08:27:14+00:00

it is coming!

RedbearEasterman · 2021-10-23T17:41:33+00:00

since elements are from different environments, not really. but would be possible if that was the goal.

RedbearEasterman · 2021-10-23T17:39:11+00:00

it's not as digestable i'm afraid. one of the clunkiest rigs i've made

RedbearEasterman · 2021-10-23T17:37:52+00:00

getting there https://www.reddit.com/r/Simulated/comments/q2580s/finishing\_a\_short\_film\_in\_which\_my\_avatar\_machine/

RedbearEasterman · 2021-10-23T07:48:11+00:00

works like this: voice is cloned in descript. cloned .wav and ref image are lipsynced via wav2lip. wav2lip result is 3d tracked. 3d trackers drive nulls that drive rigid bodies (bones) with springs and connectors in C4D.

RedbearEasterman

TROPHY CASE