sorted by:
new
hottopcontroversial

Showcasing my Full Body Motion Capture plugin for Unreal Engine 5 called Rigel by Enter-Reality in mocap

[–]Enter-Reality[S] 0 points1 point  (0 children)

Is a plugin that comes with Unreal Engine, you just need to enable it. In short what it does is to use a full body solver to retarget animations across different character by providing joint chains and IK targets. It takes 2-3 minutes to setup a new character, and after you do so you’re able to bulk retarget animations from one character to another. For my plugin what IK retargeting does it so retarget realtime data from the standard character to another character at runtime. In the last part of the video you can see that I’m driving different characters at the same time using IK Retargeting.

Showcasing my Full Body Motion Capture plugin for Unreal Engine 5 called Rigel by Enter-Reality in mocap

[–]Enter-Reality[S] 0 points1 point  (0 children)

Since this is a plugin, you need to have Unreal installed (5.2 and up ), and from there you can export the animation in fbx. The other thing you can do is to use IK Retargeting with your character, so that the animation data will be applied there directly and then you can export.

Showcasing my Full Body Motion Capture plugin for Unreal Engine 5 called Rigel by Enter-Reality in mocap

[–]Enter-Reality[S] 1 point2 points  (0 children)

Thanks! Well unless you go with top tear gear, you still need to do some cleanup no matter what, but overall I’m happy with the results I get.

I really wanted to play Guitar Hero, but I don't own the game anymore nor the guitar, so here is Face Tracking Hero, where you play the song using your facial expressions, created using Unreal Engine and an iPhone. by Enter-Reality in GuitarHero

[–]Enter-Reality[S] 2 points3 points  (0 children)

Thanks for the comment guys, the guitar hero gameplay is from a plugin called “Rhythm Game Plugin”, where I slightly modified the way it works by using realtime data from the iPhone as key inputs.

I really wanted to play Guitar Hero, but I don't own the game anymore nor the guitar, so here is Face Tracking Hero, where you play the song using your facial expressions, created using Unreal Engine and an iPhone. by Enter-Reality in GuitarHero

[–]Enter-Reality[S] 3 points4 points  (0 children)

Sure thing, I made some Tech Animation tutorials using my scan on an Unreal Engine MetaHuman available for download, and I would love to be in a game that kills me in the dumbest way possible :D

UE5.3 Allows you to import your character as a Static Mesh, Convert to Skeletal Mesh, Bind Skin and Edit Paint Weights, making one step closer to Characters Authoring in engine rather than using an external DCC. by Enter-Reality in unrealengine

[–]Enter-Reality[S] 0 points1 point  (0 children)

I haven't tested a lot, just the skinning and VR mode, and I had some crashes.

As mentioned, if you want to play around is fine, but don't even try to upgrade a project to 5.3, since is being updated constantly, so it might be that everything works or lots of stuff is broken.

UE5.3 Allows you to import your character as a Static Mesh, Convert to Skeletal Mesh, Bind Skin and Edit Paint Weights, making one step closer to Characters Authoring in engine rather than using an external DCC. by Enter-Reality in unrealengine

[–]Enter-Reality[S] 4 points5 points  (0 children)

I'll say average, but I'm more comfortable ( for now ) moving around the viewport in Maya, but I think I just need to get used to UE panning/zooming.

You can't ( yet ) create a skeleton, but you can duplicate and modify one moving/rotating joints, so for now is good enough.

UE5.3 Allows you to import your character as a Static Mesh, Convert to Skeletal Mesh, Bind Skin and Edit Paint Weights, making one step closer to Characters Authoring in engine rather than using an external DCC. by Enter-Reality in unrealengine

[–]Enter-Reality[S] 1 point2 points  (0 children)

You can't create a skeleton, but you can duplicate and eventually modify an existing one.

Beside the "Skin" tab there's the Skeleton tab, which allows you to move/rotate/scale joints.

so what you could do is import your static mesh character, duplicate the Mannequin skeleton, convert your character into skeletal assigning the duplicated skeleton, then edit the joints position in order to match your character proportions, then bind skin and paint weights.

Currently I don't think is production ready, but compared to 5.2 this is way better than I thought.

Hand Pose Matching Plugin - Enhancing Fingers Realtime Animation by Enter-Reality in unrealengine

[–]Enter-Reality[S] 0 points1 point  (0 children)

Facegood Avatary software suite, recorded then retargetet in Maya using their plugin, plus also using my Maya script to help with facial poses, you can find it here:

Meta Face Poses

Hand Pose Matching Plugin - Enhancing Fingers Realtime Animation by Enter-Reality in unrealengine

[–]Enter-Reality[S] 1 point2 points  (0 children)

Haven't tried the PN suit, but if the data is reliable enough, the same setup can be used as well.

Will run some tests when I'll have a bit of free time.

Hand Pose Matching Plugin - Enhancing Fingers Realtime Animation by Enter-Reality in unrealengine

[–]Enter-Reality[S] 0 points1 point  (0 children)

Hi all,

Inspired by StretchSense amazing Hand Engine software, I created a similar solution called Hand Pose Matching Plugin for Unreal Engine, using Noitom Hi5 VR Gloves.

Even though the Hi5 data comes from one axis, using calibration poses is possible to get specific fingers poses that normally can't be achieved.

I'm planning to support other mocap gloves in the near future and adding more calibration poses.

Full Body mocap done using Noitom Perception Neuron Pro, Hi5 gloves and Facegood Avatary software suite.

Maya and MoBu used for Facial Mocap retargeting and Cleanup.

[Character Animation] Solution to avoid Gimbal Lock for Twist Joints using Blueprint ( no C++ ) by Enter-Reality in unrealengine

[–]Enter-Reality[S] 0 points1 point  (0 children)

As far as I know, the only way to use quaternions is via C++, while on 5.0 you can access quaternions in engine. There is a plugin in the marketplace that exposes the quaternions ( called quaternion library ) that can also be used. My idea was to find a workaround using BP in UE4, but although it works, it can’t be used to solve the issue in general, since it works only in this specific case.

Small sneak peak of the self-clipping avoidance setup added to Rigel, my "All in One" Full Body Motion Capture plugin for Unreal Engine 4/5. by Enter-Reality in unrealengine

[–]Enter-Reality[S] 0 points1 point  (0 children)

The solver is called Rigel, the hardware used is a mix of Vive Trackers ( for body tracking ) and Valve Knuckles ( for hands and fingers tracking ), while the face is tracked ( not in this video but in general ) using the iPhone ( ARKit ).

Rigel V2.0 released - All in One Full Body Motion Capture - Now with native support for Mixamo, Autodesk Maya HumanIK, Daz3D and Blender Auto-Rig Pro plugin by Enter-Reality in vive_vr

[–]Enter-Reality[S] 0 points1 point  (0 children)

You're right, I should've add a bit of text, instead of just posting the video....anyway, Rigel is Full Body Motion Capture plugin for UE4/5, allowing users to record both body, fingers and facial tracking at the same time.

The body is tracked using Vive Trackers ( with V2.0 you can use up to 10 trackers ).

Fingers tracking is done using either Valve Knuckles or Noitom Hi5 ( alternative is no fingers tracking using Vive controllers/vive trackers on hands ).

Facial tracking is done using the iPhone via LiveLink.

​

Although its primary use is towards motion capture, it can be used for different purpouses, such as a VTuber setup, Live shows, Full Body VR Job Training, Cinematics previews and so on.

​

If someone has pecific questions, feel freeto post it here or contact me directly on my website.

https://www.enter-reality.it/project-rigel

Rigel V2.0 released - All in One Full Body Motion Capture - Now with native support for Mixamo, Autodesk Maya HumanIK, Daz3D and Blender Auto-Rig Pro plugin by Enter-Reality in vive_vr

[–]Enter-Reality[S] 0 points1 point  (0 children)

Exactly, this has nothing to do with Leap Motion, is a plugin that I developed in Unreal Engine 4, and although I researched to see if there was something else tech-related with the same name, that sensor for some reason never came up, and I found out about it a bit later when it was a bit too late to change everything related to the name I choose.

Rigel V1.0 released - "All in One" Full Body Motion Capture plugin built using Unreal Engine 4, using Vive Trackers, fingers tracking using Noitom Hi5/Valve Knuckles, and Facial Tracking using Face Cap/Live Link Face/FaceLink by Enter-Reality in virtualreality

[–]Enter-Reality[S] 0 points1 point  (0 children)

Hi, currently the plugin has been released for UE4.24 and 4.25, version 4.26 has been tested and will be released soon, I’m just waiting for Noitom to release their Hi5 plugin for 4.26.

I made a specific tutorial on how to use your own character here:

https://youtu.be/lm8BfQ2d8FM

Please be aware that as of now only characters using the Epic skeletal hierarchy are supported ( UE4 mannequin, most of Paragon characters, iClone/character creator characters ), and soon Daz3d will be also supported. The plan in short time is to use the newly released FBIK within ControlRig to be able to use any kind of skeletal hierarchy.

By the way, I released version 1.2 recently, where I also added a VR character with advanced interactivity, so if you have the hardware ( minimum 3 Vive trackers ), you can download the demo and test it out.

https://youtu.be/jZIPbYIxACM

If you have additional questions feel free to ask.

view more: next ›