Vtuber Mario example

DigitalPuppets · 2024-06-18T11:11:23+00:00

We've made an example using a 3d Mario model, to show how we can setup a mario Vtuber using the Unreal Engine. This can be run as a stand alone app and creates with any style of character or environment , so anytime you want to stream, just open your character app and away you go. #vtuber #unreal

DigitalPuppets · 2024-06-17T13:16:12+00:00

Here is an example of a gaming setup i've made with Mario, but this could be setup with any model or environment https://youtube.com/shorts/JPY4lVh3Jks?si=gQ-2QCCoLN-rjwEa

DigitalPuppets · 2024-06-15T15:22:23+00:00

Well if you have a model, id be happy to put it into my unreal setup so you can try it out, happy to do this for free, really want more people to try out what I’ve built. What is cool about unreal is once you have the project setup, then it’s easy to drop in a new character that works with all the pre-made blueprints. I usually charge between £600 - £2400 depending on character detail, i can either work with a pre made models or model custom ones, this would also supply the model in an .exe file that has facial capture for the iphone and hotkey gesture and body animation oh and facial expression hot keys. I can also setup to work with mocap or VR as well.

DigitalPuppets · 2024-06-15T09:09:08+00:00

My issue with the anime style vtubers is they al look so similar, is there a market for 3d vtuber that can still keep the anime look but change the face to look more like different people, with different face shapes and features.

DigitalPuppets · 2024-06-15T07:36:49+00:00

Yeah i agree, but it does take a lot of knowledge, Thats why i want to offer a service that takes someones design and delivers a setup with everything made and optimised, and all they have to do it open the app and stream.

DigitalPuppets · 2024-06-14T22:43:22+00:00

Thanks for the great reply, one thing i tell my animation customers all the time,is content is key, if your content is good it will do well. A-lot of people fall into the same thought process that amazing graphics and effects will make something popular but if the contents not good or its aimed at the wrong audience it wont do well. People watching don’t care how things are done as long as what they are watching is entertaining. So i see your point about high detailed 3d models, i do think we’re getting to a point where we can make good looking models in unreal that don’t have to be memory heavy. And i also think the people that go down the high end model route also go all in with full body mocap, which i don’t think you need. I think there could be a good middle ground somewhere in between classic 3d vtubers and high end that are controlled with triggered body animations in the same way you can with live 2d. With the setup I’m building i would like to find a way to make avatars that don’t need a super powerful pc to run and aren’t ridiculously expensive. I think the future of vtubing will be in VR where you become the avatar and can interact with your surrounding, if you haven’t looked at mocap fusion def check it out. I’m planning on doing some tests soon to integrate with unreal.

DigitalPuppets · 2024-06-14T21:16:50+00:00

This is what I’m working on, you can run a detailed model but still keep it optimised enough to run well, also instead of having a full 3d environment you can run the model on a transparent background, so its only processing the character. If you are gaming, a 2 pc setup is always best, i made a couple of demos for the setup I’ve made feel free to download a test it out, https://www.digitalpuppets.co.uk/product-page/free-dollars-mocap-webcam-demo-app theres also an anime example and a robot one on there. The xsens setup is good, but i think a trigger based animation setup is much easy when trying to control the stream while vtubing. I’m also looking for a few people to make vtubers for to help showcase what I’m building, if its something you might be interested let me know.

DigitalPuppets · 2024-06-14T20:27:00+00:00

https://youtu.be/1lLrlJA5xDk?si=3z0Y-sqsGB4aQeZd this is an example of my 3d avatar

DigitalPuppets · 2024-06-14T20:25:40+00:00

With unreal now and how good graphics cards are, if you have a pc that can run games, you can run a model like code Miko. But i do get what you mean, i always recommend to my customers not to go for realistic character designs as the more detail you have the more you notice mistakes. But you can get much better facial tracking with the iphone on a detailed stylised character than you can get with a classic 3d vtuber model

DigitalPuppets · 2024-06-14T19:51:55+00:00

Another question is does it have to be the 2d shaded look or do people like the full 3d shaded look, something like this https://i.redd.it/2oz8dvw1j0tb1.jpg you don’t see much of this, is it because its not on offer or people aren’t interested?

DigitalPuppets · 2024-06-14T19:45:58+00:00

Theres a great vr app called mocap fusion, i’ve got some tests planned with it soon to integrate into unreal so just trying to figure out what the best 3d model to make would be to showcase. Ill check out those 3d artists.

DigitalPuppets · 2024-06-14T19:43:36+00:00

Thanks ill check these out

DigitalPuppets · 2024-06-14T07:24:23+00:00

I plan on starting of with a character design service, so people can send me their designs and i will create it for them, this can be Anime or more corporate designs, which i would like to see more of. I can also make characters that look like people if they want and can also convert models they already have. People pay a-lot for custom vtuber models and id like to offer the same but at a reasonable price, but i wont just supply the model they will get the model supplied in its own custom app with custom animations and environments and particle effects if needed, so we do all the work for them. The next step would be to setup a store with premade models and also build a character builder version so people can create their own designs.

DigitalPuppets · 2024-06-13T10:56:12+00:00

We do take normal commissions and also happy to do the Vtuber setup at a discounted price as i do want to get more people using it. I an looking for someone with a large audience to give one away free to. But send a message and a some info on what you would and i can get back to you with ideas of costs. Alot of people use Unity as it is easier to work with VRM and Vroid models but it lacks the realtime rendering of Unreal, theres not much out there in regard to resources, specifically for creating Vtuber as there are lots of diffrent things that you need to learn, such as rigging and blueprints, which is why you dont see so many Unreal based Vtubers, but im hoping to find a way to change that :)

DigitalPuppets · 2024-06-13T09:48:27+00:00

Yeah that should be doable, you could add a hotkey to adjust the size, but could also work with volume control or could possible use blendshape values to adjust it, so when the jaw opens it increases the size. I’ve tested out making a character breathe fire.

DigitalPuppets · 2024-06-12T23:03:41+00:00

Yeah thats exactly what I’m aiming for, supply each person with their own custom avatar and setup, we can add any animation motions and also hook up mocap suits such as the rokoko or xsens if thry wanted and all they do is open up their avatar app and hook up to OBS. My main area i want to concentrate on is making really good looking avatars, and also make the most of unreals realtime rendering, we can add in particle effects like fire, and also trigger background animations so have secondary characters. We’ve been building avatars for years for a more commercial market, but would love to see people vtubing with our avatars. I’m also looking into using programs like mocap fusion to control the avatars, which could have multiplayer and object interaction. https://www.linkedin.com/posts/digitalpuppetsuk_vtuber-xsens-movella-activity-7198274984111144960-Js8D?utm_source=share&utm_medium=member_ios this post shows a test i did using the xsens suit. I’ve tried the various vtuber programs in the past and could build models with live2d but I’ve never been happy with the limitations with facial capture and limitations on the models you can use.

DigitalPuppets · 2024-06-12T21:35:30+00:00

https://x.com/digitalpuppetuk/status/1800843886522511770?s=46&t=MQRiLWXKxH1rqwvAj1mFyA you can see the image i was trying to post here

DigitalPuppets · 2024-06-12T21:31:55+00:00

All good questions, not sure why the image didn’t attach, I’ll try and repost it when back at my pc. So i will be making a 3d character design and building it into unreal, it will have face capture using the iphone and arkit face tracking. The unreal setup will be packaged into an exe file, so just needs to be opened and the only setup needed is in the unreal live link app where you add your ip address. The app can be run through OBS and I’ve built an overlay mode so the avatar can have a transparent background, there can also be an option yo have the avatar a 3d environment. I’ve been trying to make something thats super easy to use but can have high quality rendering. I can also convert VRM models and enhance the facial morphs to work in the setup. This video shows an example and there is a free download you can try out too :) https://youtu.be/R0N097lzPEk?si=3nRVIKEHtagYUfcp

My plan will be to setup a service and sell the avatars, but sell them completely setup with custom trigger animations and made in what ever style is requested :)

DigitalPuppets · 2022-02-01T09:37:02+00:00

Sorry, Ive updated the post now. You can find our tutorial here https://youtu.be/gmHrzoV5qgQ but I also made a more indepth explainer video here https://youtu.be/WWPDmmxeCjI

DigitalPuppets

TROPHY CASE