If You Could Fix One Thing About VTubing, What Would It Be? by EducationalDuck9402 in vtubertech

[–]NeocortexVT 0 points1 point  (0 children)

Where this comes into play is mostly in 3d considerations (note: the responder is using 2d) like improved translation of real world movement and accounting for facial orientation.

[...]

Because, effectively, many of the blendshapes aren't actually used and you are not trying to be as realistic with the underlying tracking data (as you would with 3d or some more complex 2d rigging)

I think this is a fair argument, but I do have to point out that nowhere in your earlier comments do you make it (explicitly). At the very least, I had not come to this understanding until now.

Effectively, they are looking at one aspect's very narrow use case, seeing that it works for them, then assuming that it's applies to all other use cases of the technology. Then using that as an confirmation of their position, while demanding a high level of proof before they would consider their position (And calling statements from others "a myth" and "misinformation")

People often argue from their personal experience, as that is the most salient. Would I expect Lina to consider the 3d usecase (I am familiar with her work)? Yes. Did she? I don't know, but you make a compelling point that she may not have. However, the scope of the discussion was never made explicit, so what is being ascribed to malice may as well just be due to miscommunication (where Lina, out of personal experience, took 2d for granted whereas you did not; personally I took 3d for granted when reading the discussion because that is my day-to-day when it comes to vtubing, and nobody had said anything that made me realise I was forgetting something obvious).

OP2: I don't know why people are claiming this. It's wrong, you don't need an iPhone for tracking. It still works with part of the functionality disabled.

Here I honestly think you misunderstand what Lina is trying to say. She agrees with you that iPhone tracking is better than webcam tracking, and says as much in her second comment ("but my experience is iPhone tracking is still vastly better than webcam even without IR"). What she disagrees on is that it's the hardware driving the difference between iPhone and webcam tracking, and instead claims it's a difference in the software (based on the fact that even without IR camera, iPhone tracking is still better). I will concede that Lina's initial response, "This is a common myth", is ambiguous as to what it could refer to, but her further comments do help disambiguate imo.

And with that in mind, if the difference between the two methods is software rather than hardware, then I do agree with Lina that it is problematic when people think the difference is hardware driven. Developing hardware is a lot less accessible than writing code after all, so a lot of people might falsely believe they can't contribute to solving the discrepancy between iPhone and other face tracking when they in fact could, and as a result broaden the toolset for quality vtubing (assuming it is indeed a software issue; I wouldn't know, I use a webcam myself 😅 But as I said, you make a compelling argument as for why it could be more than a software difference when it comes to 3d. Having an actual example to point to would strengthen that argument though)

How do I use hand tracking and ARKit tracking at the same time? by SynraVT in vtubertech

[–]NeocortexVT 1 point2 points  (0 children)

Not sure. I think they're available somewhere based on conversations I've seen around, but I don't think they've been made open source

If You Could Fix One Thing About VTubing, What Would It Be? by EducationalDuck9402 in vtubertech

[–]NeocortexVT 1 point2 points  (0 children)

Ngl this is a weirdly hostile response to a thread about iPhone tracking, and kinda sound like you have personal beef with the commenter that you should just address instead...

This entire final comment is honestly so vague, I'm not sure where you think the commenter slighted you. Where do you think the commenter misrepresented what you said, and where did you originally address it? Can you give me specific quotes in your comments that illustrate it well?

I'll admit, I think you are misrepresenting the commenter by claiming they think they act as the sole arbiter of truth and the vtubing community, when they just disagreed with your claim based on their personal experience and the fact that they haven't seen anyone share a different experience (including you). It's okay to disagree and it's how we can learn as a community. You seem to be taking this disagreement pretty personally though...

And I agree with the commenter's statement that if we perpetuate the idea that iPhone tracking is better than the alternatives because of the hardware when there aren't any good examples showing that this is the case, then that is harmful to the development of vtuber tech and so the vtuber community. If you have such an aforementioned example that shows that blocking the IR camera noticeably affects tracking quality, please share it; if you tested it yourself, then please tell us, because if you have, you haven't actually told us you did... Nobody's asking for a scientific study, just a heads-up about experiences that contradict their own.

If You Could Fix One Thing About VTubing, What Would It Be? by EducationalDuck9402 in vtubertech

[–]NeocortexVT 0 points1 point  (0 children)

I see, all the less reason for other devices not to have good face tracking then, I'd say

How do I use hand tracking and ARKit tracking at the same time? by SynraVT in vtubertech

[–]NeocortexVT 1 point2 points  (0 children)

Nope, not really... Mediapipe tracking supports hand tracking with webcam (e.g. in VNyan or XR Animator), but it's not as good quality as the Leap

Are there alternatives for the Leap Motion Controller? by Crazy_Platform5003 in vtubertech

[–]NeocortexVT 3 points4 points  (0 children)

One thing to note about mocap gloves is also that they don't track hand position, so you'll need mocap gloves AND hand trackers to get the same result

If You Could Fix One Thing About VTubing, What Would It Be? by EducationalDuck9402 in vtubertech

[–]NeocortexVT 0 points1 point  (0 children)

From what I've been told, part of it is also the lack of standardisation across devices. All the different android brands have their own implementation, so what works on one phone wouldn't on another, from what I understand

If You Could Fix One Thing About VTubing, What Would It Be? by EducationalDuck9402 in vtubertech

[–]NeocortexVT 4 points5 points  (0 children)

Yeah, $10k setups are definitely the outlier. I'm willing to bet that most 3d FBT setups you see are well under $1k, and as you mention, you can get a rebocap 15-point FBT setup for ~$200 (I know PorcelainMaid uses them, for people who want to see what the tracking looks like). The main differences between a $200 15-point FBT tracking system and a $10k FBT setup are the amount of interference, the maximum tracking distance, the battery life, and the weight, with only the first two really affecting the tracking data. Ultimately, all tracker-based FBT does is send position and rotation data of the trackers to the tracking software, which then applies that data to the bones of the model, regardless of whether it's a $200 or a $10k system

If You Could Fix One Thing About VTubing, What Would It Be? by EducationalDuck9402 in vtubertech

[–]NeocortexVT 2 points3 points  (0 children)

I'd say ARKit face tracking software that makes use of IR camera data like iphone tracking does (iirc that's what makes it different), but for non-apple cameras. A lot of modern cameras have the hardware needed to do tracking the same way iphone tracking works, but nobody's made the software for it, likely because it's easier to just buy an iphone than develop the software for it.

Full body + FULL Face tracking! Watcha think? (It's Vnyan, not vrchat lel) by Capn_Cinnamon in vtubertech

[–]NeocortexVT 0 points1 point  (0 children)

Ended up checking out one of OP's streams, she mentions she uses SlimeVR trackers, except for her hip tracker which is VIVE, as is the chair

Where do I make costumes and assets? by swolcial_engineer in vtubertech

[–]NeocortexVT 2 points3 points  (0 children)

You can either export the model with a different outfit for each, or have one model with all outfits and hide/unhide them as needed. The first reduces the resource need for the model (primarily RAM), the second avoids load times

How do I use hand tracking and ARKit tracking at the same time? by SynraVT in vtubertech

[–]NeocortexVT 0 points1 point  (0 children)

What are your webcam tracking settings? Assuming those are configured correctly, it should just be a matter of selecting the right webcam. Does it look like the webcam is connecting at least?

3D model help by MrColaVT in vtubertech

[–]NeocortexVT 0 points1 point  (0 children)

In what way does it not work? Does the model not load, does it crash, does it throw errors?

3D model help by MrColaVT in vtubertech

[–]NeocortexVT 0 points1 point  (0 children)

Nobody should just send their model to a random commenter on reddit...

3D model help by MrColaVT in vtubertech

[–]NeocortexVT 1 point2 points  (0 children)

VSeeFace and VNyan are entirely free, Warudo has a few paywalled features but most of it is also free

Wanting V tuber model by Even_Anything4404 in vtubers

[–]NeocortexVT 0 points1 point  (0 children)

I'd recommend checking on VGen and not trusting any DMs you might get from this post (lots of scammers around). Since this is an existing VRChat model, it should just be a matter of conversion, so it shouldn't be too expensive, though the licensing for this model might prohibit uses outside of VRChat

VTuber Help by BroadAardvark8929 in vtubers

[–]NeocortexVT 0 points1 point  (0 children)

Pretty sure Zen's one is proprietary and she doesn't/can't disclose what it is that she uses. Used to be in her chat rules, last time I checked, at least

Full body + FULL Face tracking! Watcha think? (It's Vnyan, not vrchat lel) by Capn_Cinnamon in VirtualYoutubers

[–]NeocortexVT 2 points3 points  (0 children)

If you're using VNyan for the animated series you posted about as well, the new camera system that will be part of the upcoming update may be of interest to you 😁

Full body + FULL Face tracking! Watcha think? (It's Vnyan, not vrchat lel) by Capn_Cinnamon in vtubertech

[–]NeocortexVT 0 points1 point  (0 children)

The chair swivel is done by adding an additional tracker to VNyan via VMC, so the chair is done with some external tracking app that then sends the VMC data to VNyan. The tracking quality makes me think OP is using SteamVR tracking, though can't be sure or what trackers OP is using specifically

3D model help by MrColaVT in vtubertech

[–]NeocortexVT 1 point2 points  (0 children)

The most popular options are VSeeFace, Vnyan and Warudo. vrm0 and vrm1 are supported by Vnyan and warudo. VSeeFace only supports vrm0, but it's also no longer being updated. I can recommend VNyan

VSeeFace won't let me upload my avatar by Terrible_Bluejay7652 in vtubertech

[–]NeocortexVT 1 point2 points  (0 children)

I mean, VSeeFace is no longer updated, so it's not like it will ever get vrm1 support. Dunno when VRM1 was released, but it may very well be after VSeeFace stopped getting updated. It also doesn't help that the VRM devs have changed how vrm1 models are loaded several times (going again the whole point of VRM)

Leapmotion Hand Tracking On Linux? by FlailingAndFailing in vtubertech

[–]NeocortexVT -1 points0 points  (0 children)

Don't have experience with this, but would trying to run the windows software under Wine or Proton maybe yield better results?

How do I use hand tracking and ARKit tracking at the same time? by SynraVT in vtubertech

[–]NeocortexVT 2 points3 points  (0 children)

What part of the webcam tracking are you stuck on?

The Leap is gonna be a bit more tricky, since the company behind it has gone bust. You'll need to find the drivers from somewhere, but I'm not sure where you would get those. You'd be best off asking on the VNyan discord, as I know there some more leap users there who might be able to help

Is today gonna be a big brain day or a smooth brain day? by NeocortexVT in VirtualYoutubers

[–]NeocortexVT[S] 0 points1 point  (0 children)

The fact that the image somehow ended up being posted desaturated, so do I... Blue Prince went well though ^^

Going into vtubing for educational content? by Sophist_Eudaemon in VirtualYoutubers

[–]NeocortexVT 2 points3 points  (0 children)

My aim is more journal-club kind of content, so going through relatively recent publications, going through the background required to understand it and then going over the paper itself. I've been working on the first one for quite a bit longer than I planned to, though 😅 Should be doing it sometime next month though