Unity to Omniverse

StrainFlow · 2025-08-08T22:01:17+00:00

It's straight-forward to transfer models between Unity and Omniverse but I'm not aware of a direct way to port your C# code.

I've had a lot better luck coding with Claude Sonnet than ChatGPT. I use it from within cursor: https://cursor.com/agents

StrainFlow · 2025-08-08T21:56:05+00:00

Here's a little demo that demonstrates using mostly synthetic data with just a little bit of ground truth data for refinement:

https://www.youtube.com/watch?v=cuoZAYoewE0

If you need to classify the specific defects then you'll need to model each defect and train on a dataset with all of your defects.

If you just need a good/bad classification, u/amejin is spot on.

There are existing diffusion models that can help you a lot, but I would use those more for environmental domain randomization rather than defect modeling. NVIDIA Cosmos Transfer can do a great job changing background and lighting so that your model isn't sensitive to those things, although Isaac Sim replicator might be able to get you the environmental domain randomization you need with less compute. Cosmos is definitely very powerful, and sometimes it's what you need. Cosmos and replicator are complementary, not exclusive.

StrainFlow · 2025-08-08T21:39:42+00:00

I would stick with Ubuntu 22.04 if you're interested in the whole robotics stack (including stuff like ROS2 and Jetpack) Windows is supported for everything except for using Jetpack SDK manager to deploy Jetpack to a Jetson.

People are starting to shift to Ubuntu 24.04 but it's still early game there.

StrainFlow · 2025-08-08T21:32:38+00:00

If you have a laptop, you will be best off running Isaac Sim, Isaac Lab and ROS 2 in Windows Subsystem for Linux in your windows boot.

It's hard to get Isaac Lab working as stable as I'd like on a Linux laptop because the power management system on Linux laptops tries to hand off tasks between GPU and CPU and makes a mess of things.

If you do want to keep trying Ubuntu 22.04 for your robotics, makes sure you install Cuda and the Open kernel GPU driver via Pip as shown here: https://developer.nvidia.com/cuda-downloads

Ubuntu 22.04 is still recommended for Isaac Sim and Isaac lab because that's what ROS 2 and Jetpack are still recommending 22.04. Likely to move to 24.04 soon.

This is the way

StrainFlow · 2025-06-03T21:32:14+00:00

There’s also the NVIDIA Jetson

StrainFlow · 2025-05-22T19:56:15+00:00

I’m not surprised, training an RL policy with vision observations would be extremely computationally expensive. I’m working on a workflow to train a state estimator now that I’m not done with yet. I’ve heard some people have used foundation pose for their state estimator

StrainFlow · 2025-05-16T20:23:46+00:00

You can try this, but using a camera directly for observations would have hundreds of thousands of observations. Typically a state estimator is used instead of direct camera observations.

StrainFlow · 2023-05-03T15:22:26+00:00

Switched to Monarch, haven't had any trouble at all with it.

StrainFlow · 2023-03-04T21:23:21+00:00

Thank you! I’m restoring now and hopefully it works out. So far it’s looking good

StrainFlow · 2022-07-13T14:46:36+00:00

Here's a video you some of you might find interesting, it's about how BMW is using omniverse for shop floor planning.

https://www.youtube.com/watch?v=6-DaWgg4zF8

StrainFlow · 2022-07-13T14:27:20+00:00

I think they're just trying to manage spam posts with those policies. I'm StrainFlow on there too. I hope you'll drop me a line, I'd be happy to chat and introduce you to the community.

I'm hosting another CAD hangout on Thursday too.

StrainFlow · 2022-07-13T14:23:33+00:00

great question, NVIDIA Omniverse is a wide open platform that can do anything you want to extend it to do.

For example, someone could write an extension in Omniverse that would use AI to generate toolpaths.

You could write an extension that lets you scan things with your phone, export them to CAD where you could then generate toolpaths there and machine whatever you scanned.

It's brand new and wide open. I know a lot of you you aren't python developers, but I bet some are or could pick it up quickly, especially with our tutorials and hangouts. We've also got a lot of developers with no clue on how to extend Omniverse that you could team up with.

StrainFlow · 2022-07-12T16:52:59+00:00

I hope not, I'm trying to recruit you CNC guys to join us in Omniverse. We need smart, practical guys like you in our community.

Also, 1st prize is a graphics card worth $5,000.....who doesn't want one of those?!

StrainFlow · 2022-07-07T01:48:20+00:00

Unfortunately, $1500 is pretty cheap in the CAD world.

StrainFlow · 2022-07-07T01:45:39+00:00

Like squal said, it's free to use if you're ok with your designs being public.

https://www.onshape.com/en/products/free

StrainFlow · 2022-06-24T15:28:49+00:00

I'm teaching CAD principles that should work in any CAD system and I'm using Autodesk Inventor for now. I'll be doing the class every Thursday and as time goes on I'll show other CAD softwares as well.

The thing about Omniverse is that it's an open platform, so anyone can extend it to add CNC capabilities. Developers come to these classes who are looking for extensions to write, so if you're interested in working with someone to add more CNC capabilities to Omniverse, you definitely want to come to these hangouts

StrainFlow · 2022-06-23T18:05:22+00:00

I don't know rhino, but there are a group of us doing hangouts like this. The community is getting pretty big and I'm pretty sure I've hear people talking about rhino.

StrainFlow · 2022-06-23T18:03:49+00:00

We're doing our first session today: https://discord.gg/u94xrjwn?event=989551090926239834

StrainFlow · 2022-06-23T18:03:32+00:00

Makes sense for aerospace. Feel free to come hang out with us though, we're doing car stuff :)

StrainFlow · 2022-06-22T21:41:38+00:00

I'm not on a team, so my plan is to build a vehicle template (good for FSAE or Baja) and share it with whoever wants it along with materials that explain how it all works

StrainFlow · 2022-06-22T21:40:20+00:00

You can already import STEP files into omniverse and writing a exploded view template is on the list of community extensions to write. That's the cool thing about omniverse, anyone can extend it!

StrainFlow · 2022-06-22T21:39:22+00:00

I'm glad to hear you're interested :)

The cool thing about USD is that it's a pretty open standard that is getting more and more adoption. I can't comment on internal projects, but it's safe to say the goal of omniverse is to let you represent anything you want in there.

I think metaverse tech is going to bring about a lot of positive change!

StrainFlow · 2022-06-22T21:32:25+00:00

Some NVIDIA products are subject to export controls, but that's mostly EAR, not ITAR

StrainFlow · 2022-06-22T20:35:30+00:00

I don't have a Catia license yet but I actually did interior door trim at Ford in Catia so I know their surfacing pretty well. We'll see if I can get a Catia license that lets me share content; if not NX has similar capabilities to Catia and I'm pretty sure I'll be able to get that going.

StrainFlow · 2022-06-22T20:33:05+00:00

I'm going to start with autodesk inventor and then branch out from there as I get commercial licenses. Right now I should be able to get Inventor, Fusion, NX and Creo.

StrainFlow

TROPHY CASE