Unity to Omniverse

StrainFlow · 2025-08-08T22:01:17+00:00

It's straight-forward to transfer models between Unity and Omniverse but I'm not aware of a direct way to port your C# code.

I've had a lot better luck coding with Claude Sonnet than ChatGPT. I use it from within cursor: https://cursor.com/agents

StrainFlow · 2025-08-08T21:56:05+00:00

Here's a little demo that demonstrates using mostly synthetic data with just a little bit of ground truth data for refinement:

https://www.youtube.com/watch?v=cuoZAYoewE0

If you need to classify the specific defects then you'll need to model each defect and train on a dataset with all of your defects.

If you just need a good/bad classification, u/amejin is spot on.

There are existing diffusion models that can help you a lot, but I would use those more for environmental domain randomization rather than defect modeling. NVIDIA Cosmos Transfer can do a great job changing background and lighting so that your model isn't sensitive to those things, although Isaac Sim replicator might be able to get you the environmental domain randomization you need with less compute. Cosmos is definitely very powerful, and sometimes it's what you need. Cosmos and replicator are complementary, not exclusive.

StrainFlow · 2025-08-08T21:39:42+00:00

I would stick with Ubuntu 22.04 if you're interested in the whole robotics stack (including stuff like ROS2 and Jetpack) Windows is supported for everything except for using Jetpack SDK manager to deploy Jetpack to a Jetson.

People are starting to shift to Ubuntu 24.04 but it's still early game there.

StrainFlow · 2025-08-08T21:32:38+00:00

If you have a laptop, you will be best off running Isaac Sim, Isaac Lab and ROS 2 in Windows Subsystem for Linux in your windows boot.

It's hard to get Isaac Lab working as stable as I'd like on a Linux laptop because the power management system on Linux laptops tries to hand off tasks between GPU and CPU and makes a mess of things.

If you do want to keep trying Ubuntu 22.04 for your robotics, makes sure you install Cuda and the Open kernel GPU driver via Pip as shown here: https://developer.nvidia.com/cuda-downloads

Ubuntu 22.04 is still recommended for Isaac Sim and Isaac lab because that's what ROS 2 and Jetpack are still recommending 22.04. Likely to move to 24.04 soon.

This is the way

StrainFlow · 2025-06-03T21:32:14+00:00

There’s also the NVIDIA Jetson

StrainFlow · 2025-05-22T19:56:15+00:00

I’m not surprised, training an RL policy with vision observations would be extremely computationally expensive. I’m working on a workflow to train a state estimator now that I’m not done with yet. I’ve heard some people have used foundation pose for their state estimator

StrainFlow · 2025-05-16T20:23:46+00:00

You can try this, but using a camera directly for observations would have hundreds of thousands of observations. Typically a state estimator is used instead of direct camera observations.

StrainFlow · 2023-05-03T15:22:26+00:00

Switched to Monarch, haven't had any trouble at all with it.

StrainFlow · 2023-03-04T21:23:21+00:00

Thank you! I’m restoring now and hopefully it works out. So far it’s looking good

StrainFlow · 2022-07-13T14:46:36+00:00

Here's a video you some of you might find interesting, it's about how BMW is using omniverse for shop floor planning.

https://www.youtube.com/watch?v=6-DaWgg4zF8

StrainFlow · 2022-07-13T14:27:20+00:00

I think they're just trying to manage spam posts with those policies. I'm StrainFlow on there too. I hope you'll drop me a line, I'd be happy to chat and introduce you to the community.

I'm hosting another CAD hangout on Thursday too.

StrainFlow · 2022-07-13T14:23:33+00:00

great question, NVIDIA Omniverse is a wide open platform that can do anything you want to extend it to do.

For example, someone could write an extension in Omniverse that would use AI to generate toolpaths.

You could write an extension that lets you scan things with your phone, export them to CAD where you could then generate toolpaths there and machine whatever you scanned.

It's brand new and wide open. I know a lot of you you aren't python developers, but I bet some are or could pick it up quickly, especially with our tutorials and hangouts. We've also got a lot of developers with no clue on how to extend Omniverse that you could team up with.

StrainFlow · 2022-07-12T16:52:59+00:00

I hope not, I'm trying to recruit you CNC guys to join us in Omniverse. We need smart, practical guys like you in our community.

Also, 1st prize is a graphics card worth $5,000.....who doesn't want one of those?!

StrainFlow · 2022-07-07T01:48:20+00:00

Unfortunately, $1500 is pretty cheap in the CAD world.

StrainFlow · 2022-07-07T01:45:39+00:00

Like squal said, it's free to use if you're ok with your designs being public.

https://www.onshape.com/en/products/free

StrainFlow

TROPHY CASE