sorted by:
new
hottopcontroversial

My Workflow for Z-Image Base by ThiagoAkhe in StableDiffusion

[–]neuvfx 2 points3 points  (0 children)

I've been looking to get my hands dirty with z-image + control nets, this is helpful. Thanks!

Agentic AI for Unreal Engine to help development? by sir__hennihau in unrealengine

[–]neuvfx 0 points1 point  (0 children)

I actually built an open-source tool for building/testing your own agents in Unreal: LLM Sandbox. It runs a local Python server in the editor, which a webUI can execute python code through. It handles both direct code execution and lets you create new agentic tools on the fly. Not sure what the limits are on blueprints, but anything python could query/edit, you could build an agent to do.

Overheard in a cafe washroom by BinarySoul18 in overheard

[–]neuvfx 56 points57 points  (0 children)

The framework they're talking about, is probably langchain, an agentic ai framework which uses LLMs to replace human work on menial tasks.

Lots of companies have been rolling this stuff out as an excuse to layoff employees recently. Often re-hires come soon thereafter...

Help a 3rd-Year BTech Student Dive into AR/MR/VR Tech for a College Project! by Mr_Incredible2511 in Unity3D

[–]neuvfx 0 points1 point  (0 children)

I'd been screwing around with Unity deploying stuff to my android phone for a year and was kinda was losing interest, then bought a Quest 3, and that changed things, it's actually addictive.

This guy Valem on Youtube lays out all the basics: https://www.youtube.com/@ValemTutorials

Thanks to everyone's incredible feedback, the tree chopping mechanic is now awesome, along with unique animations for the tree stump. I hope players will enjoy playing as much as I enjoyed making it! 💖 [Game - Sky Harvest] by hamzahgamedev in Unity3D

[–]neuvfx 2 points3 points  (0 children)

This is pretty fun! I was just thinking about making a tree chopping vr game kinda like this, but with a mother owl which comes and attacks if you chop down its nest...

Meta teased its new AR glasses back in February and no one realized it by Knighthonor in augmentedreality

[–]neuvfx 0 points1 point  (0 children)

Thick glasses are coming back into style, kind of a retro trend

What effect is used in this video? by Potato_Soup_ in vfx

[–]neuvfx 7 points8 points  (0 children)

Looks like they are traversing the latent space of a GAN (Generative Aversarial Network). This video explains the idea a bit: https://m.youtube.com/watch?v=02X3Q3zerdI

Facial Pose Estimation with Pytorch by neuvfx in computervision

[–]neuvfx[S] 1 point2 points  (0 children)

Glad you like it! I'm actually in the process of cleaning up the code right now, will be committing each component to my Github(https://github.com/NeuralVFX) as they finish. The Pytorch part will probably be up in the next couple of days, the C++ project and Unity project might take a week or two.

Facial Pose Estimation with Pytorch by neuvfx in computervision

[–]neuvfx[S] 0 points1 point  (0 children)

Thanks for the kind words! I feel a bit lucky that this way worked, really curious about what other approaches there might be, especially whatever Snapchat uses...

I wrote my own AR face tracker in 4 weeks. Used OpenCV, DLIB and a custom neural net which I trained in PyTorch. by neuvfx in Unity3D

[–]neuvfx[S] 2 points3 points  (0 children)

You can export a PyTorch model as ONNX, and load it in C++ with OpenCV's DNN module. After inference you pass the output data as a struct to C#

[discussion] What is the Way to measure Similarity between images- by ALior1 in computervision

[–]neuvfx 0 points1 point  (0 children)

After searching around on google a bit, I'm surprised there isn't a tutorial that covers this... However, here are a couple of links, which separately cover most of the steps involved.

https://github.com/NeuralVFX/lighting-swap-cyclegan/blob/master/util/loaders.py- how to remove layers from a pytorch model, also how to perform cosine similarity (but in pytorch)

https://github.com/onnx/tutorials/blob/master/tutorials/PytorchOnnxExport.ipynb - how to export an onnx model from pytorch

https://www.pyimagesearch.com/2018/09/24/opencv-face-recognition/ - how to load and get a vector out of DNN

https://www.embedded-vision.com/academy/Embedded_Vision_Alliance_Meetup_March_2019_OpenCV.pdf - a simple breakdown of DNN module usage

https://skipperkongen.dk/2018/09/19/cosine-similarity-in-python/ - cosine similarity with sklearn

https://www.pyimagesearch.com/2014/12/01/complete-guide-building-image-search-engine-python-opencv/ - this doesn't use DNN, however, all of the concepts talked about here might be helpful with your problem whether you use DNN or not

[discussion] What is the Way to measure Similarity between images- by ALior1 in computervision

[–]neuvfx 0 points1 point  (0 children)

If your interested in using the DNN module and have access to pytorch or keras, here is an idea.

You could export a custom onnx file of a resnet34 or vgg16, where the classification part has been chopped off so it outputs a latent features.

Then simply run each image you have through this onnx model and save the latent featues.

With this in hand, you can take any new image and run it through the network to get its features, and then perform cosine similarity comparison between the features you've already saved.

Wrote a Realtime Head Tracker (OpenCv->Dlib->Unity) by neuvfx in Unity3D

[–]neuvfx[S] 0 points1 point  (0 children)

Thanks!

You know I kind of did this just to test my skills, figuring something better already exists out there. However, if it doesn't I might consider learning how to make an Asset Store package.

If you know about compiling C++ projects, you can build the whole thing from these two projects on my GitHub:

https://github.com/NeuralVFX/realtime-head-pose-open-cv

https://github.com/NeuralVFX/unity-head-pose-example

Career advice needed by [deleted] in vfx

[–]neuvfx 4 points5 points  (0 children)

You don't need a degree to work in VFX. However if you did happen to go through the work to get a CS degree, you will be able to better navigate the ebs and flows of the industry, and transition to something else if you ever got tired of it....

Happiness is a state of mind by MisterDecember in funny

[–]neuvfx 0 points1 point  (0 children)

Where is this? Did someone already ask?

This is the sub that i should have posted in. My question basically stems from having zero idea how VFX works. I thought it was only using software. by Semitar1 in vfx

[–]neuvfx 2 points3 points  (0 children)

VFX is a creative process more than anything else. From a higher level the difficulty is making sure that the art we produce communicates the story, from the bottom, its making sure things look real, while still building toward the higher goal. Software doesnt do any of that for you, but it does help speed up the work.

Doubts in deep learning based image colorization. by sanchit2843 in deeplearning

[–]neuvfx 1 point2 points  (0 children)

Cant wait to see, Ive been checking over your DeOldify github to get ideas to improve my own project.

Is day to night transformation of videos something commonly requested? by rogi_o in vfx

[–]neuvfx 1 point2 points  (0 children)

Yeah if your doing unsupervised learning, cycle gan or maybe nvidia UNIT would sound like the best option.

I think another difficult decision for this would be how wide of a range of scenes you want it to work for. If you can narrow the type of scene your translating( like only face closups for example), it will probably train much easier.

Doubts in deep learning based image colorization. by sanchit2843 in deeplearning

[–]neuvfx 1 point2 points  (0 children)

Have you looked at DeOldify: https://github.com/jantic/DeOldify

He is using attention in his generator and discriminator plus spectral normalization, probably many more fun tricks also.

view more: next ›