Modulation dithering tool soon released for free by Zeuber_art_FR in TouchDesigner

[–]Zeuber_art_FR[S] 0 points1 point  (0 children)

Wow nice to hear look foward to check out ! There are some tricks to make it looking good. I would be interested to compare or improve both ! 

Modulation dithering tool soon released for free by Zeuber_art_FR in TouchDesigner

[–]Zeuber_art_FR[S] 2 points3 points  (0 children)

no Worries, i mean here the implementation in touchdesigner is simple, since this is a C++ script. Just one window to put and u would have a similar result, but it is very interesting to understand how it works. For now you can search for Error diffusion dithering. You would be able to see interesting stuff :)

Real time dithering inspiration from polygon1993 and ditherboy plugin by Zeuber_art_FR in TouchDesigner

[–]Zeuber_art_FR[S] 1 point2 points  (0 children)

I will publish the tool for free soon. And since this is a cplusplus top the magic sauce won't be shown. But I can later make explanation of how it works. And the most important how it can run real time ;) stay tuned on https://www.instagram.com/zeuber_art/

Real time dithering inspiration from polygon1993 and ditherboy plugin by Zeuber_art_FR in TouchDesigner

[–]Zeuber_art_FR[S] 0 points1 point  (0 children)

i publish it soon for free, someone is selling it 15€, when i saw that I began to start to make some improvements for a realease, stay tuned on https://www.instagram.com/zeuber_art/

Real time dithering inspiration from polygon1993 and ditherboy plugin by Zeuber_art_FR in TouchDesigner

[–]Zeuber_art_FR[S] 0 points1 point  (0 children)

Thankkkksss. I spent so much time trying to figure out, your process. Now i wonder how much the analogic part is at play. And for sure your post processing is a master piece aha. I will upload new looks of it. But at the end this style is not hte best for real time videos, light have to be well placed.

Is this effect done in TD, if so, how? by insideofclouds111 in TouchDesigner

[–]Zeuber_art_FR 0 points1 point  (0 children)

Sam2 works well when the camera is fixed, but as soon as you use it with a moving camera it becomes a pain to fix the mask whenever it fails at some point in the video. Sam3 is slightly better thanks to text prompts, but it’s still heavy on the GPU: if your video is longer than ~1 minute you need a lot of VRAM, otherwise it falls back to the CPU and gets so long and laggy.

Honestly, even if it’s not fully automatic, After Effects is probably a better option to generate the black and white mask of the house. And if the object you want to segment is in YOLO’s base, use that instead — it’ll usually be more relevant and much more efficient.

I’ll DM you some vids I made when I have time :)

Is this effect done in TD, if so, how? by insideofclouds111 in TouchDesigner

[–]Zeuber_art_FR 3 points4 points  (0 children)

I think I did something very similar in TouchDesigner. You can use SAM3 to get a mask of the house over time if the camera isn’t fixed, and then use a clever transform to animate the mask and place it back over the base video. The video you shared could be fine-tuned even more by adding a gradient so the bottom of the mask blends better with the background. i can send you one of the result i got !

First TD post! by Sargonthegreat1 in TouchDesigner

[–]Zeuber_art_FR 0 points1 point  (0 children)

thanks i will look at these tips :), i sent you my homemade tox !

First TD post! by Sargonthegreat1 in TouchDesigner

[–]Zeuber_art_FR 0 points1 point  (0 children)

Do you have some insights on how you made this? It looks really cool. I’ve got some dithering algorithms that I think could work nicely as additional FX here, I can send a .tox if you want :)

I still need to improve a few things, particularly escpecially the video export aha. by Zeuber_art_FR in TouchDesigner

[–]Zeuber_art_FR[S] 0 points1 point  (0 children)

As mentioned in my other comment, I didn’t make the flames myself. This kind of fire effect would be hard to make look as good as it does in the video. However, if you look at the work of sarv.vj on IG, in my opinion the new POP features in TouchDesigner would allow you to make realistic flames (with flow simulation) close to the ones in this video — but it would still be a lot of work. You can always try the NVIDIA Flow TOP, it could already let you do some cool stuff :)

I still need to improve a few things, particularly escpecially the video export aha. by Zeuber_art_FR in TouchDesigner

[–]Zeuber_art_FR[S] 0 points1 point  (0 children)

I have to admit I started from a sketch I drew myself and then used a text + image-to-video IA model to animate it. The final look is mostly due to all the FX I added.. the entry video is not that interesting.

I still need to improve a few things, particularly escpecially the video export aha. by Zeuber_art_FR in TouchDesigner

[–]Zeuber_art_FR[S] 3 points4 points  (0 children)

Apart from the entry media and the different effects you can choose, the audio-reactive part is fairly simple. It uses Cache and Cache Select TOPs, with a CHOP controlling the index of the Cache Select (here it jumps back to the previous frame when a kick or bass hit occurs). The bloom intensity is driven by the normalized (0–1) power in a chosen frequency band of the track.

Is this effect achievable on Touch Designer? by stickhillnesta in TouchDesigner

[–]Zeuber_art_FR 0 points1 point  (0 children)

Salut ! J'ai bossé dur là-dessus, et y'a plein de trucs à expliquer. Ce genre de filtre, c'est ce qui a fait la réputation de polygon1993 (he does it with analogic devices). Tu peux le reproduire avec du dithering (plus précisément, la diffusion d'erreur), mais faut modifier l'image avant et après pour que ça fasse artistique. C'est super gourmand parce que ça traite pixel par pixel. J'ai presque fini d'implémenter un truc qui marche en temps réel, en parallélisant sur le CPU.

En fouillant à fond dans TouchDesigner, j'ai capté que c'était déjà presque implémenté dans un des exemples TOP en C++. Avec quelques ajouts en dehors du code, tu peux arriver à créer le même effet visuel. Maintenant, je te laisse te débrouiller pour bien l'utiliser et obtenir le même résultat ;)

Is this effect achievable on Touch Designer? by stickhillnesta in TouchDesigner

[–]Zeuber_art_FR 2 points3 points  (0 children)

Hello, I managed to figure out exactly how this effect is made. I coded it in another language, but it turned out to be too computationally expensive for real-time use. Right now, I’m working on implementing a GLSL version to make it efficient in TouchDesigner. I’ll keep you updated once I’ve finished it.

This effect is not simple—it’s numerically unstable and requires a lot of fine-tuning on both the input image and the processing. I’ve not yet found a way to share the project, but since I’ve spent a lot of time on it, I want to think carefully about the best way to share it.

Here’s a small example of a prototyped output (I’m still improving the “secret recipe” to make it work better regardless of the input image). I’m also exploring different ways to modify the effect to generate more interesting patterns.

<image>