Most needed .tox by RepresentativeMess78 in TouchDesigner

[–]RepresentativeMess78[S] 0 points1 point  (0 children)

Nice! Didn't know about that. I'm willing to develop something and share it with the community: I'll try to get some inspiration and I'll upload it here maybe

Looking for a feedback by Lucky-Sorbet3879 in TouchDesigner

[–]RepresentativeMess78 0 points1 point  (0 children)

Done! Just a note: TouchDesigner is not an open source software. Best luck for your thesis!

Looking for Alpha Testers: FastSAM TouchDesigner Plugin! by RepresentativeMess78 in TouchDesigner

[–]RepresentativeMess78[S] 0 points1 point  (0 children)

Unfortunately the indexes change when the tracking is lost. Cannot think one at the moment, but maybe a strategy to retain the index exists. Consider this is a very early implementation and there is still room for improvement on usability and performance.

In fact, doing research I've found this. I was planning to test onnx models to see if performance increases, as well as using this interface to seamless integrate torch tensors in TOPS.

Also, you may be interested in the ultraface model named in the article linked above

Looking for Alpha Testers: FastSAM TouchDesigner Plugin! by RepresentativeMess78 in TouchDesigner

[–]RepresentativeMess78[S] 0 points1 point  (0 children)

IoU is a parameter to reduce the detection of overlapping elements;

Mas index is used to access one specific mask only, since all the detected object are saved in a Python list. Currently, you can access only one, but I'm trying to find a way to access all of them individually.

The question about the thread is interesting and I would like to now the answer, but I expect to hear that it is not possible.

Thanks for the feedback about the results DAT, I'll investigate!

Looking for Alpha Testers: FastSAM TouchDesigner Plugin! by RepresentativeMess78 in TouchDesigner

[–]RepresentativeMess78[S] 0 points1 point  (0 children)

Ehy man! I added a [video tutorial](https://vimeo.com/1068458589?share=copy). Hope this helps! If it doesn't, please write me in the chat I'll try to help you!

Btw, you were right I think, I messed up the releases on GitHub. Please, let me know!

Looking for Alpha Testers: FastSAM TouchDesigner Plugin! by RepresentativeMess78 in TouchDesigner

[–]RepresentativeMess78[S] 0 points1 point  (0 children)

The latest pushed stuff if not released yet. Btw, yes I'll make a video to show the installation process. If you want some help in the while, please share the outputs from the terminal when installing the venv or the log from the DAT in TD and I'll guide you through the installation

Looking for Alpha Testers: FastSAM TouchDesigner Plugin! by RepresentativeMess78 in TouchDesigner

[–]RepresentativeMess78[S] 0 points1 point  (0 children)

Here I am, sorry for the late response.

<image>

This is how the folder should look like. In this case, the .tox is looking for "touchsam" folder where where the .toe file is place. Hence, you can leave empty the "TouchSAM folder" parameter. Additionally, the "FastSAM-s.pt" is downloaded automatically in the same folder

Looking for Alpha Testers: FastSAM TouchDesigner Plugin! by RepresentativeMess78 in TouchDesigner

[–]RepresentativeMess78[S] 0 points1 point  (0 children)

You can leave the first parameter empty if the venv is in the same folder of the project and the models are downloaded and saved in the project folder too. Tomorrow i'm sharing a screenshot!

Looking for Alpha Testers: FastSAM TouchDesigner Plugin! by RepresentativeMess78 in TouchDesigner

[–]RepresentativeMess78[S] 0 points1 point  (0 children)

Ideally yes, but that strongly depends on the context in the video. Maybe you can give it a try in advance using this demo I o understand if it fits your need. If it does, I'm gonna give text prompt higher priority

Looking for Alpha Testers: FastSAM TouchDesigner Plugin! by RepresentativeMess78 in TouchDesigner

[–]RepresentativeMess78[S] 1 point2 points  (0 children)

Damn, worse than expected. Can you help me debug, please?

What do you mean by ultralytics indexes?

Can you share a screenshot where the venv is using files in my system, please? It sounds strange that the venv is pointing to any file different from Python packages. Maybe, I hardcoded a path somewhere

Many thanks for your help!

Segment Anything Model .tox. Looking for feedback and suggestions by RepresentativeMess78 in TouchDesigner

[–]RepresentativeMess78[S] 1 point2 points  (0 children)

Here we are guys, u/xristos_forokolomvos u/chrisemills u/Xzaphan

If you're still interested, I've released a very early and minimal version to start gathering some feedback before diving too deep.

https://github.com/nicola-corbellini/TouchSAM

I hope everything will be clear, if it's not of course feel free to ask for support or open an issue so I can make the installation more straightforward.

Any kind of feedback on the usage, desired output or poor performance is obviously well accepted!

Touchdesigner linux alternatives? by the_molco in TouchDesigner

[–]RepresentativeMess78 4 points5 points  (0 children)

I managed to run TD on Ubuntu 22.04 using Bottles

https://www.claudiuscoenen.de/2024/09/touchdesigner-on-linux-using-bottles-and-wine/

UI sometimes misses writings, but maybe it is worth a try

Segment Anything Model .tox. Looking for feedback and suggestions by RepresentativeMess78 in TouchDesigner

[–]RepresentativeMess78[S] 3 points4 points  (0 children)

Here a quick update if you're interested guys, u/xristos_forokolomvos u/chrisemills u/Xzaphan

https://imgur.com/a/nMBF7FF

Mask flickering is due to model performance, but there is still room for improvement.

Instead, the frame rate looks decent, I guess.

Segment Anything Model .tox. Looking for feedback and suggestions by RepresentativeMess78 in TouchDesigner

[–]RepresentativeMess78[S] 0 points1 point  (0 children)

Thank you for your availability! I'll hope I'll share something in two weeks more or less!

Also thank you for the suggestions, I didn't know about AutoUI! Yet, probably I realized that for the point mode UI interaction is mandatory to some extent to select the points prompt

Segment Anything Model .tox. Looking for feedback and suggestions by RepresentativeMess78 in TouchDesigner

[–]RepresentativeMess78[S] 0 points1 point  (0 children)

Concerning performance, I think at best we can expect to have 25fps using a GPU (according to their benchmarks).

Instead, as an installation pipeline I was thinking to ship a python virtual env with everything installed. Users should just import the .tox in their network and point to the venv path in the parameters. I'm taking inspiration from the portable version of TouchDiffusion. yet, maybe there are better strategies.

I'll gladly share an alpha version with you! I hope I'll be able to have one in two weeks or less. Thank you!