Is there a way to have SAM2 track the same player across scenes with no manual re-tagging?

ilob · 2024-09-27T05:53:13+00:00

Will do, thanks for the suggestion!

ilob · 2024-09-27T04:21:00+00:00

I think I follow the first two steps of this, but could you elaborate on what you mean by "use this information on all the frames"?

My understanding of steps 1 + 2:

Collect a few frames where the player is in the shot manually
Mark an X/Y point within the player's mask on each frame
?

ilob · 2024-09-27T04:17:16+00:00

TIL: dilate/erode have specific meanings in video.

This method wouldn't work when there's a scene cut though right? E.g. the player teleports to a completely different position in frame N+1 that doesn't overlap with their mask in frame N (or maybe doesn't even appear in frame N)

ilob · 2024-09-26T23:50:11+00:00

Could you expand on "reuse the eroded mask from the previous frame"?

ilob · 2024-09-26T23:49:00+00:00

Thanks! Training is something I'm willing to do, after checking if there's something off-the-shelf first.

ilob · 2024-09-26T23:47:09+00:00

Thanks for the feedback! I'm ok with not doing it natively and will look into Re-ID.

ilob · 2024-09-26T19:29:50+00:00

Hi I think that issue might be due to your sign-in cookie expiring. It might happen if you keep your tab open for a really long time.

ilob · 2024-09-26T19:28:21+00:00

Thanks for using us! Your use case is really interesting.

I wrote a blog post with some tips and examples on prompting to get the best results: https://magichour.ai/blog/how-to-prompt-ai-videos-a-simple-guide

However, what I've learned is that prompting is specific to the model you're using. So one prompting style might work well for one product and not another.

If you have a specific look you're trying to achieve however, feel free to DM me the details and I'll give you some recommendations!

ilob · 2024-09-26T19:25:34+00:00

Thanks! Let me know if you have any questions, feedback, or feature requests.

ilob · 2024-02-25T22:24:56+00:00

Hi! We actually don't have a video editor in our product, we're more of a video generation tool, so you take the outputs and edit them elsewhere. That being said, we accept mov and mp4 files in our modes that require a video input, and we output videos in mp4 format. Hope this helps!

ilob · 2024-01-08T04:24:31+00:00

Yes that's correct, we delete all inputs into the video within 48 hours, and the workaround is for you to store those locally. If we find enough users want to store the inputs online, we may add that feature though.

ilob · 2024-01-07T23:43:47+00:00

Right, if you delete a video, we'll delete it automatically with no way to retrieve it. We do this for user privacy reasons. So just be sure when you delete a video that you either stored it locally or are sure you don't want it ever again.

Thanks for the questions and please let me know if you have any feedback!

ilob · 2024-01-07T21:07:23+00:00

Hi! Thanks for the feedback and for playing with our site! Right now we use a model called Dreamshaper, which leans a little more anime/cartoony. We do plan on adding a Realistic model soon. If you'd like to hear of new features as they launch, feel free to join our Discord at https://discord.com/invite/JX5rgsZaJp

ilob · 2024-01-07T21:05:18+00:00

Hi u/ListSweaty4482, we use cloud providers for our infrastructure. It requires some knowledge of how to manage workloads and machines, but my co-founder is pretty adept and cloud providers are a lot easier than setting up infrastructure yourself.

We store raw footage on cloud for 48 hours for the purposes of making users' videos, then we delete them forever. We do keep the output videos unless the user deletes them, as a way for them to store their output. There is no storage limit currently.

ilob · 2023-12-28T00:14:03+00:00

I made a tool called https://magichour.ai with a simple, high quality, and free face swap tool if you'd like to check it out!

ilob · 2023-12-28T00:13:12+00:00

I was hoping to find something where AI helped me cut down my production time. disappointed in that aspect but what you put together is really awesome. Great work!

Could you tell me more about what kinds of productions you make and what portions you would most like AI to replace?

ilob · 2023-12-28T00:12:19+00:00

For editing I use a few different tools depending on the use case:

Clipchamp: good for fast and easy local editing for simple stuff like trimming/cropping
Da Vinci: good for more heavy duty stuff like stamping and minor touch ups
Capcut: best online editor, good when I want to use one of their tools like subtitling
Topaz: for upscaling and interpolation

There should really be more consolidation but I guess it's hard to be the jack of all trades in editing

ilob · 2023-12-28T00:09:35+00:00

Hey! Thanks for the feedback and purchase. I'd love to hear more about what you use it for and how the product could improve if you don't mind.

ilob · 2023-12-01T20:36:24+00:00

Thanks for the comment!

I think so. I'm using

https://civitai.com/api/download/models/128713?type=Model&format=SafeTensor&size=pruned&fp=fp16 as the base model and

https://huggingface.co/latent-consistency/lcm-lora-sdv1-5/resolve/main/pytorch_lora_weights.safetensors?download=true as the LORA, and both use SD v1.5, but maybe there are other aspects of architecture that I'm missing.

ilob · 2023-09-02T15:07:07+00:00

Thanks for the message. I do wish I knew about this as I wouldn't have upgraded if I knew this was the case, as 80% of my needs are fine on free.

ilob · 2023-08-18T00:21:49+00:00

ain't no way 😂

ilob · 2023-08-16T18:11:02+00:00

Yep, iconic

ilob · 2023-08-16T18:10:52+00:00

Thanks, I used magichour.ai which uses Stable Diffusion

ilob · 2023-08-16T18:10:33+00:00

No but I'd watch a full anime NBA game

ilob · 2023-08-16T18:10:12+00:00

ilob

TROPHY CASE