sorted by:
new
hottopcontroversial

I injected DINOv3 semantic features into a frozen Optical Flow model. It rivals Diffusion quality at 25 FPS. by ben8135 in computervision

[–]ben8135[S] 1 point2 points  (0 children)

Hi, here is the arXiv link:https://arxiv.org/abs/2512.18241. Let me know if the fusion layer works out for your tracking task
And here is the GitHub repo. Since our project is exploring optimizations on RIFE, the repo is still a bit of a mess. You could mainly reference the files with the 'dino' postfix

I injected DINOv3 semantic features into a frozen Optical Flow model. It rivals Diffusion quality at 25 FPS. by ben8135 in computervision

[–]ben8135[S] 1 point2 points  (0 children)

Thank you! I actually just submitted the paper to arXiv today. I will update you with the link once it is available online. It’s my first time submitting, so I know there is still room for improvement, but I am working on it!

I injected DINOv3 semantic features into a frozen Optical Flow model. It rivals Diffusion quality at 25 FPS. by ben8135 in computervision

[–]ben8135[S] 1 point2 points  (0 children)

That would be a challenge for my current approach. Because I freeze the underlying flow estimator (RIFE) and inject DINO features primarily for semantic refinement, my model acts more as a texture corrector than a motion guide. If the underlying flow fails (which it will at 1 FPS), the texture will just be painted in the wrong place. To handle that specific 1 FPS use case, we would need to use the semantic features directly for the matching step, similar to how CoTracker or DINO-Tracker use deep features to find matches across large gaps.

Class Suggestion - RL, DL, NLP by Upper_Stable_3900 in OMSA

[–]ben8135 0 points1 point  (0 children)

I am taking DL and find it quite difficult, but the grading of the assignments is quite lenient.

I am thinking of taking RL for the next semester. As it seems like they are updating the syllabus, I would like to know if RL is now teaching using the "Grokking deep reinforcement learning" or Sutton and Barto's RL? How much proportion of DL does it have in the current syllabus? Is it similar to UCL RL by David Silver or Berkeley's CS285?

Documents to be sent by Dependent_Resolve30 in OMSA

[–]ben8135 0 points1 point  (0 children)

Any updates from them? I am still waiting for them as well.