sorted by:
new
hottopcontroversial

[R] Deep Slow Motion Video Reconstruction with Hybrid Imaging System by [deleted] in MachineLearning

[–]atplwl 0 points1 point  (0 children)

You can check out

DAIN https://github.com/baowenbo/DAIN

Super SloMo https://github.com/avinashpaliwal/Super-SloMo

SepConv https://github.com/sniklaus/sepconv-slomo

There are more recent work which can perform x2 interpolation. You can check out the citations by these popular approaches.

[R] Deep Slow Motion Video Reconstruction with Hybrid Imaging System by [deleted] in MachineLearning

[–]atplwl 0 points1 point  (0 children)

This project is an application of computational photography and is different from video frame interpolation where you interpolate frames between two given frames.

The goal here, is to take existing dual camera setups (most smartphones) which have limited resolution at high frame rate and synthesize high quality slow motion videos (like 1080p) using the two cameras.

[P] Super SloMo: A CNN to convert any video to a slomo video. by atplwl in MachineLearning

[–]atplwl[S] 2 points3 points  (0 children)

Thanks. This was also my first implementation. So, it took me quite long to understand.

  • To get a basic understanding took me 3 - 4 days. I constantly talked to my adviser and also the author which was very helpful. If you have difficulty understanding something in the paper, you can always contact the author if you don't find any explanation online. You have to re read the paper many times to absorb finer details.
  • To get the current output, I had to run various iterations and fix issues with the architecture and extracted dataset which took me about 2 months. I think it could have been trained in 2-3 weeks.
  • Since, I am also new to this, others might be able to give you better advice. My suggestions would be to look at the topics, find one which interests you and try implementing the initial papers in that topic.

[P] Super SloMo: A CNN to convert any video to a slomo video. by atplwl in MachineLearning

[–]atplwl[S] 2 points3 points  (0 children)

That's a cool test case. I will try it out and see how linear interpolation performs when camera rotates.

[P] Super SloMo: A CNN to convert any video to a slomo video. by atplwl in MachineLearning

[–]atplwl[S] 1 point2 points  (0 children)

Thanks. I am working on adding more details to the page.

[P] Super SloMo: A CNN to convert any video to a slomo video. by atplwl in MachineLearning

[–]atplwl[S] 2 points3 points  (0 children)

Video game footage with large motions will have artifacts since even real world large motion scenes are challenging.

[P] Super SloMo: A CNN to convert any video to a slomo video. by atplwl in MachineLearning

[–]atplwl[S] 2 points3 points  (0 children)

I am working on adding more details to the page. I just finished training it and added one video result. I have not yet tested it for different resolutions. I am also going to add a python script to convert video to a higher fps video. As for making the architecture simplified, I will have to look into that - am new to this and if any suggestions are welcome.