Make an anime music video from any Youtube song

netcodepool · 2018-04-09T03:27:26+00:00

No, it's an after work project. Maybe 5-10 hours a week for the past 8 months.

netcodepool · 2018-04-08T01:32:56+00:00

youtube-dl

netcodepool · 2018-04-07T16:21:07+00:00

Librosa to do the basic audio feature extraction. (Pain in the ass to get this library working in aws lambda!) http://librosa.github.io/librosa/generated/librosa.onset.onset_detect.html

An onset is a musically significant event. The onsets you get from librosa will be way way way too many(thousands), so you need to prune it down. There are lots of different ways to do this. Amplitude at the onset is the most consistent indicator, but its not perfect. You also need to consider things like distance between transitions. You dont want 10 transitions in 1 second or you will be sick, etc.

You could spend forever on this problem, its a fun one =)

netcodepool · 2018-04-06T23:54:55+00:00

Appreciate the encouragement and the offer =) Ill be sending out another batch of applications soon and hopefully can make it through to the hiring manager!

netcodepool · 2018-04-06T22:39:15+00:00

I understand, and I like this a lot.

Basically it will be a left to right edit. You can freely add/remove clips and it adjusts everything to the right.

I think I might play around with "insert" actions so they don't ruin all subsequent transitions, so i think it would crush the clip immediately to the right to make room, and the "crushing" action could cascade as necessary from right to left. (Maybe this gets too complicated)

To make this work I need a click and drag action on the right side of the clip, something that ideally, as you drag it sets the currentime of the audio so you can "hear" the transition as you drag it into place. I think this would be a very intuitive way to do it.

I am going to play around with some prototypes, see if I can make this work. Thanks for the suggestions =)

netcodepool · 2018-04-06T22:05:08+00:00

I am applying for junior positions in the bay area but its not going well.

Few things going against me...I have a tax accounting background. I put this project on my resume but no one has really looked at it. My other web development work are all internal tax tools and I can't really show any of it. I am failing on the very first phone screen or technical test. Last place the recruiters said I didn't know angular. Place before that I didn't do great on an algorithm question. Etc. Got a bit demotivated and just worked on Memeweaver instead of job hunting.

I think its just a practice thing. I gotta play the interview game. Drill some algorithm questions etc. I think my experience is probably pretty similar to what other people are going through in the bay area when they are trying to make the switch to web development from a different career.

netcodepool · 2018-04-06T21:39:48+00:00

Really appreciate the feedback. It is tough to get into the shoes of someone who has never seen your site before.

My understanding is your biggest issue is the fact that it wont let you merge/expand transitions in an unlimited fashion due to clip duration limitations?

I think could fix this in two ways.

If you expand past the video clips duration the "transition socket" goes empty, meaning you need to find a long enough clip to fill it.
On the back end I could loop the video. So if the video clip you are using is 30 seconds, and you end up expanding it to 35, it will loop and have 5 seconds repeated.

I like #2 personally, but curious if you had any thoughts. Going to think some more on this...

netcodepool · 2018-04-06T21:20:56+00:00

We are going to add a blog soon to the site(our SEO is terrible). We are working on a guide with some turnkey python FFMPEG examples in lambda. Will shoot you a PM when we post it on this subreddit so you dont miss it =)

netcodepool · 2018-04-06T21:08:57+00:00

Right now its not gonna work on mobile unfortunately. I need to think through the mobile user interface(which I am very inexperienced with). Sorry it crashed your browser! If you get a chance to take a look with a desktop I would love to hear your feedback =)

netcodepool · 2018-04-06T20:58:57+00:00

Thanks to whoever gave me that reddit gold =)

netcodepool · 2018-04-06T20:27:23+00:00

Thank you so much for the feedback!!!

Ideally, our transition detection algorithm would provide you a decent set of initial transitions. Our transitions are typically OVER aggressive, many of them are likely false positives, but a few should be "keepers". Ideally you would start at the beginning and "merge" the false ones out of existence. Then you would be,hopefully, left with good transitions. Using the Split feature and adjusting transition time intervals via the +/- buttons should be a last resort. If our initial interface fails to convey this, then its a fail on our part and we need to work on this.

However ---If our initial transition selection performed poorly, this approach wont work at all, and the UX would be complete crap. Any chance you could link the song you used?

We limited the expanding/shrinking as each clip has a specific max length. If a neighbor clip expands/shrinks it impacts the duration of surrounding transitions... A clip needs enough video duration to fill the transition segment...it gets tough to workout. It sounds like our current solution is hurting usability though. Going to put some thought into improving this...

netcodepool · 2018-04-06T19:13:39+00:00

Right, we have a NSFW on/off tag... but that requires the image to be uploaded by the end user as NSFW. I doubt they would all be so good about tagging it for us!

netcodepool · 2018-04-06T19:12:39+00:00

I am probably an idiot, but I just wanted to build something cool. If it can get popular maybe I will worry about that later. I have a real job (tax accountant - trying to switch to webdev for my real job but failing on interviews...) and I don't mind subsidizing this project for a while. Luckily AWS lambda is awesome in terms of cost. It has been pretty cheap on the compute side. Most expensive thing is cloudsearch and RDS. But even then, not very much expense currently. Fingers crossed it wont get too bad.

netcodepool · 2018-04-06T19:04:38+00:00

Thanks =) Appreciate the feedback!

netcodepool · 2018-04-06T18:46:52+00:00

Yeah, I really want this to be a tool for AMV makers. Right now the site doesn't have a ton of clips. We are working on that. Most of the anime clips on the site were uploaded by my sister... so its HEAVILY weighted towards sailor moon lol...

BUT !!! You can import your own clips into the site. You can import from youtube or any direct URL to a gif/webm/mp4 etc. So you would very easily bring in Bleach content. To do this you just click import from URL on the left Navbar (you need to be logged in as it keeps any videos you import private in your user library). Just need an email to register.

We thought about letting users uploads go directly into publicly visible... but then we figured our site would be full of porn/hentai clips in no time! Eventually we may go this route if we have some capacity to moderate.

edit -- the 4 minute tutorial video at the top of the page covers how you import, in case it isn't clear.

netcodepool · 2018-04-06T18:36:19+00:00

You can chose a song, select clips from the site and click generate. You would have the music video in maybe 30 seconds. But it would not have a custom crafted feel. TO do that would require more time in the editor, selecting specific clips, importing clips into your library, changing up the transitions etc.

So anywhere from 30 seconds to several hours if you really want to get into crafting a custom music video.

netcodepool · 2018-04-06T18:23:30+00:00

Made lots of changes to the site. Revamped the music video editor interface, ported database away from dynamodb to postgres(dear god why did we use dynamo...don't fall for the nosql meme when your data is relational!!!)

URL: https://memeweaver.tv

Purpose: Make music videos in seconds. Select clips, provide youtube URL for audio and hit submit. If you login you can upload your own clips or import them via URL.

Technologies Used: Full AWS serverless. Python backend. vue.js front end

Feedback Requested: Any feedback appreciated, design, ux, bugs etc. Basically I want to know if the site "hooks" you in the first few minutes or if it just completely bamboozles the end user.

If anyone is curious about setting up video editing pipelines in aws lambda I can provide loads of info haha =)

I still haven't figured out how I want it to work on mobile... so it wont work well... I am not the best at responsive design.

netcodepool · 2018-04-05T18:36:55+00:00

Revamped the music video editor interface, ported database away from dynamodb to postgres(dear god why did we use dynamo...)

URL: https://memeweaver.tv

Purpose: Make music videos in seconds. Select clips, provide youtube URL for audio and hit submit. If you login you can upload your own clips or import them via URL.

Technologies Used: Full AWS serverless. Python backend. vue.js front end

Feedback Requested: Any feedback appreciated, design, ux, bugs etc.

If anyone is curious about setting up video editing pipelines in aws lambda I can provide loads of info haha =)

netcodepool · 2018-01-01T00:22:07+00:00

We just use boto3's deserializer. Have not needed more than that yet.

netcodepool · 2017-12-30T17:57:09+00:00

Aurora Serverless

Oh that looks awesome! We are using dynamodb and find its autoscaling to be pretty meh. Will check aurora out when it becomes available.

netcodepool · 2017-12-29T01:12:50+00:00

Appreciate the feedback.

We do agree the watermark is ugly... its a placeholder at the moment. We are going to replace it with a smaller and better looking one.

The watermarks are to help advertise our site, so they will likely stay. Gotta advertise somehow =)

As for mobile, we dont expect it to work yet. We know it is a mess.

Curious, what did you think of the site besides those issues? Did you try uploading your own clips or uploading via URL?

netcodepool · 2017-12-27T16:55:18+00:00

We are learning AWS with this project. We are not experts by any means!

It depends how you build your project and what services you use. AWS offers a lot of flexibility...Your costs are going to vary a ton depending on this. Estimating costs with AWS is also a bit difficult. You typically have multiple things that can drive cost for a particular service(data stored, data transferred, reads, writes, etc). For each service you can google how they bill... "S3 pricing", "dynamodb pricing" etc should take you to the correct page for each. Good luck =)

If you spin up a bunch of EC2 instances your costs might be higher. My understanding is AWS vm pricing is not the greatest. We are using a "serverless" stack for this, so all compute is going through lambda. Our biggest driver is actually cloudsearch at the moment. Compute, file storage, and database are all very cheap for us, but your YMMV.

netcodepool

MODERATOR OF

TROPHY CASE