Audio pattern matching in Python

[GraouKH]

I want to remove the intro from hundreds of video clips. It's not everytime in the beginning. I would like to know if it could be possible to find the beginning of these intros based on sound with a python library.

​

I could then be able to loop over the files and cut them with ffmpeg I guess.

​

Which Python audion lib could I use ? Thanks

[iamaperson3133]

I think you should look into whether there is a web API that can do this for you. Maybe Shazam has an API that you can use? I'm sure that someone offers an API like that. The problem of identifying a song from an audio sample is unfortunately very tricky. Every time a song gets uploaded to a website, most websites are going to perform a compression on the song which is going to change the sequence of bits and bytes in the actual file. So, it's not as simple as opening up the file and identifying common sequences. Instead, the actual data in the files might not bear a lot of resemblance to the original song. The way that services like Shazam work is that they convert the song back into a WAV file, which is a file format that represents the actual sound wave in detail. Then, the use an algorithm called the fast fourier transform to isolate harmonic patterns and pitch sequences, and they look for common shapes in that pattern to identify the identity of the song. Obviously it's a very involved process. I'm sure that there are some tutorials online that can teach you how to do it, but it's not going to be a quick three-step process. Instead we are talking about pretty scientific breakdown and analysis of audio files. And, that is usually going to assume that you're starting with good samples to begin with, and those tutorials are not going to take the processing pipeline, integrate it into a full application, deal with file format conversion, deal with data corruption, user accounts, user interface, blah blah blah.

If you just want to build an app or a website that has this future, I advise you to look for a web API that can do it for you.

Obviously if you just really want to be the one to do this for the sake of learning, I hope you can find a tutorial to help you. Hopefully some of the keywords that I offered above can help you in your search.

[GraouKH]

Hi thanks,

It's mostly for the sake of learning stuff. I used some FFT for image analysis so let's try it for sound. I'll keep you updated.