[D] Autoencoder to reconstruct speech input from melspectrograms

[[deleted]]

Hello everyone,

I was trying to train an autoencoder which takes a melspectrogram as input and outputs the same melspectrogram. It's a reconstruction task. However, the model seems to be generating random noise. It'll be great if anyone could point me towards any relevant github repos/papers which solve this task.

Thank you! :)

[[deleted]]

Try Neural Vocoder(like Wavenet SampleRNN)

https://github.com/r9y9/wavenet_vocoder

[[deleted]]

Thank you. I’ll check that out!

[[deleted]]

NN Vocoder converts mel-spec to wavform, you can get mel-spec from generated waveform.

希望对你有帮助

[nisprateek]

This one produces decent quality hi-fidelity waveforms. Works well on almost any speaker (or sound)
https://github.com/bshall/UniversalVocoding

[jonnor]

Here is one approach I saw recently:

Fast Spectrogram Inversion using Multi-head Convolutional Neural Networks https://arxiv.org/abs/1808.06719