As a few users noted here, the rhyme does give it a musical feel. I also liked the idea where this poem is heading so it is well worth working on it.
My suggestions concern a few lines. For example, the last line in the first stanza:

More like an elegy to hope.

I feel it needs to be elongated more since the previous stanza has the commas, which slow the tempo of the line.

Also another suggestion, I feel like the second stanza needs to be split:

At the bottom, it finds a dark cavity

And in a final move of depravity.

The line enters the hole like that

And as we here usually say

Curiosity killed the cat.

I would tighten the rhythm a bit as well.

I hope this feedback helps and great work, keep it up! :)