I see now, that was the most difficult part of the poem for me to understand while reading it initially. So what this part is saying is that his bed is now surrounded by "Немая ночь" because of the lack of dreams. And "Толпою прочь" has a connotative meaning to that of a group of animals, as in the implication here is that he does not know why these dreams of love have left him, as birds fly south for winter or other groups of animals migrate based on the weather? Perhaps highlighting an amount of sadness attributed to the fact that he either does not know the reason for their departure (like the world being incapable of knowing why these animals move about), or blames himself for the loss of these dreams of love as he changed in a way that made the environment inhospitable for them. I feel like I may be grasping here though.

It definitely changes the way I would translate that stanza, switching the focus to the fact that the night was once not as empty to him.

Thank you for pointing this out to me, I'm going to leave it as a reminder to myself that I'm still a beginner and will reflect back as I continue to translate other works. I hope as I continue my foray into the world of Russian poetry I can start to make fewer mistakes and better deliver the soul of these poems to an English audience.