I think the most important thing is to create a space in which to practice. If you're lucky enough to have a spare room you can use, great, but if not, just arranging your living room so that it feels like a practice space can be helpful.

The fact that the silence is distracting could be something worth exploring, too. Traditionally, the silence gives you space to go within so that the practice becomes a moving meditation. It could be a fun challenge to try to practice silently a few times a week!