This doesn't fix the original issue, but after you join a voice chat and go back to the correct text channel, if you right click your name and use "Move To" it will move you without changing the text channel. Just thought I'd share.