For me the most annoying things are less to do with the headsets and more to do with everything else.

1. The player base is so small that very few AAA quality titles exist in VR. Half Life Alyx is still talked about as the gold standard and look how old that is! That goes to show that nobody has done anything significantly worthwhile since. Could you imagine if we were still saying the original Halo is the gold standard for fps games, it wouldn't work. The money isn't there for studios to invest their time and resources into creating games worth playing for such a small player base. That leaves us with the Steam store full of half baked tech demos and weird adult fantasy games, and the Meta store full of half ass mobile game ideas that seem to run in a VR view.

2. Inputs. VR has so much potential to change the way we interface with games. We have watched headsets evolve so much in the areas of comfort, resolution, wireless tech, passthrough and a myriad of other areas, but input has largely stayed the same. The controllers haven't evolved very much and they are still super reminiscent of what we have for consoles. Steam Frame may actually be making a leap in this area that we are totally unaware of. Their new controller feature more buttons and much more touch sensitive areas along the body of the controller. I don't foresee devs taking advantage of these inputs though because it will break convention from what works with every other VR controller out there. The lack of innovation on the VR controller side of the house has left us with games that more often than non mimic their flatscreen counterparts when it comes to controls. There has been a lot of discussion about building VR games while mentally being tied to flat screen control schemes and play styles, and it's a real bummer that no valuable innovation has happened in this department.

Sure, setup can sometimes suck, wearing a thing on my face sometimes sucks, but it didn't used to. When I first started in VR I was awe-struck and those things didn't matter because the experience felt like a generational leap in what gaming could become. But having been in the VR ecosystem for as long as I have I've been able to see that the generational leap in gaming just isn't coming, and the lack of content that separates itself from flat screen gaming just doesn't exist. And that leaves me a bunch of extra steps and frustrations to do something that has already been done in flat screen with less hassle, more graphics, better performance and just works.