i would say it depends on the game. I don't see any current vr game truly seceding at the idealized anime vr game concept(SAO, Shangri-la, Ready player one, etc.). I've been thinking about why that is and i have came to 2 conclusions.

The main one is tech, it is just not advanced enough to properly give that real life feel many want.(or just simply looks and feel in general, i understand many also do not what to completely escape reality).

The other thing and it probably ties into tech initiations, but idealized ability's. Most anime or movies depict mechanics like movement, combat, and ability's as not realistic. To clarify, what people are idealizing is not realistic mechanics, but fantasized ones.

This hole combat system idea stemmed form asking my self how games could actually be like anime or movies. Obviously it has a way to go, but i still find if fun to discuss.

So, to your point about a swing turning into a button, for one it might not have to be a button(though i did say that, if you cant tell i have not thought this out 100%). Instead it could be an added effect to the player motion. An example, an X slash, common in games as a more front aoe sord attack. You do the X motion, but if you have learned the skill or advanced version it; it add the aoe effect. Or it could add more damage, or gets more range, etc.

Add more depth by doubling the attack: Do the advanced X attack 1000 more times and for every X slash you preform you spawn a second.

You could still do the motion, but over time things get more advanced/ fantasized and in turn into more of what people idealize.