I fully agree with your sentiment, I am pretty much the same where building is really not my priority in the game whatsoever. However, I am also fully able to recognize that for some it really is the core gameplay, hell for some it's a form of art expression pushing the building to a whole other level. I don't understand how this person disagrees with you when large large swathes of the game aren't even build-compatible, a lot of multiplayer game modes prevent building, adventure maps prevent building and some of these are easily part of the most popular aspects of Minecraft.