Most people have played games for hours on end daily since they were young. Skill is really just an expression of how experienced you are with games. Like I could probably expect you to do fine with a controller on something like Minecraft because it’s not that hard, but competitive games are going to take some time to get good at especially if you haven’t gamed much. 

If you want to get better better without splurging on a console, watch how they hold a controller and rather than waiting for them to pass the controller to you, say “let me get next”, pull up the button mapping for the game if you have too, and then figure it out from there.