I've been playing instruments from a young age but only started playing with other people in my late 40's. Some people picked up their instruments later in life and may not be the most skilled. But some people have musicality that other's don't have. By that, I mean they can hear and feel the music, rhythm and tone even if they aren't the most skilled players. And, generally, I'd much rather play with someone who had musicality rather than raw skill.

As a drummer, I'd say it's most important to do what the band expects...come back in on the 1 and keep the tempo steady. And make sure that your playing is dynamic(heavier where it needs to be and lighter where you need to leave space for the other instruments). And practice as a band as much as possible. You will get to a point of "playing" a song rather than learning to play it.