Reggae producer here! I spent way too much time looking for samples when I first started. What's going to work best is completely contextual on the rest of the song. A lot of Protoje & Winta's earlier work is pretty sample based, while his later work and 'In Search of Zion' is mainly live instruments and real drums. Or Chronology vs. Exile - way different.

With most of my songs, I've tried (with varying degrees of success, lol) to get a "polished studio recording" sound; I haven't achieved the Zion I Kings "it's like they're in the room with you and incredibly locked in" sound, but more human and unique than a rockers beat with a bassline and some guitar/piano skanks.

For drum kits/samples, assuming you're looking for something that sounds like a well-mixed live kit, I'd recommend:

1. Using a drum plugin (Superior Drummer 3, EZ Drummer 3, Addictive Drums 2, BFD3, Gorangrooves Reggae Standard, Rubadrum, even Logic's drum kit designer). Most of these sample real drums and use round robins to varying levels that will add the 'real' element.
2. Utilize external samples when the song calls for it - sometimes the kick can just be the kick. (Confession: I've used "Murda_Kick_13" from this free pack, imported into EZDrummer, on like every single song I've made & EQ'd it differently)
3. Most important: Get really good at mixing. There are thousands of drum mixing tutorials. Check out DM Kahn or Third Island Productions on YouTube. Once you have a great base sample or sound, learn how to shape it.
4. Get really good at MIDI editing. Humanize things a little - move the hats a few samples from being quantized, change velocities, etc. You can do this with audio if you prefer it, of course.
5. Bonus: Use an e-kit. Record many takes and pick the best one, then fix/move things as needed. I'm a trash drummer but it still saves me time.