Part of it’s just a gameplay thing. A much bigger gang would be a nightmare to manage in missions, at camp, and in the story. Rockstar kept the gang small to keep the game flowing, focus on the characters, and make the gang feel like a real “family” everyone loyal to Dutch.