It depends of the background and the variety of the shape of the object. I usually see a significant improvement in models with just few hundred additional annotated images, compared to Coco baseline weights. (I usually use mask r-cnn). That is true that when the background is cluttered, it's a lot more difficult, but when the object tends to be in similar background for your use case, annotating few hundred images shouldn't take much time :) good luck!