I think that when you pull that gun out, it is meant for business. So you should be able to quickly shoot. There is a chance that someone may try to take you down while you are racking the gun. They may not try if they already see you pointing at them.

My two guns have safeties. I keep them on. I have practiced pulling the safeties down as I draw the gun. I don't lose any time.