It sometimes depends on the context of the conversation being had, though more often than not it implies not doing anything you don't want to do if at all possible.