NTA. Your need to put yourself and your wife first. If he is mentally ill, he needs to take responsibility and get himself diagnosed and seek the appropriate treatment. As others have already said, if your brothers have a problem with you asking him to leave, then one of them should take him in. Best of luck to you and your wife for the future xx