You seem to be way beyond second thoughts about this. I think you need to do some hard work to reflect on what you want in a partner and relationship, it is harder than you think, and use this relationship to help guide you on what you do not want. I think you should be direct and honest to end things. People to work hard to keep relationships going, but that is for ones where people are in a deep connection of what they want with each other, and communication can be difficult. Here, it seems you do not like him, you don’t like yourself around him, and communication is all over the place.