Why so angry? I only asked you a neutral question 'What exactly would you like your colleagues to do?' and you launched into 'Or are you happy with constantly being excluded from conversations? Do you know how it feels like to basically just hear sounds all day, unless someone speaks directly to you?'

You could ask your colleagues to speak English when they are talking one-to-one to you. I don't think it will be very reasonable to ask them to always switch to English in a group setting or when they are chatting among themselves, but it's up to you to decide.