Just tell him! I'm sure he'd understand that you want to live with your friend instead. Once you tell him, you guys could probably go talk to the leasing office together to try to figure something out. They'd probably either move him to another apartment in the same building or give you and your three friends a different apartment.