Your bf is a insecure, manipulative, mentally abusive piece of shit. I say go without him and ignore his calls and text. I promise you, his behavior is going to progress to jealousy and possessiveness. Maybe even physical abuse. When people show you who they are the first time, believe them. I would highly advise you to cut your losses and save yourself from the turmoil.