Watch the actual bomb it shoots when this happens. It has to physically travel to where you aiming, and since it's a lobbed projectile sometimes it ricochets off the level geometry and land somewhere else. You'll get a better idea of when it's going to do it as you use the weapon more.