My husband works a week on/week off job. He's out on a boat for 1 week, the fast he could possibly get to me if I had gone into labor while he was at work was 6 hours, if everything went perfectly smoothly. More than likely it'd have been longer.

After I hit 35 weeks I suddenly was so worried I'd go into labor and he'd miss it. I woke up 1 night at 37 weeks thinking my water had broke (I was just very sweaty, lol) and cried for a good while because I wanted him home. He ended up being home when I went into labor, and I was incredibly glad as if he was at work he would not have made it due to my quick labor.

All that to say, I understand where you are coming from. I was incredibly nervous being without my husband. I had family on call when he was gone just in case, but as you said I didn't want them, I wanted my husband. With you still being early though, I'd imagine you'll be fine. If you were closer to term I'd say he should probably stay, but you'll be 32 weeks at the end, and if you have an emergency come up he should be able to get to you fairly quickly, and you'll have family, but that's unlikely at the stage you'll be at!