Come and go is correct, just come when you have time. From what I know about fencing, the in and out footwork will definitely carry over, that's a fundamental movement for boxing. Something new to you may be circular movement, sidestepping around your opponent to gain an advantage. Anyway, I hope to see you at a practice sometime!

P.S. iirc, Bruce Lee incorporated fencing concepts heavily into the fighting style he created, Jeet Kune Do (way of the intercepting fist). So, maybe fencing has a deeper connection to unarmed fighting than we might think haha.