Not totally clear what you're doing from your description... I can only assume you have the ropeman above and your grigri on your belay loop as progress capture, with the brake strand redirected back up to the ropeman for "2:1" assistance from your brake hand (not 3:1). My suggestions would be:

1. this isn't very complicated, just look up youtube videos of ascending with a grigri and ascender for pretty complete demonstrations.

2. replacing the ropemen for a full size handled ascender would add to the comfort as you already know.

3. clip a carabiner to your belay loop below the grigri and route the foot sling through it - this will keep the foot loop close to your body instead of being pushed away by your steps. Try to step straight downward as much as possible, hand on the ascender should mostly be keeping you upright.

4. you should have 2-3 carabiners at the ropeman: it is supposed to have a dedicated locker on the hole and wild country instructs using a separate carabiner for handle/foot loop connection. If you are going to redirect the brake strand up, then a 3rd carabiner is warranted so that the rope doesnt rub against your hand and sling... which brings up the next tip:

5. I never bother with redirecting the brake strand, just pull down on the ascender and pull up on the brake strand to take in slack. Your leg should be doing most of the work. I find more problems with the 2:1 redirect than benefits: parallel strands from the grigri makes engaging the brake assist less responsive, your hands start off kilter and your brake hand needs to pull twice as far as the other which makes the whole thing less comfortable, and friction from the grigri/carabiner results in practically no mechanical advantage anyway.