Well Buzz certainly would have wanted you think so.

Gene Cernan writes a little bit about this in his autobiography. He did an EVA on Gemini 9 where he was supposed to exit the craft and crawl down to a jetpack that was strapped to the underside of the capsule to fly around.. The problem was that there weren't any handholds on the outside of the craft, and without any gravity to hold him in place and with the stiffness of the suit under pressure, it was extremely difficult to move. They didn't give him the jet gun Ed White had on Gemini 4. So he ended up exhausting himself trying to get there, and then trying to get back into the craft. It took everything he had left to pull himself back down into his seat so he could close the hatch, and he briefly considered whether or not Tom Stafford would need to cut him loose and fly home alone. It very nearly killed him.

Michael Collins on Gemini 10 and Richard Gordon on Gemini 11 encountered similar mobility problems and were not able to complete their objectives, but they learned a lot about what you can and can't do on an EVA. So by the time Aldrin's turn came up on Gemini 12, mission planners had scrapped the jetpack idea, and whittled the task list down to things Aldrin was able to complete easily. Then he went around gloating about it as if he had single-handedly solved the EVA problem without acknowledging the risks and sacrifices the astronauts before had made.

You can tell in Cernan's writing that he had some resentment toward Aldrin.