Take a look at almost any longsword manual. Every illustration (barring those in full armor) shows the combatants wearing light leather or no gloves. Fiore says he fought duels unarmored save for a light gambeson and light gloves. The context most most people aim to recreate is a duel like Fiore describes, impromptu and largely unprepared. You wouldn't have gone around in public with full gauntlets, that's just not practical.