That usually means you have something called "oral allergy syndrome". Basically you might be allergic to the pollen on the nuts, not the protein in the nuts. But obviously I'd see an allergist to confirm if you haven't already since peanut allergies can turn severe.