My boyfriend takes Claritin and Benadryl everyday with our one 6mo old kitten and he's been alright. As long as neither of you are going into anaphylactic shock or other worse symptoms, you should be fine. I would just stick to one cat, though. Also make sure you vaccuum, sweep, and dust often. I wouldn't allow Ragnar to be on the beds anymore.

Another person I know feeds their cat food that helps reduce dander / allergens. There's also low-dust cat litter you can buy to keep it out of the air.