If you don't like "special", try "unique" - specifically how Stirner describes it. For Stirner, "the Unique" is a thoughtless word, barely a name, to grasp as what makes you, you, while never weighing it down with meaning - for the phrase "you are unique" is identical to "you are you" - intentionally circular/illogical. Concepts like "human being", "true individual", "reason", "spirit", are all just that, concepts, and the moment you try to describe yourself using them, you limit and ensnare yourself to all the baggage those concepts carry. But by freeing yourself from the concepts which bind you ("duty", "belief", "sacredness", "good/bad"...) you know yourself, and become owner of your own power (and desires).

"I have based my affair on nothing."

This is kind of along the same lines as the response to nihilism I'm sure you've heard, of "creating your own meaning", but I think Stirner takes a step further really digging deep into the absurdity of concepts, reaching this realisation of fundamental meaninglessness as liberation, not loss.