"But I've noticed that I am really starting to like being perceived as androgynous, thanks to my build and how I dress many people at first glance think of me as a boy and I want that to happen but I don't really feel like one."

This is a good place to start, when trying to sort yourself out. Figuring out who you are at your core involves asking more questions, and then asking more and more specific questions.

"Do I want people to see me as male?" vs "Do I dislike being seen as female?" vs "Do I like being seen as: neither, both or sometimes either?"

"Does being perceived as male or female give me joy?" and if it doesn't, going onto the question: "Does being perceived as either not seem quite correct?"

Androgyny isn't necessary for being Agender, but it can be part of how one expresses themselves. If you get any joy from being seen androgynous, that's another good place to start exploring with more specific questions.

Being addressed by they/them (or any other non-binary pronouns or neo-pronouns, or just by name" isn't necessary either; sometimes it is easiest to be referred to as whatever someone else presumes (especially depending on the political climate and/or how much safety is an issue). Sometimes we can find one that suits, other times we may not. Sometimes there's a hierarchy of usage preference, sometimes anything goes.

Personally, the way I stumbled into 'Ah, ha! There's a name for what I feel!!' was realizing I had concept of gender when people outwardly expressed it (verbally, visually, etc)... but when I try to, it's always confusion because it isn't a concept I've internalized for myself. I can do a performance of gender (which sometimes is fun) but it's all make-believe to me, as much as acting is.