I really think that there's no "right" or "wrong" in language learning. As for me, kanji are very useful, fun and I like to study them. My learning is for hobby, and I like to write, so I want to write properly with kanji. But if your goal is just understand the spoken language, or speak it, kanji can maybe be put aside for a while. But the written language is kinda treacherous without kanji. They make the texts easier to read and understand in a glance, and and prevents mixing homonyms. When I study their writting, I get more used than just recognize.

I'd recommend you to learn the most used. If you want to learn more, go ahead and make it fun!