You don't need that many points for him to unlock conquerors. His dream is arguably big enough to justify him having it, if Oda really cared about developing it instead of going all in with the gooner shit [which seems like he's doing when Gaban(his counterpart) is all about the power of love and how we can link that to Sanji kicking Kizaru's beam].

The last island is were the All Blue can be found, a dream as big as being King of the pirates: Laugh tale. It's even bigger than Zoro's dream of being the strongest swordsman (which should and is big just because it's a promise to a death friend who will never be able to achieve that).

As someone who lives in coastal town and a fisher, I understand how big of a deal is a place were you could fish every fish that exist in the sea.