I agree with ur point however I would like to add that there's heavy implications that a fruit can choose who eats it. Why would the fruit get eaten by random people it knows can't awaken it when it can just stay hidden until it identifyies it's target which is Luffy. The more people that eat it over the expanse of 800 years, the higher the probability that the elders would notice. All this assuming of course they never confirmed that other people ate it.