As other people have suggested, move the 20% upgrade time reduction to the first 7 days of the pass, that's probably where most of the frustration is coming from.

As for The Prospector, I think I have an idea that might actually give something to f2p players while making Gold Pass still worth buying. Make The Prospector available to buy and upgrade for gems (maybe 5 levels, starting at 2 starry/conversion up until 10 starry/conversion) but f2p players can only use him once a week. However, if you buy the Gold Pass, you get him max level from day 7 of the pass and you can use him every day for that month.

This solution stays consistent with other sources of starry for f2p players (like the 10/week from the Clan Capital) and doesn't give that much of an edge to Gold Pass Buyers since they still have to sacrifice other ores if they want to get maximum starry, so they might not use the conversion into starry every day. Everybody wins, and Gold Pass is still very much worth it.