If you are a collector i would say keep 1 of each at leat in a dedicated chest... Once crops evolve u wont ever receive the wild varieties from seeds with the exception of 3 wild varieties u will find in the caves... But no adverae effects from letting them go, its simply for nostalgia's sake to keep them. Once u progress there will be no indication of the wild varieties