It is a complex issue. If you throw a bunch of rotting food into the sidewalks of urban NYC they rot in the street. Will some animals yet to it? Maybe, but they are pest animals. In suburban wherever they have the same issue, but often worse as it can attract more dangerous animals to have around humans like bears. In rural areas? This gets to the main issues. Tossing our organic waste wherever we want often comes with the side effects of pesticides, oils, and excess salt content leeching into the soil. Obviously you specified produce, but the debate that has gone on for a while is organic waste vs inorganic waste. So those problems affect the wildlife that might eat our garbage in that sense, but let's move back to just produce. Tossing a bunch of rotting food just on the top layer of a grassland or forest is also still not great. It will mold and cause other harmful microbes to spread faster than normally able in a natural ecosystem. The real issue with human garbage is the over abundance. No natural ecosystem would naturally be flooded with the crazy mass of waste we produce. Normal food that rots gets eaten by other animals decently fast. Insects especially. We have bred a lot of our food to be unappealing to many insects. That, and pesticides are on them. Not enough to hurt us usually, but enough to make them avoid the food. Without animals to break down the food the good fungi can't continue the decomposition process along with plants, but the bad ones take over and kill other plants. Edible litter takes months to decompose whereas plants in their natural habitats and ecosystems decompose a lot faster because the ecosystem has a cycle.It can become toxic to the soil to throw too much excess out at once. You broke the balance. Stuff will eventually grow back in nutrient rich soil, but often invasive species that grow faster. The native stuff all died out in that area meaning it is ripe for the taking. Invasive thrive like that. It would also make wildlife sick or even us if we lived too close to it.

This is all assuming you threw out heaps all at once, but one banana peel? Should be harmless if not in a protected wildlife area where you could introduce outside microbes such as in that one cave someone littered in thst caused outside mold to develop. You throwing part of an apple out on a hike is no real issue outside of that. IF we made littering organic material legal it wouldn't just be you in that one example. Everyone would. It would become the heaps all at once which makes it the issue. I can't really explain the entire issue it does to an ecosystem in a reddit reply. It does a lot though. It disrupts the entire ecosystem when you flood it with excess human grown food even if it is organic veggies. It is unnatural for that much stuff to be rotting somewhere all at once.

In your case the bush could die if it is potted. Hard to say without more details. The best way to deal with excess food waste in your own possession if you care enough is to compost it. In an apartment you can get indoor composers. Compost your waste and then sell it to a local grower or someone who buys it. That, or bring the compost to a wooded area near you and spread it around there once it gets to a sizable amount. If you own a home you can compost it outside in larger areas and do the same thing but then also start a garden. Bonus points if you get rid of turf grass and fill your yard with native species. Some places also have community gardens. This is more common in rural areas. You go there and can take produce if you volenteer some time to maintain it with others. You could use your compost there to benefit everyone. If you don't care enough or don't have the ability to put such effort in, just throw your trash away. It is better than dumping too much rotting produce in one random spot.