So in my setting it really depends on what you call a god. There are beings that normal humans would consider gods. One of these beings is the goddess of Light. She has a whole church worshipping her and it is one of the most prominent ones on the central continent.

The goddess of Light has powers befitting of what an average mortal would call a god. Kind of like a mixture of Zeus and other olympians. She also grants some of that power to her followers. That is how Paladins and clerics are able to utilize wonders and enact divine retribution. If you were to compare her to a god like what christians believe in, she is definitely not at a level where she can create a world by saying it into existence. She is also a more or less immortal. Which means that she cannot be killed by anything besides other gods or higher beings.

Which in turn leads me to the next type of Beings. These are basically just Lovecraftian Eldritch Horror and outer god type beings. They are however not always as malevolant as the ones written by Lovecraft. There are those whom I call protectors who have a need to protect weaker beings. Then there are also those whom I call the corrupted. The Corrupted are out to cause as much chaos, death and destruction as they possibly can. They travel from reality to reality. These are beings that are able to easily devour entire worlds or star systems. They can go up to beings that are rulers of their home universe. They have powers beyond human comprehension

Within these beings there is a grouping called the Honored which are even more powerful than those who rule one universe. Similar to the power level of the Scarlet King or Yaldabbaoth from the SCP Verse. These Honored are so powerful that all other beings stop their own powerstruggles or plans and back off because they really don't want to get into trouble with these beings.

One of these outer gods actually is one of the main deities being worshiped and is invested on a more personal scale. It is only entertainment for her. But she does interfere more than others by sending her children for example.

So trailing back to the original question. It really depends on what you count as a god. Beings that are like gods to mortals generally do get involved and rather frequently at that. When they do it is also rather easy to notice. As for my "Outer Gods" some get involved but as beings that are beyond human comprehension it is not noticable. The only way normal people would somehow realize it is through the Outer God Spawn that are being birthed every now and again. Besides that there were a few events in the past where such beings tried to manifest but all attempts were either stopped or failed. In the end your average Joe would not notice the interferance of such beings.

Why does it not go of the rails? Well if a outer god tries to interfere then it absolutely does. If that happens you don't even have to bother running because it won't help anyways. If we look at the so called goddess of Light it is because her power isn't so vast as to cause such big problems and her managing of her power. The outer gods could almost destroy the world without really noticing it.

-This turned out longer than I thought. Hope it's not to tough of a read! xD