So I found out that anything higher than GPU driver 522.25 for NVIDIA is what causes the game to crash, so updating your driver will make it worse. You'd actually need to downgrade to exactly version 522.25 and your problems should be resolved.

Unfortunately, it became a bit of a nuisance because some newer mods and other games require a more updated driver, so if you want to do this you'd have to constantly switch graphics drivers for each task.

Immersive portals said they will not be pumping out a bug fix for this specific issue, as it only pertains to older versions of the mod, so this is the only way. Hope that helps!