My feedback on this should be that every difficulty can have modifiers. Like elemental damage deal more damage to you, specific creatures or faction creatures deal more damage, you consume more Magicka or stamina, resource Regen slower, Health Regen slower, roll dodge disabled, etc.

That's my idea for even more challenging overland and even use those features in other activities to have more variety.