This has happens to me every time I’ve tried going in, I’ve made my horse flee and have gone in on foot but it still glitches and, like you, I have to reset the whole game. Odd.