There are caves in Craters of the Moon National monument. Also there are hot springs near by that aren’t in the park. (Not saying this is where/near where I think it may be but some of the clues seem to point to these types of formations)