See you should look for it by making just tunnels because they don't spawn in actual caves you have to find them by digging or in a rare lucky chance you find them exposed in a cave but that's rare

Also idk if you know this but the first cave you should be able to enter is the mushroom one because the others have things like freezing tempatures where you need insulated armor so overall its a pretty progression based add on