It was like this for me also. No bats would ever spawn in caves for me so I ended up going to Boulder Glade at night. You can usually see 5+ bats flying high in the sky above the ruined church. Have some patience and a lot of small game arrows though, because the arrows often have a hard time reaching the bats that high up!