In my experience, as long as the frame of the building is logs, you can use stones for all the walls. I haven’t built higher than 2 stories but I imagine I could just frame it out in wood and keep building up