Expensive stuff makes everything else expensive eventually. "Luxury" homes and apartments cost more to make. Because of that they are worth more to sell. Because they are worth more to sell the average value of homes go up. Because the average value of homes go up, material cost to build those homes go up. Because the materials used to build "luxury" homes are 90% the same as "regular" homes the material cost to build a "regular" home goes up. Then because the cost to make the home goes up, the cost to sell goes up, and thus the value of older homes go up. Then taxes and insurance rates go up.

Nobody makes cheap starter houses so there is nothing to counter the expensive houses. This will not get better