Free markets for housing are likely to settle into an "optimum" where some percentage of people cannot afford housing at all, because while construction of housing for them would net a return, it's not worth the opportunity cost.

Markets don't optimize for "everyone gets some", yet that's precisely what you need for housing. You'll always need the government to come in at some point to provide for those left behind by the free market.