In my impression, "in the past," people with lower-paid jobs also built houses and were often the sole breadwinners.
I can tell you how it was with my grandparents. My grandpa was a civil servant in the lower service at the railway, and my grandma worked as a cleaner. According to the old documents, the total amount was 110,000 DM. Of this, the land was listed at 10,000 DM and the house at 100,000. But of the 100k, 50k was labor they did themselves. Among other things, my grandpa dug out the cellar himself with a shovel and wheelbarrow. In the 10 years after building the house, there were no vacations and no other unplanned expenses. So, sacrifice was required. The first vacation my father took with my grandparents was when he was 19. It was often the case in the past that many other areas were sacrificed for the dream of a house, but who wants that nowadays? By the way, my grandparents built in 1968.