What you describe is the situation in 2019 / 2020 – now we are long in a different phase. And its shape is still completely open. The "place" is only worth as much as someone is willing to pay for it. Unless it’s black money, most ordinary buyers will have to work for this money and also finance it. Both wages, lifetime work, and credit limits are limited and not unlimited – and also location-dependent.
The fact that the OP can get a cheaper plot elsewhere, and thanks to a higher salary could theoretically still manage a fresh building project today, does not mean that there is an army of solvent buyers lined up for the house at the old location. The prices for used properties in the area currently obviously contain the same hot air.
How much someone is willing to pay, however, you won’t find out if you underestimate your property (in ignorance). Only a bidding process can prove that to you. Your thought patterns prevent you from achieving a good price.
You completely underestimate the financial situation of many fellow citizens. They possess more money than ever and most still don’t know what to do with it. Especially considering the inflation at work.
Maybe Kati still remembers how huge the rush for new building plots was at her place. That can serve as an impulse on how big the "army of solvent buyers" really is. But they don’t stand by the roadside and are transparently countable; you have to attract them, then they will come ;-)
I also have neighbors where one wondered, hm, how do they actually do it? The trick is: inheritance and/or dowry. And not just a little.
You can currently close 500k€ for 1666€ on 10 years, for example with 3% repayment. Plus a six-digit amount from mom, dad, grandma, and the money is there. That’s how it works, even today and not only in 2019.