Considering everything mentioned here (reasonably not building), I would examine the financing of the additional costs. After all, it seems to be a very special situation.
Land paid for and equity available enough to finance the vast majority of the house. If now 50-70k€ should be missing, that would be a loan, depending on the land price, of around 30% or even less and a burden at 3% repayment and 1.5% interest of around 250€ per month. As soon as you live somewhere as a tenant, this position should at least be comparable, and if the 200k are saved independently and verifiably, there definitely seems to be potential, hopefully not "from earlier times and currently no longer possible."
Have you ever talked to your house bank, otherwise Volksbank or possibly Sparkasse to inquire, the situation is indeed special.
It is just an idea, even if the information given so far recommends withdrawal much more.