It would be like that with goods. But even there, if the goods have been used so much that they can no longer be considered new, you would have to accept a reduction in the refund amount.
I think what you mean here points towards warranty. It is logical that with a used item, you cannot invoke the right of withdrawal. Also, this only applies 14 days after the purchase is concluded, provided you were informed about your right of withdrawal.
In the case of withdrawal under a construction contract, there are also the futile expenses of the builder, which here would be the sample selection and possibly even the building application. If the house was planned by the general contractor and now can no longer be implemented as such. But money is, as is well known, one thing; the lost time is another. Basically, you’re starting practically from scratch again now.