He'll just say in court if necessary that he verbally warned you, and then it's his word against yours.
I would either insist that he simply made a mistake for which you are not responsible, and if necessary take it to the limit, or agree with him now (50/50, whatever). The good man might die next week from Corona, fall off a ladder, go bankrupt, close his business, etc., and you'll be left empty-handed again. So it's better to settle and close the matter now, no matter what.