I wouldn't react to that. The risk that a lawyer is already leading things behind the scenes seems relatively high to me. Following the motto: collecting written statements from you, setting traps, etc., from which something can later be constructed. Because if a letter from a lawyer came to you immediately, the risk would be too great that you would also run to a lawyer right away and no longer make any unconsidered statements.
The fact is, he wants money. So he won't be satisfied with any justification from you anyway. Immediately put his cell number on the block list on your phone, etc.
Time is on your side, because an expert appointed later in the conflict will always find it harder to determine whether the moisture damage became visible before or after the purchase and note that in the report accordingly.
So long story short: don't respond to emails, reject calls, always answer with a false name when the number is hidden/unknown, and wait for the other's reaction. If a proper letter with a demand and deadline arrives, go to a lawyer.
...what kind of construction expert was that anyway? That's the first thing you look for: moisture damage in the basement and ground floor, that's the ultimate negotiation opener. You just have to move a cabinet for that.