With a smoke pen, I then examined the ventilation ducts in the house.
What do you mean by ducts? At the valves, one should be able to determine the flow direction with the bare hand without further aids (i.e., whether it is supply air or exhaust air).
The construction manager said at the beginning that air is extracted in the wet rooms (bathroom and kitchen) and fresh air is supplied to all others.
That is not wrong, but it could lead to significant overflow volume flows and correspondingly large volume flows in the bathroom and kitchen. Are there planning documents that you have?
Exhaust: Guest room (upper floor), office (upper floor), gallery (upper floor), dressing room (upper floor), utility room (ground floor).
Supply air: Bedroom (upper floor), bathroom (upper floor), bathroom (ground floor), living room 3x (ground floor), kitchen (ground floor).
Is that correct?
In my opinion, the correct would be:
Supply air: Guest room, office, bedroom, living room
Exhaust: Dressing room, utility room, bathroom, kitchen
The gallery could be understood as a corridor, usually an overflow area.
The way it is with you is deficient. I would report this as a defect. If you have no planning documents, request to inspect the documents (depending on the contract situation, you might also insist on handover, I don’t know...).
If you have the planning documents, balance the supplied and extracted volume flows.
For the time being, I would switch off the system, continue to monitor the humidity, ventilate manually as needed, and observe whether the headaches and eye redness improve (keep a diary!).