Your calculation applies to closed containers and not to a house
That is not correct. The calculation is generally correct. Of course, there are mixtures that then influence the humidity on average again. Basically, it is important to understand relative and absolute humidity. Then it quickly becomes clear that the problem is not fundamentally with the controlled residential ventilation, but with "cold, dry air." And letting this into the house through the window has only disadvantages and no advantages. By the way, you cannot retrofit an enthalpy exchanger on windows, but fortunately you can with controlled residential ventilation.
Our house has 45-55% humidity without controlled residential ventilation,
That is probably because you overall have a rather low air exchange rate, despite partly open windows. Or you bring in a lot of moisture through flowers, cooking, showering, etc.