Passive house is more expensive in terms of the building envelope. Floor slab, walls, windows, roof, insulation.
It makes a difference whether you choose a builder who says "well, if you insist and really want such a contraption, then we'll build it" or one who only builds KFW 40, KFW 40+ and passive houses.
Why don't you want a solid wood house?
which expensive technology makes the difference?