is absolutely right, even with a prefab house, the interior finishing takes place live on site. I am lucky (ok, it was planned, location, location, location) that my new home is 800 meters as the crow flies from work. And that my employer has no problem if I occasionally go "check" for half an hour. And I did just that.
When you then sneak quietly through the side door and find a group of craftsmen discussing, and one of them, standing with his back to the door, is just suggesting not to let the client know about it... priceless! "She’s right behind you!"
At my site there was always a crate of beer/radler, at times coffee, breakfast rolls, lunch... in return, the excavator operator even screwed the mailbox on!
If you yourself can’t supervise the construction at all (timewise, technically), you need someone to do it. You have to find and pay that someone yourself (important!!), so that he actually works for the client!! This construction supervision is absolutely not money thrown away—no matter what construction method the house is built with. Nevertheless, it was often said “Can you come by, we want to discuss how it should be” and it was not about expertise but often where exactly something should go and if it would be okay there, etc. “Look at this sample here, which glass should we take?”
If the woman is home, great! Baby in arm (already mentioned) and off to the construction site! You have to get through the day anyway. People like to work for a nice young family.