I don't have to be able to walk around the house once to happily call it "mine"
I also think it's okay, a semi-detached house. And honestly: since most people build their single-family house anyway with the garage on the boundary, they can't walk around their little house either.
Oh, there is a wall in between. And on the other side, we have more distance for that than those with a 3m boundary setback mandatory users on each side.