I also think Dirk's idea is great, but that will be difficult since I only purchased the 3-family house just 10 months ago. The people next door are long-established and older. They are not supposed to be very flexible. I will politely address the neighbors again, but I fear that we will not come to an agreement.
And yes, I want to live in the property myself. Originally, I wanted a bungalow, but two floors, where half of the upper floor would serve as a roof terrace, would also be conceivable. The house really has a beautiful view to the back (view downward with lots of greenery). Therefore, I would also want to build at the back of the plot so that actually none of the houses in front would be affected. So, do you think that a proper house cannot be built with only 4.5 m width and about 16-17 m length? Total living space up to 130 sqm + full basement and large roof terrace (40-50 sqm)