All correct, in parts ;). The photo presents the "anti-example." As described, the gardens to the right and left, running lengthwise to our property, are not so massively built up. One neighbor only did this to level his entire garden. It is always the rear boundary of the neighboring properties. The neighbors' houses stand about 1.5 m higher at about 20 m distance from the boundary. Since the entire area slopes down towards a distant ditch, it is all hillside and results in this strange topography.
With the neighbor with the wall, I am already considering simply filling in this area since our new garage runs 1.1 m away from the property line. Then I save myself elaborate slope stabilization. The garage would then practically be a retaining wall for his garden.
A slope is one option but of course limits the possible depth of my property and then slopes down to the lower house. I don't find that quite so nice, however, and that needs to be seen after a rough profiling, I don't want to drink my coffee in a concrete enclosure.