Why do you assume that the garden will always be shady? There isn’t much neighboring construction up there anyway. If you look at it that way, I would say: there is a house to the south that would cast a shadow on your house.
We have that too and I am very grateful for it. No midday heat on the house. Of course, if you belong to the sun worshippers who feel great at 30° and above, then that is of course a disadvantage. Then you probably need a property where there are no neighboring houses to the west and south.