Many builders want the financing "at their place of residence," meaning they want to address their caseworker directly in case of problems and resolve issues or other matters face-to-face. This is one of the reasons why many builders reject financing through Interhyp & Co. with unknown or distant banks, even if these might be cheaper.
Precisely this motivation can, of course, fail in the event of an assignment if the (originally) financing bank sells the claim to a third party. This can happen in portfolios (a bundle of existing financings), which can consist of good and/or bad financings.
The clause is probably completely OK in the vast majority of cases. Foreclosures do not come out of nowhere, and courts in Germany still protect against arbitrary actions. Things are never as bad as certain TV shows would have us believe.