We had the problem that most houses with a granny flat are well over 200sqm in total. We didn’t want that either because we have no children/want none... we are now building 140sqm on two levels for ourselves and 50sqm as a staggered single-storey annex
If you don’t want to rent out, your husband could use the granny flat as a spacious office and work there without the typical distractions of a home office
My mom is moving in with us right away but we are planning so that renting out to strangers could also be possible. Since we both work a lot from home, it would also be an option for us to potentially use the granny flat as an office