For me personally, I would see 2 sensible options in your case.
For both options:
Expand your garden by at least 1/3 to about 1/2 of the new plot and design it for gardening for yourselves!
Another advantage: if needed, in 15 years this area is optimally usable for new construction, e.g. of a bungalow.
Option A:
Carry out a few cosmetic repairs and rent out the old little house (inexpensively) along with the clearly smaller part of the plot. This way you have time to consider what exactly can be usefully done with it. Through rental use, the still existing building fabric is preserved (for a possible later renovation).
Furthermore, your children thus have the opportunity in 5-10 years to either renovate a house near the parents or to newly build on a plot. And yet the previously existing living space is currently being used.
Option B:
Demolition and new construction of a 4-5 person rental building. When designing, make sure that your garden view to the south is not strongly impaired and that tenants cannot look onto your terrace. As builders, you can actively take this into account.
Advantages:
Use of current low interest rates, creation of living space, income property (for you and your children), possibility for children to possibly use an apartment themselves in a few years.
Option A of course also leaves you the possibility to go for option 2 in a few years.