There are really quite a few things that haven’t been fully thought through. Yes, a small fireplace might be about 50cm deep, but keep in mind, you can’t just slap it against the wall, it has to have a certain distance from the wall (20cm) AND from the furniture (80cm) in front. So, that only leaves you 2.50m for the dining table including chairs. And not to forget, the heat radiation from the stove could quickly make it uncomfortable at the table if you’re sitting right up close in front of it. The people sitting with the chair against the wall will also not be happy if they always have to squeeze past to get to their seat. I’m absolutely pro-fireplace, but in this spot it is misplaced. And don’t forget, you might be planning for another child, which means either a stove guard in front of the fireplace (space?) or a burnt child or the stove stays off and is pointless. By the way, the 4m is the raw construction measurement. You also have to subtract 10cm for plaster, wallpaper, and baseboard.
Also, the concept of possibly living downstairs later: either do it properly or not at all. If you square off the ground floor as well, you gain space and will probably even save some money.
And yes, I know what it’s like with 2 children and one bathroom. I even know what it’s like with 3 children, so that’s why I recommend reconsidering the bathroom concept, or do you want to send your kids out of the warm bathroom after their bath just so they can use the toilet? If you want, you can plan a second toilet upstairs, but a toilet still belongs in every bathroom, especially when there are children. Also, something I just realized: the shower won’t work under the sloping roof either.