Do you already have children?
In my opinion, the children should also move to the middle floor. Not only because of the bigger rooms, but also because of your nerves. ;) Our son is 5 1/2 years old. When he is sitting one floor above us in his room and can’t manage something while building with Lego, he calls for me. If he then can’t bring what he built downstairs (because it’s too big), I don’t just have to interrupt my work here, but also have to walk upstairs. With two children and that happening several times a day, that would bother me immensely.
Even if the children have slept poorly, are sick, etc., you always have to walk two floors up from the living room.
You, on the other hand, really only need your bedroom for the night.