Theoretically, you could first do the foundation. Leave it for three months. Concrete slab - leave for six months - after each exterior wall also a two-month break - load-bearing walls one month break. Ceiling - four months break. Then first close the downstairs with windows and doors. Then six months break. In the next four months, then waterproof the concrete slab and gradually install empty conduits, pipes, and chases for electrical and plumbing.
If you cover the stairwell with a nice panel, more is possible. That is already two years. Then the same procedure upstairs, another two years. Then interior finishing another two years per floor. With the supply bottlenecks for various building services products, it is entirely plausible to extend that by another two years. I think you can stretch a house construction nicely over more than 10 years without the structure suffering significant damage if you don't have a break of more than a year.
You can't just do that theoretically, but practically as well.
However, there is one single, not to be underestimated problem. MONEY.
Either you finance it, then the bank is breathing down your neck - both because progress is slow and because the commitment interest weighs on your mind. And if you have financed, then you don't need to stretch out the time. The bank will not only advance the financing. They will want the entire construction project covered.
Or you must/can't finance, then you have to keep saving money (for that, you need a decent income) to continue building. That makes no sense either, especially if you need new craftsmen each time for small tasks.
The procedure you described is typical for self-builders who only ever save up for new material and then spend a week of vacation/overtime to continue building. In that case, the house construction is legal and cost-effective, planned over several years.