Yes, yes, it can work. But for that, we still know far too little about your house. The bad part is, you don’t either. But it will be fine.
Where should it stand? What is the ground like? Is there a slope? What utilities are connected? What heating do you want, which is affordable for you?, energy saving regulation, windows, security, floors, walls, fireplace, sanitary... the list is long. The only thing I know so far is a moderately sized house with an expensive flat roof and a Polish lattice staircase.
Not that I need to know all of that, but you have to know it for your financial plan. Therefore – first comes the needs plan (rooms, area, wishes), then the design, with a rough budget specified. Then you look at how to stick to the budget. Then you plan the details and only then can you eventually talk to the bank. At least that’s how I know it.