It's not about shifting responsibility onto the state. Of course, I made a wrong decision and learned from it. But in a constitutional state, there should be mechanisms to take action against poor performance or false information. Otherwise, unscrupulous craftsmen could continue unpunished.
You do have rights (for example, the Building Code regulates such a case). You just have to sue for them in an emergency. I have already told you how that works.
Have you demonstrably requested remedy of the defect 3 times with a set deadline (preferably in writing)? All 3 attempts have failed.
Therefore, in my opinion, you have the right to withdraw from the contract and claim damages. You can now commission a contractor of your choice to create your staircase free of defects. However, you are also obliged to minimize the damage.
How did you determine that the steps don't hold?
As I said before, I would be happy to receive photos and/or plans.
I can't imagine that an anchorage in the concrete does not hold. Is this a structural defect?
What does your construction manager say about this?