Hm, I don't see any technical defect there. I have over 80 spots with 230 V LED bulbs in my house. My wall lamps, staircase lighting, and outdoor lighting are also LED and without a transformer.
On the topic: GU5.3 are usually for sockets for 12V bulbs. GU10 are usually for 230V bulbs. You cannot use the depicted sockets for 230V bulbs.
Both the GU5.3 and the GU10 bulbs are available with MR16 reflector (50 mm housing) and are possibly interchangeable. The GU5.3 also comes with MR11 reflector, which is a bit smaller (35 mm housing).
I would do it like this: remove the transformer – clamp a GU10 socket onto the cable (99 cents on Amazonas), insert a 230V LED bulb there (e.g. LEDON). If you previously had 50 mm halogen spotlights, the LED bulbs fit into the old sockets.