As already mentioned, it is either direct sunlight or there is something wrong with the insulation. The underfloor heating is slower to warm up than radiators, but hardly slower to switch off. Off is off in both cases, and neither system provides active cooling. Both systems heat floors and walls, which then continue to emit heat afterwards, with the underfloor heating doing so just a bit more.
Insulation plays a much bigger role in the inertia towards cooling. A modern house hardly loses any heat and therefore takes ages to cool down. Even if it suddenly drops below freezing outside, the slowest underfloor heating still balances out faster than the house cools down. Anyone who suddenly loses a few degrees during the day has a problem with the insulation!
The same applies in summer. If it gets warmer outside, the outdoor sensor regulates this and the heating is off before the heat can enter the house. If heat comes directly as sunlight through the windows, that naturally warms the house strongly, independently of the heating. Shading is the solution here.