There’s a whole countermeasures section in TFA that describes a clock-based mitigation for this if you bothered to read it.