A quantum gate is not a tiny switch. It is a physical process.
Depending on the kind of quantum computer, the gate might be made by a laser pulse, a microwave signal, an electrical field, or some other carefully tuned interaction. The goal is always the same: move the qubit from one quantum state to another with extreme precision.
Each of these effects can nudge the final state a little away from where it was supposed to land.
Figure 1: An ideal gate lands the qubit exactly on the target state; a physical gate scatters around it. Gate fidelity measures how closely the physical operation matches the ideal one. The lower insets show the idea schematically: moving from 99.9% to 99.99% fidelity represents a tenfold reduction in gate infidelity.
From 99.9% to 99.99% is a tenfold cut in gate infidelity. The small-looking step is the whole story.
A gate fidelity of 99.9% means the real operation is, on average, very close to the ideal one. The matching gate infidelityThe error left over in a gate (100% minus the fidelity). Moving from 99.9% to 99.99% fidelity cuts this tenfold, which is a big deal. is roughly 0.1%.
The gap between 99.9% and 99.99% looks small. It is not. Measured by the same method and under comparable conditions, it is a tenfold cut in gate infidelity.