Latency is the first thing to check and the last thing anyone checks. Log commanded vs measured joint position and look at the phase lag.

We found the same, plus a 6 ms jitter from DDS discovery. Pinning the participant removed it.