def zero_grad(self):
        """Clears the gradients of all optimized parameters."""
        self.wrapped_optimizer.zero_grad()
        self._grads_are_scaled = False
Clears the gradients of all optimized parameters.
infoxlm/fairseq/fairseq/optim/fp16_optimizer.py