def distribute(self):
        """Sets `self.model` as `torch.nn.parallel.DistributedDataParallel`."""
        for name in self.models:
            self.models[name] = torch.nn.parallel.DistributedDataParallel(
                module=self.models[name],
                device_ids=[torch.cuda.current_device()],
                broadcast_buffers=False,
                find_unused_parameters=True)
Sets `self.model` as `torch.nn.parallel.DistributedDataParallel`.
runners/base_runner.py