def transformer_tpu():
  """HParams for Transformer model on TPU."""
  hparams = transformer_base()
  update_hparams_for_tpu(hparams)
  return hparams
HParams for Transformer model on TPU.
tensor2tensor/models/transformer.py