def wmt_enro_tpu():
  """HParams for Transformer model on TPU."""
  hparams = transformer.transformer_base()
  hparams = transformer.update_hparams_for_tpu(hparams)
  hparams.batch_size = 512
  return hparams
HParams for Transformer model on TPU.
tensor2tensor/models/research/transformer_vae_flow_prior.py