def iwslt_baseline_single_gpu():
  """HParams for Transformer model on TPU."""
  hparams = iwslt_baseline_gpu()
  hparams.batch_size = 1024
  hparams.learning_rate_schedule = "constant*linear_warmup*rsqrt_decay"
  hparams.learning_rate_constant = 0.1
  hparams.learning_rate_warmup_steps = 16000
  return hparams
HParams for Transformer model on TPU.
tensor2tensor/models/research/transformer_vae_flow_prior.py