def evolved_transformer_tiny():
  """Base parameters for Evolved Transformer model."""
  hparams = add_evolved_transformer_hparams(transformer.transformer_tiny())
  hparams.learning_rate_schedule = (
      "constant*single_cycle_cos_decay")
  return hparams
Base parameters for Evolved Transformer model.
tensor2tensor/models/evolved_transformer.py