def ppo_original_tiny():
  """Parameters based on the original PPO paper, tiny version."""
  hparams = ppo_original_params()
  hparams.epoch_length = 5
  hparams.optimization_batch_size = 1
  return hparams
Parameters based on the original PPO paper, tiny version.
tensor2tensor/models/research/rl.py