def ppo_dist_params():
  """Parameters based on the original paper modified for distributional RL."""
  hparams = ppo_original_params()
  hparams.learning_rate_constant = 1e-3
  return hparams
Parameters based on the original paper modified for distributional RL.
tensor2tensor/models/research/rl.py