def rlmf_eval_dist():
  """Distributional set of hparams for model-free PPO."""
  hparams = rlmf_eval()
  hparams.distributional_size = 4096
  hparams.distributional_subscale = 0.08
  hparams.base_algo_params = "ppo_dist_params"
  return hparams
Distributional set of hparams for model-free PPO.
tensor2tensor/models/research/rl.py