def afx_small_p16():
  """Small transformer model with small batch size for fast step times."""
  hparams = afx_small()
  hparams.add_hparam("simulated_quantize_bits", 16)
  return hparams
Small transformer model with small batch size for fast step times.
tensor2tensor/models/research/adafactor_experiments.py