Collection of the models for our paper "Intrinsic Credit Assignment for Long Horizon Interaction".