def symmetrize(x):
    "Make layer symmetric in final two dimensions, used for contact prediction."
    return x + x.transpose(-1, -2)
Make layer symmetric in final two dimensions, used for contact prediction.
dpkd/transformers/src/transformers/models/esm/modeling_esm.py