Run SDXL on multiple GPUs

#195
by Scianso - opened

Hi everyone, i have a server with 2 tesla V100 gpus and I want to know if it's possible to run SDXL on both instead of one

@Scianso yes, just set device map to balanced.

Like @YaTharThShaRma999 said, set device map to balanced, but one important detail is it wont double the vram, it will have to load the model onto both.

Sign up or log in to comment