Can I use this checkpoint to run the model using diffusers?

#3
by podidiving - opened

I want to run the model inside diffusers and not ComfyUI.
According to this discussion I know the required config.json file, but when I try to load the model into diffusers (like this: from diffusers import FluxControlNetModel; controlnet = FluxControlNetModel.from_pretrained(controlnet_model,torch_dtype=torch.bfloat16)) I get the following error:

ValueError: Cannot load <class 'diffusers.models.controlnet_flux.FluxControlNetModel'> from mistoline because the following keys are missing: 

AFAIU I have to change key names in safetensors file. Can anyone give me a mapping for such transformation?

podidiving changed discussion status to closed
podidiving changed discussion status to open

Any update on how to load this CN in diffusers?

Sign up or log in to comment