Love This!
Hey Eric, I am trying to get this running on runpod serverless for ComfyUI. Have you tried that yet? If so do you have any suggestions? I am able to run the job without any validation errors, but the model /or maybe ComfyUI just ends up returning a small empty image. Do you have any suggestions?
I meant to comment this under the distil version sorry.
Hi, I haven't tried on runpod, but a small black image is usually the result of OOM or other error. If you are using my nodes for this, there maybe a message in the console log about what is happening that could help troubleshoot? Not sure which GPU you have or how you have the nodes configured on runpod. Distil version should require less VRAM than instruct, but neither fits on 4090 or 5090 without some block swaps.
I figured it out ty so much I think it’s working!