Instructions to use rain1011/pyramid-flow-sd3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use rain1011/pyramid-flow-sd3 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("rain1011/pyramid-flow-sd3", torch_dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Multi GPU outputs blank video
#22
by philbanjo - opened
I am running my model on 4 P6000 gpus (24gb) and the model runs fully but the output is just a black video. Any idea why this may happen?
Hi, do you use FP16? The model does not support FP16 now. You can use bfloat16 or float32.
ahh! that might be it! my gpu doesnt support bf16, ill try setting it to fp32 and see if anything changes. Thanks so much !
that was the issue - when will FP16 be supported on multi gpus?
philbanjo changed discussion status to closed