Instructions to use FastVideo/FastVideo-FastH3-8-Step-V2-NVFP4-Consumer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use FastVideo/FastVideo-FastH3-8-Step-V2-NVFP4-Consumer with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("FastVideo/FastVideo-FastH3-8-Step-V2-NVFP4-Consumer", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Add precomputed AdaLN tables for the 8-step schedule (skip the 26 GB projections)
Browse files- README.md +15 -0
- transformer/adaln_tables.pt +3 -0
README.md
CHANGED
|
@@ -15,5 +15,20 @@ RTX PRO 6000) or a DGX Spark.
|
|
| 15 |
- **VAE:** LynnReal lightweight video VAE with Kijai's INT8 weights; H3 audio VAE.
|
| 16 |
- **Sampling:** `fastvideo_inference.json` holds the 8-step DMD schedule, which FastVideo reads automatically.
|
| 17 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
For multi-GPU data-center serving, use [FastVideo/FastVideo-FastH3-8-Step-V2-NVFP4](https://huggingface.co/FastVideo/FastVideo-FastH3-8-Step-V2-NVFP4).
|
| 19 |
Smaller, faster experimental variant: [FastVideo/FastVideo-FastH3-Trim-8-Step-NVFP4](https://huggingface.co/FastVideo/FastVideo-FastH3-Trim-8-Step-NVFP4).
|
|
|
|
| 15 |
- **VAE:** LynnReal lightweight video VAE with Kijai's INT8 weights; H3 audio VAE.
|
| 16 |
- **Sampling:** `fastvideo_inference.json` holds the 8-step DMD schedule, which FastVideo reads automatically.
|
| 17 |
|
| 18 |
+
## Machines with less than 64 GB of system RAM
|
| 19 |
+
|
| 20 |
+
The 50 AdaLN timestep projections are 26 GB in BF16. `transformer/adaln_tables.pt` (155 MB) holds their precomputed
|
| 21 |
+
outputs for the 8-step schedule, so FastVideo can skip loading them:
|
| 22 |
+
|
| 23 |
+
```python
|
| 24 |
+
import os
|
| 25 |
+
from huggingface_hub import hf_hub_download
|
| 26 |
+
|
| 27 |
+
os.environ["FASTVIDEO_H3_ADALN_TABLE"] = hf_hub_download(
|
| 28 |
+
"FastVideo/FastVideo-FastH3-8-Step-V2-NVFP4-Consumer", "transformer/adaln_tables.pt")
|
| 29 |
+
```
|
| 30 |
+
|
| 31 |
+
The table covers only the shipped schedule (`fastvideo_inference.json`); FastVideo raises an error for other timesteps.
|
| 32 |
+
|
| 33 |
For multi-GPU data-center serving, use [FastVideo/FastVideo-FastH3-8-Step-V2-NVFP4](https://huggingface.co/FastVideo/FastVideo-FastH3-8-Step-V2-NVFP4).
|
| 34 |
Smaller, faster experimental variant: [FastVideo/FastVideo-FastH3-Trim-8-Step-NVFP4](https://huggingface.co/FastVideo/FastVideo-FastH3-Trim-8-Step-NVFP4).
|
transformer/adaln_tables.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2ae3bdebed7d92a71ba930da9cabacafed92c3c2aa550a284f324aba7841a234
|
| 3 |
+
size 154971509
|