aryan5v commited on
Commit
9d0d0d3
·
verified ·
1 Parent(s): 540cfae

Add precomputed AdaLN tables for the 8-step schedule (skip the 26 GB projections)

Browse files
Files changed (2) hide show
  1. README.md +15 -0
  2. transformer/adaln_tables.pt +3 -0
README.md CHANGED
@@ -15,5 +15,20 @@ RTX PRO 6000) or a DGX Spark.
15
  - **VAE:** LynnReal lightweight video VAE with Kijai's INT8 weights; H3 audio VAE.
16
  - **Sampling:** `fastvideo_inference.json` holds the 8-step DMD schedule, which FastVideo reads automatically.
17
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
  For multi-GPU data-center serving, use [FastVideo/FastVideo-FastH3-8-Step-V2-NVFP4](https://huggingface.co/FastVideo/FastVideo-FastH3-8-Step-V2-NVFP4).
19
  Smaller, faster experimental variant: [FastVideo/FastVideo-FastH3-Trim-8-Step-NVFP4](https://huggingface.co/FastVideo/FastVideo-FastH3-Trim-8-Step-NVFP4).
 
15
  - **VAE:** LynnReal lightweight video VAE with Kijai's INT8 weights; H3 audio VAE.
16
  - **Sampling:** `fastvideo_inference.json` holds the 8-step DMD schedule, which FastVideo reads automatically.
17
 
18
+ ## Machines with less than 64 GB of system RAM
19
+
20
+ The 50 AdaLN timestep projections are 26 GB in BF16. `transformer/adaln_tables.pt` (155 MB) holds their precomputed
21
+ outputs for the 8-step schedule, so FastVideo can skip loading them:
22
+
23
+ ```python
24
+ import os
25
+ from huggingface_hub import hf_hub_download
26
+
27
+ os.environ["FASTVIDEO_H3_ADALN_TABLE"] = hf_hub_download(
28
+ "FastVideo/FastVideo-FastH3-8-Step-V2-NVFP4-Consumer", "transformer/adaln_tables.pt")
29
+ ```
30
+
31
+ The table covers only the shipped schedule (`fastvideo_inference.json`); FastVideo raises an error for other timesteps.
32
+
33
  For multi-GPU data-center serving, use [FastVideo/FastVideo-FastH3-8-Step-V2-NVFP4](https://huggingface.co/FastVideo/FastVideo-FastH3-8-Step-V2-NVFP4).
34
  Smaller, faster experimental variant: [FastVideo/FastVideo-FastH3-Trim-8-Step-NVFP4](https://huggingface.co/FastVideo/FastVideo-FastH3-Trim-8-Step-NVFP4).
transformer/adaln_tables.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ae3bdebed7d92a71ba930da9cabacafed92c3c2aa550a284f324aba7841a234
3
+ size 154971509