wlsaidhi commited on
Commit
b1b4d67
·
verified ·
1 Parent(s): bb25666

Use FastH3 Omni name and add local AI recipes

Browse files
Files changed (1) hide show
  1. README.md +10 -4
README.md CHANGED
@@ -8,15 +8,15 @@ tags:
8
  - comfyui
9
  - diffusion-single-file
10
  - minimax-h3
11
- - omniref
12
  - reference-to-video
13
  - nvfp4
14
  - qad
15
  ---
16
 
17
- # FastH3 OmniRef NVFP4 QAD for ComfyUI
18
 
19
- The ComfyUI-native NVFP4 QAD diffusion model for FastH3 OmniRef. It generates video with synchronized 32-kHz stereo audio from a prompt and ordered image, video and audio references in eight sampling steps.
20
 
21
  [Release collection](https://huggingface.co/collections/FastVideo/fasth3-omniref) · [BF16 release](https://huggingface.co/FastVideo/FastVideo-FastH3-Omni-8-Step-V1) · [Shared ComfyUI components](https://huggingface.co/FastVideo/FastH3-OmniRef-Comfy)
22
 
@@ -28,7 +28,7 @@ Place `fasth3_omniref_qad_nvfp4_comfy.safetensors` in:
28
  ComfyUI/models/diffusion_models/fasth3_omniref_qad_nvfp4_comfy.safetensors
29
  ```
30
 
31
- Download a compatible text encoder, video VAE and audio VAE from [FastH3 OmniRef Comfy](https://huggingface.co/FastVideo/FastH3-OmniRef-Comfy) and place them in `ComfyUI/models/text_encoders/` and `ComfyUI/models/vae/`. The audio VAE and the text encoder's reference-vision support are required. Select a text-encoder format supported by your GPU.
32
 
33
  Accelerated NVFP4 inference requires NVIDIA Blackwell hardware. Use BF16 or FP8 on other GPU families. Quantized output can differ from BF16. This is the ComfyUI format; use the separate FastVideo-format model for FastVideo inference.
34
 
@@ -48,6 +48,12 @@ ComfyUI uses its own model layout, sampler and runtime kernels; outputs can diff
48
  - **UniServe — GB200/B200, RTX PRO 6000 Blackwell and Hopper:** use the [BF16 release](https://huggingface.co/FastVideo/FastVideo-FastH3-Omni-8-Step-V1) and [deployment guide](https://github.com/hao-ai-lab/uniserve/blob/main/docs/minimax_h3/minimax_h3.md).
49
  - **FastVideo local AI — DGX Spark and RTX 5090:** use the [FastVideo-format NVFP4 QAD model](https://huggingface.co/FastVideo/FastH3-OmniRef-NVFP4-QAD) and [local inference guide](https://github.com/hao-ai-lab/FastVideo/blob/main/docs/inference/fasth3_omniref.md).
50
 
 
 
 
 
 
 
51
  ## License
52
 
53
  Use of these weights is governed by the [MiniMax-H3 Community License Agreement](https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE).
 
8
  - comfyui
9
  - diffusion-single-file
10
  - minimax-h3
11
+ - fasth3-omni
12
  - reference-to-video
13
  - nvfp4
14
  - qad
15
  ---
16
 
17
+ # FastH3 Omni NVFP4 QAD for ComfyUI
18
 
19
+ The ComfyUI-native NVFP4 QAD diffusion model for FastH3 Omni. It generates video with synchronized 32-kHz stereo audio from a prompt and ordered image, video and audio references in eight sampling steps.
20
 
21
  [Release collection](https://huggingface.co/collections/FastVideo/fasth3-omniref) · [BF16 release](https://huggingface.co/FastVideo/FastVideo-FastH3-Omni-8-Step-V1) · [Shared ComfyUI components](https://huggingface.co/FastVideo/FastH3-OmniRef-Comfy)
22
 
 
28
  ComfyUI/models/diffusion_models/fasth3_omniref_qad_nvfp4_comfy.safetensors
29
  ```
30
 
31
+ Download a compatible text encoder, video VAE and audio VAE from [FastH3 Omni Comfy](https://huggingface.co/FastVideo/FastH3-OmniRef-Comfy) and place them in `ComfyUI/models/text_encoders/` and `ComfyUI/models/vae/`. The audio VAE and the text encoder's reference-vision support are required. Select a text-encoder format supported by your GPU.
32
 
33
  Accelerated NVFP4 inference requires NVIDIA Blackwell hardware. Use BF16 or FP8 on other GPU families. Quantized output can differ from BF16. This is the ComfyUI format; use the separate FastVideo-format model for FastVideo inference.
34
 
 
48
  - **UniServe — GB200/B200, RTX PRO 6000 Blackwell and Hopper:** use the [BF16 release](https://huggingface.co/FastVideo/FastVideo-FastH3-Omni-8-Step-V1) and [deployment guide](https://github.com/hao-ai-lab/uniserve/blob/main/docs/minimax_h3/minimax_h3.md).
49
  - **FastVideo local AI — DGX Spark and RTX 5090:** use the [FastVideo-format NVFP4 QAD model](https://huggingface.co/FastVideo/FastH3-OmniRef-NVFP4-QAD) and [local inference guide](https://github.com/hao-ai-lab/FastVideo/blob/main/docs/inference/fasth3_omniref.md).
50
 
51
+ ## Local AI resources
52
+
53
+ Run FastH3 Omni on **DGX Spark or RTX 5090 through FastVideo** using the [FastVideo-format NVFP4 QAD weights](https://huggingface.co/FastVideo/FastH3-OmniRef-NVFP4-QAD). Start with the [FastVideo cookbook](https://haoailab.com/FastVideo/cookbook/) and [FastH3 Omni recipe builder](https://haoailab.com/FastVideo/cookbook/minimax-h3/fasth3-omniref/); use the [Spark recipe](https://github.com/hao-ai-lab/FastVideo/blob/main/examples/inference/basic/basic_fasth3_omniref_spark.yaml) or [RTX 5090 recipe](https://github.com/hao-ai-lab/FastVideo/blob/main/examples/inference/basic/basic_fasth3_omniref_rtx5090.yaml) and the [local inference guide](https://github.com/hao-ai-lab/FastVideo/blob/main/docs/inference/fasth3_omniref.md) for the AdaLN table, offload and decoder setup.
54
+
55
+ [FP8 weights](https://huggingface.co/FastVideo/FastH3-OmniRef-FP8) are a separate FastVideo variant; the [FP8 recipe for RTX 4090](https://github.com/hao-ai-lab/FastVideo/blob/main/examples/inference/basic/basic_fasth3_omniref_rtx4090.yaml) illustrates the non-FP4 path with layerwise offload and compatible BF16 encoder components. Use each runtime's matching checkpoint format.
56
+
57
  ## License
58
 
59
  Use of these weights is governed by the [MiniMax-H3 Community License Agreement](https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE).