- No image input: Text-to-video mode
- One image input: First-frame-to-video or last-frame-to-video generation
- Two image inputs: First-and-last-frame-to-video generation | | H3-Base-Ref2VA | Omni-reference mode | Supports multi-modal reference inputs:
- **Images:** ≤ 9 images
- **Videos:** ≤ 3 clips; each clip must be 2–15 seconds long; total duration ≤ 15 seconds
- **Audio:** ≤ 3 clips; each clip must be 2–15 seconds long; total duration ≤ 15 seconds
- **Mixed inputs:** Maximum number of files across all input types is 12 |  The complete H3 system consists of the following three modules: - H3-Context-IR: As inputs become increasingly complex, we build a dedicated system to deeply understand and refine the input multimodal instructions, then convert them into a form that H3 can readily understand—the Context Intermediate Representation—for generation. **H3-Context-IR is critical to the quality of the final output, so we strongly recommend incorporating it into your generation pipeline or following the “Prompting Guidance” to build your own context-processing system.** - H3-Base: Generates audio and video based on the H3-Context-IR output, producing results at 768p resolution. - H3-Regenerate-2K: Feeds the 768p result together with the original context back into H3 to regenerate the output at 2K resolution. This process leverages both H3’s powerful generative capabilities and the rich information contained in the original context, enabling it to produce high-resolution outputs with more accurate details and greater visual fidelity. ## Model Architecture ### H3\-Context\-IR H3\-Context\-IR is a hosted preprocessing and orchestration system designed for free\-form multimodal inputs\. It interprets the relationships among text, images, audio, and reference videos, as well as how these materials relate to the intended generation output\. Its internal workflow includes instruction parsing, cross\-modal association, temporal understanding, and complex logical reasoning\. H3\-Context\-IR serializes its understanding of the context into a structured representation accepted by H3\-Base\. Without deviating from the user’s original intent, it may also supplement missing or underspecified semantic details where appropriate\. Because H3\-Context\-IR relies on a multi\-stage workflow and multiple hosted models and services, it is not included in this open\-source release\. We provide an API that enables users to reproduce the behavior of the official workflow\. We also provide detailed tutorials, and developers can follow the **Prompting Guidance** to build their own preprocessing systems\. For detailed usage instructions, see **Recommended Workflow — Full 2K Workflow**\. **Safety Guardrails** User\-submitted text, images and videos, as well as enhanced prompts, are subject to automated moderation\. Content suspected of being unlawful, pornographic, or infringing third\-party rights may be blocked\. We use industry\-standard filtering measures but cannot eliminate false positives or false negatives\. These guardrails do not affect the Licensee’s obligations under the MiniMax H3 Community License, especially those relating to lawful use and use restrictions\. ### H3\-Base  #### Architecture Overview - H3\-Base encodes different modalities using their corresponding encoders or VAEs and organizes the encoded representations into a unified packed multimodal sequence\. RoPE is used to capture the necessary spatial and temporal relationships among tokens before the entire sequence is passed to the H3\-Omni\-Transformer\. - Specifically, text is encoded by the H3\-Encoder; visual inputs are encoded by both the H3\-Encoder and the H3\-VisualVAE; and audio is encoded solely by the H3\-AudioVAE\. - The H3\-Omni\-Transformer jointly predicts video and audio latents, which are then decoded into video and stereo audio, respectively\. - To reduce the computational cost of long multimodal sequences, H3 natively supports sparse\-attention training and inference\. The initial open\-source release provides inference with full attention only\. Our sparse\-attention implementation will be released in a future update\. #### H3\-Encoder - The H3\-Encoder uses the full pretrained weights of Qwen3\-VL\-32B and provides the hidden states from its 50th layer to the H3\-Omni\-Transformer\. - We add several special tokens, such as `
| stage | request | result |
|---|---|---|
| H3-Context-IR | View script | |
| H3-Base | View script | t2va.mp4 |
| H3-Regenerate-2K | View script | t2va_2k.mp4 |
| Reference 2K result by directly calling Open Platform API | View script | h3_direct_2k.mp4 |
| Reference 768P result by directly calling Open Platform API | View script | h3_direct_768p.mp4 |
| stage | request | result |
|---|---|---|
| H3-Context-IR | View script | |
| H3-Base | View script | i2va.mp4 |
| H3-Regenerate-2K | View script | i2va_2k.mp4 |
| Reference 2K result by directly calling Open Platform API | View script | i2va_direct_2k.mp4 |
| Reference 768P result by directly calling Open Platform API | View script | i2va_direct_768p.mp4 |
| stage | request | result |
|---|---|---|
| H3-Context-IR | View script | |
| H3-Base | View script | r2va.mp4 |
| Reference 2K result by directly calling Open Platform API | View script | r2va_2k.mp4 |
| H3 API 2K in Open Platform for reference | View script | r2va_direct_2k.mp4 |
| Reference 768P result by directly calling Open Platform API | View script | r2va_direct_768p.mp4 |
Description
FAQ
text-to-video
image-to-video
image-text-to-video
video-to-video
text-to-audio-video
image-to-audio-video
image-text-to-audio-video
video-to-audio-video
audio-to-audio-video
audio-video-generation
multimodal
synchronized-audio-video
reference-to-audio-video
diffusers
Details
Downloads
2,545
Platform
Civision
Platform Status
Available
Created
7/31/2026
Updated
8/15/2026
Deleted
-