featuring:
A universal FL2VA / REF2VA hybrid base model
A Low-Sigma second-pass workflow
Main goals: reduce noise, recover detail, and improve overall visual quality
The second-pass workflow is based on a segmented denoising approach using Sigma Extension + SplitSigmasDenoise.
By splitting the H3 denoising process with Split Sigma, the workflow separates it into two stages:
Stage 1 — Motion Generation
Uses relatively higher Turbo / motion LoRA weights to handle movement, temporal structure, and action generation.
Stage 2 — Low-Sigma Detail Refinement
No additional noise is introduced, while LoRA strength is reduced. Only the remaining low-Sigma section is used to continue refining the existing latent.
The goal is to reduce noise and recover finer details while preserving the original motion and temporal logic as much as possible.
About the Base Model
The workflow uses the recommended hybrid model:
minimax_h3_hybrid_fl2va_ref2va_b25-49
Its basic principle is to use FL2VA as the main model, while replacing only the adaln_proj conditioning modulation layers of selected Transformer Blocks with weights from Ref2VA.
This means there is no need for a dual-model second pass. A single hybrid model can attempt to combine:
FL2VA image and audio quality
Ref2VA reference consistency
The name b25-49 means that Transformer Blocks 25–49 use the Ref2VA modulation-layer weights.
Differences Between the Hybrid Variants
The main difference is how many later Transformer Blocks use Ref2VA adaln_proj weights.
Generally, using more Ref2VA blocks provides stronger reference consistency, but image and audio characteristics gradually move closer to Ref2VA.
b30-49
More FL2VA-oriented. Best image/audio quality, but relatively weaker reference consistency.
b25-49
Balanced version. Good compromise between image quality and reference consistency, recommended as the default.
b20-49
More Ref2VA-oriented. Stronger reference consistency, with a slight reduction in image/audio quality.
b15-49
The most Ref2VA-oriented version. Strongest reference consistency, but also the largest quality trade-off compared with the original FL2VA model.
Overall, this setup supports both FL2VA and REF2VA workflows without maintaining two separate base models, and can be used on 12GB GPUs.
本期分享一套 MiniMax H3 12GB 可用方案:
FL2VA / REF2VA 通用底模
低 Sigma 二采工作流
核心作用:去噪点 + 补细节 + 提升观感
这套二采基于Sigma 扩展 + SplitSigmasDenoise 的分段思路:
通过 Split Sigma 将 H3 去噪过程拆成动作生成阶段与低 Sigma 细节收敛阶段。第一阶段保持较高 Turbo / 动作 LoRA 权重负责运动和时序,第二阶段关闭新增噪声并降低 LoRA 权重,只利用末段低 Sigma 对已有 latent 继续收敛,从而在尽量不改变原有动作逻辑的情况下减少噪点并补充细节。
关于底模:使用的别人推荐的minimax_h3_hybrid_fl2va_ref2va_b25-49
原理:以 FL2VA 为主体,仅将部分 Transformer Block 的 adaln_proj 条件调制层替换为 Ref2VA 权重,不需要双模型二采,单模型即可尝试兼顾 FL2VA 的画质与 Ref2VA 的参考能力。b25-49 即第 25–49 Block 使用 Ref2VA 的调制层权重。
b30-49:更偏 FL2VA,画质/音频质量最好,参考能力相对弱一些。
b25-49:偏均衡,画质和参考能力兼顾,适合作为默认版本。
b20-49:更偏 Ref2VA,参考一致性更强,但画质/音频略有下降。
b15-49:最偏 Ref2VA,参考能力最强,同时也是四个版本里对原始 FL2VA 质量牺牲最大的。
整体方案支持 FL2VA / REF2VA 通用,不需要分别维护两套底模,12GB 显卡可用。
Description
FAQ
Comments (21)
效果非常棒,配置要求也不高,给大佬点个赞!另外问一下lora V2.0版啥时候发布啊?
还在测试,一打一效果不错,一到一打多就崩了,我看看能不能做个提示词模板出来
辛苦啦,敬候佳音!
Hey man, thanks for sharing this. I used your workflow with same loras, models and strengths, and made no changes at all. Only updated the prompt to suit the two high resolution input images (https://ibb.co/Sjm8Dz9). My output video (posted below) does have great motion but doesn't seem to be good quality at all, I used the same 0.5 resolution (960x544) like it's in the workflow. Am I doing something wrong?
Also, you might want to link your Combat lora in the workflow and/or here. And the link to the hybrid model seems to have changed. I found it here - https://huggingface.co/smhfacct/Minimax-H3-fl2va-ref2va-hybrid-models/tree/main. Thanks again.
I can't see your video. What's your prompt? The images generated vary greatly depending on the prompt.
@FourBunny Thank you. Here's the prompt (was revised by ChatGPT) - https://pastebin.com/2A0Ah9Cn and video I generated is below in the Review section for your workflow.
@Pitiful_Season42942867 Your video looks pretty good.
@FourBunny Thanks, I tried with two real characters and upped the resolution to 0.6, looks much better. Many thanks!!
Those images are not good as character reference. What you want instead is a reference sheet that includes: (a) full body front, (b) full body back, and (c) big head & shoulder closeup
@Daedalus_7 Got it, thank you. :)
@Daedalus_7 I'm stealing this information 😁
@Pitiful_Season42942867 But to be honest, your videos are DECENT, at least, to my eyes. I'm diving into Ref2va today and if I get results similar to yours, I'll be happy with it 😌✌️
At your recommended minimums (12vram 32ram), this workflow can barely manage 3 reference images, and crashes on 4. Not even gonna try audio or video references
I have a 4070 TI with 12 GB of VRAM and 32 GB of RAM, and I can use four images to create a 10-second video at 0.8 MP.
@FourBunny What's your average generation time at those settings?
@mobdik17378 0.5MP,10s,At around 7 minutes and 30 seconds, while the 0.8MP is at 11 minutes
The output result is super muddy, like there's a lot of noise on it
Were any upscaling nodes added?
@FourBunny No. Just copied what you did onto my setup. Instead of using the hybrid model I'm using the ref2v model, and using the ref2v turbo instead of the fl2v lightning... And I'm using the Combat lora V2 insead of the v1 (I guess that's what you used?) Could that be it?
@Pinkink2 I can also use it with the pruned INT8 version of REF2V; as you can see, it's included in my latest demo. Are you using a non-pruned model?
Thx. man. In fact, it works even better than I expected. I do martial arts scenes with real punches and after few tests I am very satisfied.