Welcome to the official repository for Chenkin-UniControl-XL!

Trained on top of the latest ckn v0.5 base model, this is a dedicated Universal ControlNet tailored specifically for anime/2D generation workflows. It solves the common pain points of traditional ControlNets, such as style degradation, muddy colors, or an overly "AI-generated" look when applied to anime illustrations.

Features

1. 8-in-One Control: This model integrates 8 of the most commonly used ControlNet types into a single base model, supporting the following modes:

   • OpenPose

   • Depth

   • HED / PIDI / Scribble / TED

   • Canny / Lineart / MLSD

   • Normal

   • Tile

   • Inpaint / Outpaint

   • Fuse (Experimental)

2. Native Style Preservation: Trained with the aesthetic foundation of ckn v0.5's massive high-quality anime dataset, using any of the control modes will not pollute the color and lighting performance of the base model.

3. Deeply Customized ComfyUI Nodes: Due to its unique underlying architecture, this model must be paired with the exclusive advanced nodes developed by our team members to unlock its full functionality.

Killer Feature: Fuse (Multi-Condition Fusion Control)

Among the 8 control modes, we have specially unlocked the highly advanced Fuse mode at the architectural level.

In traditional workflows, using "Lineart + Depth + Pose" simultaneously requires loading 3 separate ControlNets. This not only causes VRAM explosion and extremely slow generation but also leads to weight interference.

The Fuse mode completely revolutionizes this:

• Merged Calls, Doubled Performance: It allows you to input multiple control conditions simultaneously (e.g., choose 2 or 3). The underlying Condition Transformer naturally fuses these various features, merging multiple ControlNet calls into a single call.

• No Control Interference: Multiple control signals are synergized at the base level before entering the main model, completely solving the issue of image degradation caused by stacking multiple ControlNets. This achieves extremely complex and precise control with minimal VRAM usage.

Mandatory: Exclusive Plugin Dependency

Note: This model cannot be used directly with ComfyUI's native ControlNet nodes!

To achieve the complex routing of the "All-in-One" functionality and extremely high control freedom, you MUST install and use the exclusive plugin lead-developed by our team member @chinoll: ComfyUI-Advanced-ControlNet.

Core advantages of the exclusive plugin:

• Multi-Mode Switching: Seamlessly switch between the 8 control modes mentioned above directly via a dropdown menu in the node.

• Soft Weights: Perfectly replicates the "My prompt is more important" and "ControlNet is more important" features from WebUI, allowing for extremely fine-grained weight transitions.

• Timestep Scheduling: Allows the ControlNet to intervene or exit at specific sampling step intervals, preventing stiff generations.

Node Installation:

cd custom_nodes
git clone https://github.com/chinoll/ComfyUI-Advanced-ControlNet.git

Download & Setup

1. Download the .safetensors model file from this repository.

2. Place it in your ComfyUI/models/controlnet/ directory.

3. In ComfyUI, use the Load Advanced ControlNet Model node to load this model, and connect it to the Apply Advanced ControlNet node for generation.

4. Reference Workflow: We provide a basic reference workflow for the Fuse mode. You can download example/controlnet-fuse.json and drag it directly into ComfyUI to experience it.

License & Credits

• License: This model inherits the open-source spirit of the ckn base model and follows the fair-ai-public-license-1.0-sd license. Any form of commercialization or reselling is strictly prohibited.

• Team Credits: Thanks to the ckn team's Frontier Technology Lab and our team member @chinoll for their core technical breakthroughs in training this all-in-one model and developing the underlying architecture for the exclusive node.