*Important, please read this before using the model because this is very experimental, I think the training direction is right but it will struggle with hand and complex pose at the moment.You can download the clip text encoder here: <a target="_blank" rel="ugc" href="https://huggingface.co/suzushi/miso-diffusion-m-1.1">https://huggingface.co/suzushi/miso-diffusion-m-1.1</a>Though I merged the clip encoder as well so you can use it directly (without t5).You can use it like this in comfy ui if you prefer to use t5 :<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/e246af24-faf7-42b7-8eba-41121b184f71/width=525/e246af24-faf7-42b7-8eba-41121b184f71.jpeg" />This version is trained with 710k image for 5 epoch.Roughly 261 hours, running a epoch cost around 80 dollars, training a base model is costly, so if possible please consider supporting this project, the cost to develop SD3.5 medium model is slightly lower then sdxl, thousand dollar would allow me to train a million image class model for 10 epoch: <a target="_blank" rel="ugc" href="https://ko-fi.com/suzushi2024">https://ko-fi.com/suzushi2024</a>, if there's any money left it will go towards lora training in the future.Development roadmap:The larger dataset is still in processing, 2.0 aims to be utilize 1.2-1.5 million image dataset and 3.0 aimed at 2.5 million.Opensource commitment:This is a little tool I used to prepare my dataset: <a target="_blank" rel="ugc" href="https://github.com/suzushi-tw/wd14-toolkit">https://github.com/suzushi-tw/wd14-toolkit</a>Roughly 570 dollars was spend on processing the danbooru dataset, each tar file comes with image pair with its txt file as well as characters_list, feel free to use the dataset:<a target="_blank" rel="ugc" href="https://huggingface.co/suzushi">https://huggingface.co/suzushi</a>Recommanded setting, euler, cfg:5 , 32-36 steps, (denoise: 0.95 or 1 )prompt: danbooru style tagging. I recommand simply generating with a batch size of 4 to 8 and pick the best one.Quality tag<pre><code>Masterpiece, Perfect Quality, High quality, Normal Quality, Low quality</code></pre>Aesthetic Tag<pre><code>Very Aesthetic, aesthetic</code></pre>Pleasent<pre><code>Very pleasent, pleasent, unpleasent</code></pre>Additional tag: high resolution, elegantSlight increase in learning rate, the model is far from finished,every epoch still shows significant improvement.Training setting: Adafactor with a batchsize of 40, lr_scheduler: cosineSD3.5 Specific setting:enable_scaled_pos_embed = truepos_emb_random_crop_rate = 0.2weighting_scheme = "flow"learning_rate = 3.5e-6learning_rate_te1 = 2.5e-6learning_rate_te2 = 2.5e-6Train Clip: true, Train t5xxl: false

Files with SHA256: 817a0e9ebe5fd1e380870b6df1f5eabb752fb305f9b88451ff4a6687e23c9b46