the 1st character make me learn more about lora training.1st time i use AdamW8it and thought it was just another easy boring training,but i found that it doesnt even match to training <a target="_blank" rel="ugc" href="http://image.so">image.so</a> i try a few more times and using diferent settings or images,but the results were same.2 days ago, i found a important video on bilibili:【全网最细的秋叶训练器参数讲解，查漏补缺，LoRA训练，调度器函数，优化器，AdamW8bit,lion,DA,D-Adaptation，prodigy神童优化器】 <a target="_blank" rel="ugc" href="https://www.bilibili.com/video/BV1a3iYY3ETn/?share_source=copy_web&amp;vd_source=62b7af7b4367facd37340c57ca6b1e27">https://www.bilibili.com/video/BV1a3iYY3ETn/?share_source=copy_web&amp;vd_source=62b7af7b4367facd37340c57ca6b1e27</a>it explains meaning of every settings,and then the biggest transform of my lora training was using Prodigy as my <a target="_blank" rel="ugc" href="http://optimizer.it"><span style="background-color:rgb(36, 36, 36);color:rgba(255, 255, 255, 0.87);font-family:-apple-system, BlinkMacSystemFont, &quot;Segoe UI&quot;, Roboto, Oxygen, Ubuntu, Cantarell, &quot;Fira Sans&quot;, &quot;Droid Sans&quot;, &quot;Helvetica Neue&quot;, sans-serif;font-size:14px">optimizer.it</a><span style="background-color:rgb(36, 36, 36);color:rgba(255, 255, 255, 0.87);font-family:-apple-system, BlinkMacSystemFont, &quot;Segoe UI&quot;, Roboto, Oxygen, Ubuntu, Cantarell, &quot;Fira Sans&quot;, &quot;Droid Sans&quot;, &quot;Helvetica Neue&quot;, sans-serif;font-size:14px"> improves my lora quality hugely.from then on, all my loras r using Prodigy until i find a better optimizer<span style="background-color:rgb(36, 36, 36);color:rgba(255, 255, 255, 0.87);font-family:-apple-system, BlinkMacSystemFont, &quot;Segoe UI&quot;, Roboto, Oxygen, Ubuntu, Cantarell, &quot;Fira Sans&quot;, &quot;Droid Sans&quot;, &quot;Helvetica Neue&quot;, sans-serif;font-size:14px">AdamW8bit:<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/48e62752-45b9-434a-81f2-1e5eb0af184e/original=true/48e62752-45b9-434a-81f2-1e5eb0af184e.jpeg" />

Files with SHA256: 6fc3755ea2b379c5185e1e7b1917a0bf3ad8537f1f54cc5d0b2d29473dd4b14e