如题，这个也是实验产物，使用了新的lora-scripts环境torch 2.0.0，torchvision <a target="_blank" rel="ugc" href="http://0.15.0.dev">0.15.0.dev</a>，xformers 0.0.17，并更新的新的优化器。实际速度可以达到5it/s （4090，windows11，512*512，2 batch size，use lion，enable LoCon train）As the title says, this is also an experimental product, using the new lora-scripts environment torch 2.0.0, torchvision <a target="_blank" rel="ugc" href="http://0.15.0.dev">0.15.0.dev</a>, xformers 0.0.17, and an updated new optimizer.

Files with SHA256: 658ea9152f087e798a4fafbd229c93d165b5cea44144bba84824ee34c5a8c049