使用pagedadamw8bit优化器，linear (warm up=min(500步,10%总步数))学习率调度器，选择学习率为0的最后一个epoch。
Masked Diffusion Models are Secretly Learned-Order Autoregressive Models
https://arxiv.org/pdf/2511.19152
Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs https://arxiv.org/pdf/2502.15938
On the Variance of the Adaptive Learning Rate and Beyond
https://arxiv.org/pdf/1908.03265
On the SDEs and Scaling Rules for Adaptive Gradient Algorithms
https://arxiv.org/pdf/2205.10287
Revisiting Small Batch Training for Deep Neural Networks https://arxiv.org/pdf/1804.07612
Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer
https://arxiv.org/pdf/2203.03466
使用vpred+ztsnr+debias estimation loss+scale vpred loss like noise pred+keep tokens separator训练，开启shuffle tokens
推荐训练模型和推理模型的tag使用顺序为先画师画风年份词artist name (2025/2024/2023)，再画师画风周期 artist name (newest/mid/oldest),再画师画风提示词artist name，模拟风格比如jojo (style)和次级风格比如greyscale，然后人物名，服装名，接着是1girl，solo到视角，动作，外貌衣服细节，然后是系列版权名copyright，官方，模拟艺术official art或者official style类时间year xxxx周期newest质量词masterpiece，分辨率absurdes，敏感度explicit。结尾lora模型（即画面占比越大，提示词范围越小越精确的词权重排前，画面占比越小越后，概念越混乱越后。以画面占比优先，提示词精确程度在其后考虑）
sample1：jima \(2025\), jima \(newest\), jima, 1girl, angel, angel wings, ass, between breasts, blush, bottomless, breasts, covered nipples, hair between eyes, hair intakes, hair spread out, halo, large breasts, long hair, long sleeves, looking at viewer, lying, naked shirt, navel, no bra, on side, open clothes, open mouth, open shirt, parted lips, pink eyes, purple eyes, see-through, shirt, solo, stomach, thighs, very long hair, white hair, white shirt, white theme, white wings, wings, year 2025, newest, masterpiece, best quality, absurdres, highres, questionable
sample2:jima \(2024\), jima \(newest\), jima, 1girl, belt collar, black collar, bra, breasts, chain, chain leash, collar, demon girl, demon horns, demon tail, demon wings, female pov, hair between eyes, hair dryer, hand up, horns, leash, long hair, looking at viewer, low wings, mini wings, mirror, nail polish, navel, open mouth, panties, parted lips, purple eyes, purple hair, purple nails, reflection, small breasts, solo, standing, stomach, tail, twintails, underwear, underwear only, very long hair, white bra, white panties, wings, original, year 2024, newest, masterpiece, best quality, absurdres, highres, sensitive
模型可能过拟合，记得降权使用
lora参数查看器https://xypher7.github.io/lora-metadata-viewer/
推荐使用https://civarchive.com/articles/4560/upscaling-images-using-multidiffusion 方法,并配合adetailer插件修脸放大
或者使用高清修复，并配合adetailer插件修脸，否则画面将模糊
画师fanbox https://jima.fanbox.cc/?utm_campaign=www_profile&utm_medium=site_flow&utm_source=pixiv
画师pixiv https://www.pixiv.net/users/4359745
（请支持画师谢谢喵/Please support the artist thank you meow）
Description
lokr v1.8版本使用max token length=675，可能导致模型出现元素混乱，错位。这个是因为noobaixl底模使用的max token length=77和此模型不符导致的（类似与1024x1024分辨率训练的底模上使用1536x1536分辨率训练lora，由于训练集太小导致元素混乱，如果觉得效果不好可以用回v1.7版本）
gemini translated：
The LoKR v1.8 version uses a max_token_length of 675, which may cause chaotic or misplaced elements in the generated images. This issue stems from an incompatibility with the noobai-XL base model, which was trained using a max_token_length of 77.
(This is analogous to training a LoRA at a 1536x1536 resolution on a base model originally trained at 1024x1024; such a mismatch can lead to chaotic elements if the training set is too small.)
If you find the results unsatisfactory, you can revert to the v1.7 version.
FAQ
Details
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.