使用pagedadamw8bit优化器，linear (warm up=min(500步,10%总步数))学习率调度器，选择学习率为0的最后一个epoch。

Masked Diffusion Models are Secretly Learned-Order Autoregressive Models

https://arxiv.org/pdf/2511.19152

Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs https://arxiv.org/pdf/2502.15938

On the Variance of the Adaptive Learning Rate and Beyond

https://arxiv.org/pdf/1908.03265

On the SDEs and Scaling Rules for Adaptive Gradient Algorithms

https://arxiv.org/pdf/2205.10287

Revisiting Small Batch Training for Deep Neural Networks https://arxiv.org/pdf/1804.07612

Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer

https://arxiv.org/pdf/2203.03466

使用vpred+ztsnr+debias estimation loss+scale vpred loss like noise pred+keep tokens separator训练，开启shuffle tokens

推荐训练模型和推理模型的tag使用顺序为先画师画风年份词artist name (2025/2024/2023)，再画师画风周期 artist name (newest/mid/oldest),再画师画风提示词artist name，模拟风格比如jojo (style)和次级风格比如greyscale，然后人物名，服装名，接着是1girl，solo到视角，动作，外貌衣服细节，然后是系列版权名copyright，官方，模拟艺术official art或者official style类时间year xxxx周期newest质量词masterpiece，分辨率absurdes，敏感度explicit。结尾lora模型（即画面占比越大，提示词范围越小越精确的词权重排前，画面占比越小越后，概念越混乱越后。以画面占比优先，提示词精确程度在其后考虑）

sample1：jima \(2025\), jima \(newest\), jima, 1girl, angel, angel wings, ass, between breasts, blush, bottomless, breasts, covered nipples, hair between eyes, hair intakes, hair spread out, halo, large breasts, long hair, long sleeves, looking at viewer, lying, naked shirt, navel, no bra, on side, open clothes, open mouth, open shirt, parted lips, pink eyes, purple eyes, see-through, shirt, solo, stomach, thighs, very long hair, white hair, white shirt, white theme, white wings, wings, year 2025, newest, masterpiece, best quality, absurdres, highres, questionable

sample2:jima \(2024\), jima \(newest\), jima, 1girl, belt collar, black collar, bra, breasts, chain, chain leash, collar, demon girl, demon horns, demon tail, demon wings, female pov, hair between eyes, hair dryer, hand up, horns, leash, long hair, looking at viewer, low wings, mini wings, mirror, nail polish, navel, open mouth, panties, parted lips, purple eyes, purple hair, purple nails, reflection, small breasts, solo, standing, stomach, tail, twintails, underwear, underwear only, very long hair, white bra, white panties, wings, original, year 2024, newest, masterpiece, best quality, absurdres, highres, sensitive

模型可能过拟合，记得降权使用

lora参数查看器https://xypher7.github.io/lora-metadata-viewer/

推荐使用https://civarchive.com/articles/4560/upscaling-images-using-multidiffusion 方法,并配合adetailer插件修脸放大

或者使用高清修复，并配合adetailer插件修脸，否则画面将模糊

画师fanbox https://jima.fanbox.cc/?utm_campaign=www_profile&utm_medium=site_flow&utm_source=pixiv

画师pixiv https://www.pixiv.net/users/4359745

（请支持画师谢谢喵/Please support the artist thank you meow）