更新
基于Pony模型训练了一版人物lycoris，可适用于pony系模型。
参数见版本相关
Update
A version of the character Lycoris was trained based on the Pony model, which can be applied to the Pony series model.
The parameters are in the about the version.
Trained based on NAI final model using 55 images including some koikatsu and game screenshot. Anyway it works well for me when drawing with AOM3A3. (Expect the shobofuku, it seems impossible to draw asymmetrical clothing. And AI likes her shoulder very much. Even I put the "off_shoulder" tag in negative prompt in weight 2. AI still wants to draw her shoulder.)
Sample images information:
Steps: 20, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 1089767602, Size: 512x512, Model hash: eb4099ba9c, Denoising strength: 0.7, Clip skip: 2, ENSD: 31337, AddNet Enabled: True, AddNet Module 1: LoRA, AddNet Model 1: mejiro_ramonuv1_adam8bit_NAIfin(16adf996c8fa), AddNet Weight A 1: 0.65, AddNet Weight B 1: 0.65, Hires upscale: 2, Hires upscaler: Latent
hires.fix up 512X512 to 1024X1024
I suggest using this lora at weight 0.6-0.7. Larger weight may blur the face , or you can try it at higher resolution.
Before training I mirrored the images and tagged them with deepbooru at 0.35 Threshold. I put these images into differnet folder separately.
In terms of the tags of images, I only preserved the “replaceable” tags, like clothes and gesture. Removed all the tags related to the character like horse_ear, two tone hair, eyes, moles, etc. See more details in Lora人物训练（多concept）导论 - 哔哩哔哩 (bilibili.com).
Below are some settings I used in training. The script I used is LoRA_Easy_Training_Scripts. The imporant thing is the setting of "keep_token" parameter. It ensures the trigger word to function.
# Optimizer args
self.optimizer_type: str = "AdamW8bit" # options are AdamW, AdamW8bit, Lion, SGDNesterov,
self.optimizer_args: Union[dict[str:str], None] = {"weight_decay": "0.1",
"betas": "0.9,0.99"}
# scheduler args
self.scheduler: str = "cosine_with_restarts"
self.cosine_restarts: Union[int, None] = 1 # OPTIONAL, represents the number of times it restarts.
self.scheduler_power: Union[float, None] = 1 # OPTIONAL, represents the power of the polynomial.
# learning rate args
self.learning_rate: Union[float, None] = 1e-4
self.unet_lr: Union[float, None] = None # OPTIONAL, Sets a specific lr for the unet, this overwrites
# the base lr in AdamW
self.text_encoder_lr: Union[float, None] = None
self.warmup_lr_ratio: Union[float, None] = None
self.unet_only: bool = False # OPTIONAL, set it to only train the unet
self.net_dim: int = 128 # network dimension, 32 is default, but some people train at higher dims
self.alpha: float = 64 # represents the scalar for training. default is half of dim.
self.train_resolution: int = 768
self.batch_size: int = 1 # The number of images that get processed at one time, this is directly proportional
self.clip_skip: int = 2 # If you are training on a model that is anime based
# steps args
self.num_epochs: int = 10 # The number of epochs, if you set max steps this value is
# ignored as it doesn't calculate steps.
self.save_every_n_epochs: Union[int, None] = 1
# tag args
self.shuffle_captions: bool = True
self.keep_tokens: Union[int, None] = 4
Description
更新
基于Pony模型训练了一版人物lycoris，可适用于pony系模型。
参数见下：
Update
A version of the character Lycoris was trained based on the Pony model, which can be applied to the Pony series model.
The parameters are as follows:
{ "LoRA_type": "LyCORIS/LoCon", "LyCORIS_preset": "full", "adaptive_noise_scale": 0, "additional_parameters": "", "block_alphas": "", "block_dims": "", "block_lr_zero_threshold": "", "bucket_no_upscale": true, "bucket_reso_steps": 128, "cache_latents": false, "cache_latents_to_disk": false, "caption_dropout_every_n_epochs": 0.0, "caption_dropout_rate": 0, "caption_extension": ".txt", "clip_skip": 2, "color_aug": false, "constrain": 0.0, "conv_alpha": 4, "conv_block_alphas": "", "conv_block_dims": "", "conv_dim": 8, "debiased_estimation_loss": false, "decompose_both": false, "dim_from_weights": false, "down_lr_weight": "", "enable_bucket": true, "epoch": 10, "factor": -1, "flip_aug": false, "fp8_base": false, "full_bf16": false, "full_fp16": false, "gpu_ids": "", "gradient_accumulation_steps": "1", "gradient_checkpointing": true, "keep_tokens": 1, "learning_rate": 1.0, "log_tracker_config": "", "log_tracker_name": "", "logging_dir": "", "lora_network_weights": "", "lr_scheduler": "cosine", "lr_scheduler_args": "", "lr_scheduler_num_cycles": "", "lr_scheduler_power": "", "lr_warmup": 0, "max_bucket_reso": 4096, "max_data_loader_n_workers": "0", "max_grad_norm": 1, "max_resolution": "1024,1024", "max_timestep": 1000, "max_token_length": "225", "max_train_epochs": "", "max_train_steps": "", "mem_eff_attn": false, "mid_lr_weight": "", "min_bucket_reso": 1024, "min_snr_gamma": 0, "min_timestep": 0, "mixed_precision": "bf16", "model_list": "custom", "module_dropout": 0, "multi_gpu": false, "multires_noise_discount": 0.1, "multires_noise_iterations": 6, "network_alpha": 8, "network_dim": 16, "network_dropout": 0, "noise_offset": 0, "noise_offset_type": "Multires", "num_cpu_threads_per_process": 2, "num_machines": 1, "num_processes": 1, "optimizer": "Prodigy", "optimizer_args": "weight_decay=0.01 d_coef=1 use_bias_correction=True safeguard_warmup=False betas=0.9,0.99 decouple=True ", "output_dir": "/root/autodl-tmp/output", "output_name": "mejiro_ramonu-ponyXL", "persistent_data_loader_workers": false, "pretrained_model_name_or_path": "/root/kohya_ss/models/ponyDiffusionV6XL.safetensors", "prior_loss_weight": 1.0, "random_crop": false, "rank_dropout": 0, "rank_dropout_scale": false, "reg_data_dir": "/root/autodl-tmp/reg_mejiro_ramonuXL", "rescaled": false, "resume": "", "sample_every_n_epochs": 1, "sample_every_n_steps": 0, "sample_prompts": "score_9, score_8_up, score_7_up, anime BREAK, shobofuku, 1girl, solo, breasts, looking at viewer, smile, short hair, bangs, skirt, simple background, thighhighs, gloves, long sleeves, white background, closed mouth, standing, tail, full body, multicolored hair, shoes, black thighhighs, white gloves, black skirt, ascot, garter straps, white footwear, horse ears, horse girl, single thighhigh, horse tail, single glove, cropped jacket, asymmetrical gloves, mismatched gloves, asymmetrical footwear, mismatched footwear, asymmetrical legwear, --n source_pony, source_furry, source_cartoon, greyscale, from below --w 1024 --h 1024\n ", "sample_sampler": "euler_a", "save_every_n_epochs": 1, "save_every_n_steps": 0, "save_last_n_steps": 0, "save_last_n_steps_state": 0, "save_model_as": "safetensors", "save_precision": "bf16", "save_state": false, "scale_v_pred_loss_like_noise_pred": false, "scale_weight_norms": 0, "sdxl": true, "sdxl_cache_text_encoder_outputs": false, "sdxl_no_half_vae": true, "seed": "31337", "shuffle_caption": true, "stop_text_encoder_training_pct": 0, "text_encoder_lr": 1.0, "train_batch_size": 3, "train_data_dir": "/root/autodl-tmp/mejiro_ramonu_XL", "train_norm": false, "train_on_input": true, "training_comment": "", "unet_lr": 1.0, "unit": 1, "up_lr_weight": "", "use_cp": false, "use_scalar": false, "use_tucker": false, "use_wandb": false, "v2": false, "v_parameterization": false, "v_pred_like_loss": 0, "vae": "/root/kohya_ss/models/sdxl_vae_fp16fix.safetensors", "vae_batch_size": 0, "wandb_api_key": "", "wandb_run_name": "", "weighted_captions": false, "xformers": "xformers" }
FAQ
Comments (2)
Details
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.