This LoRA model is in testing stage, it should not be anticipated to get highly amazing results.
This is my first LoRA.
Notes:
The dataset contains few features related to Lumi, thus this model may behaves not well in generating images related to it.
Entire dataset was tagged with only natural language and I did not test if tag-string prompt works well.
If there is any error, please let me know.
Description
param(
[string]$Optimizer = "customized_optimizers.muon_lora.AdaMuonLoRA",
[string]$LR = "5e-3",
[int] $MaxSteps = 2000,
[int] $Dim = 64,
[int] $Alpha = 64
)