<h1 id="proteus-v0.6-lon1uv1df">Proteus v0.6</h1>I'm excited to introduce Proteus v0.6, a complete rebuild of my AI image generation model. This is the first version of the rework, focusing entirely on enhancing photorealism. While it's not aiming to be state-of-the-art, I believe it's a good step forward in producing high-quality images. Please note that this is a preliminary version, and it's not the final, fully-featured checkpoint—more improvements and features will come in future updates.<h2 id="overview-ttgyjmi4z">Overview</h2>Proteus v0.6 is a total rework from the ground up. In previous versions, combining different training methods and learning rates caused the model to become unstable during large-scale training. Learning from those experiences, I've retrained the model using only the photorealism aspects of the Proteus dataset.For now, I'm calling this new training technique Multi-Perspective Fusion.<h3 id="multi-perspective-fusion-qknhk07wb">Multi-Perspective Fusion</h3>This approach involves:<ul><li>Training Multiple LoRAs and Full-Parameter Checkpoints: I trained several Low-Rank Adaptation (LoRA) modules and full-parameter checkpoints on the same dataset multiple times to capture different "perspectives" of the data.</li><li>Integrating into an Overarching Framework: These varied models are then combined within a larger framework to enhance overall performance.</li></ul>I'm hoping this method will be interesting to data scientists exploring advanced training techniques.<h2 id="key-improvements-in-v0.6-6pg2dufoe">Key Improvements in v0.6</h2><ul><li>Total Rebuild: Constructed entirely from scratch to address previous issues.</li><li>Enhanced Photorealism: Focused on producing good-quality photorealistic images.</li><li>Stable Training Process: Refined training methods to prevent the model from falling apart during large-scale training.</li><li>Preliminary Version: This is the first version of the rework; expect more features and improvements in future releases.</li></ul><h2 id="limitations-axgearu9f">Limitations</h2><ul><li>No Illustrations or Anime: Currently, the model can't generate illustrations or anime-style images because it's only been trained on photorealistic data.</li><li>Not State-of-the-Art: While the model performs well, I'm not claiming it's state-of-the-art—just that it's a good starting point.</li><li>Work in Progress: This is not the final, fully-featured checkpoint. More updates are planned.</li></ul><h2 id="usage-mshohgvn5">Usage</h2><h3 id="recommended-settings-dduuoju94">Recommended Settings</h3><ul><li>Clip Skip: 1</li><li>CFG Scale: 7</li><li>Steps: 25 - 50</li><li>Sampler: DPM++ 2M SDE</li><li>Scheduler: Karras</li><li>Resolution: 1024x1024</li></ul><h1 id="versions-before-v0.6proteus's-background-o2bj6xaax"> Versions before v0.6 Proteus's Background</h1>Proteus serves as a sophisticated enhancement over OpenDalleV1.1, leveraging its core functionalities to deliver superior outcomes. Key areas of advancement include heightened responsiveness to prompts and augmented creative capacities. To achieve this, it was fine-tuned using approximately 220,000 GPTV captioned images from copyright-free stock images (with some anime included), which were then normalized. Additionally, DPO (Direct Preference Optimization) was employed through a collection of 10,000 carefully selected high-quality, AI-generated image pairs. In pursuit of optimal performance, numerous LORA (Low-Rank Adaptation) models are trained independently before being selectively incorporated into the principal model via dynamic application methods. These techniques involve targeting particular segments within the model while avoiding interference with other areas during the learning phase. Consequently, Proteus exhibits marked improvements in portraying intricate facial characteristics and lifelike skin textures, all while sustaining commendable proficiency across various aesthetic domains, notably surrealism, anime, and cartoon-style visualizations.

Proteus

ProteusV0.5 Update NotesThis update enhances stylistic capabilities, similar to Midjourney's approach, while also improving prompt comprehension. Methods used do not infringe on any copyrighted material.Key improvements in V0.5:<ul><li>Further refinement of stylistic capabilities</li><li>Enhanced prompt comprehension through a custom-trained CLIP model</li><li>Improved balance between creativity and accuracy</li><li>Expanded training dataset, now totaling over 400,000 images</li></ul>The model has been fine-tuned and trained on a total of 400k+ images at this point, significantly expanding its knowledge base and capabilities.Previous issues noted in V0.4 regarding "being too stylistic/creative" have been addressed in this release. V0.5 aims to strike a better balance between creative output and accurate representation of prompts.

Files with SHA256: 8f511b9fa98a98d20c745025633c638759f61e276d5cb33cc49fec500d5c3396