<h1 id="mello's-super-duper-early-httyd-lora-model-for-minimax"><strong>Mello's Super Duper Early HTTYD LoRA Model for Minimax</strong></h1><p>Yea. The last stable version I exported before restarting training for the 5th time. I'll be honest the base model already does a solid job at making httyd renders but this just makes the movements and camera movements more natural (Only trained on video, working on audio ver). Trained on 163 clips from 3 "movies" (Ranging from 17-101 frames), 8,000 steps, roughly 22 epochs. (Still finding out the best settings and stuff so it'll be a while till I publicly update this) (Full Demo Video with some extra stuff:</p><div data-youtube-video><iframe width="640" height="480" allowfullscreen="true" autoplay="false" disablekbcontrols="false" enableiframeapi="false" endtime="0" ivloadpolicy="0" loop="false" modestbranding="false" origin playlist src="https://www.youtube.com/embed/8VGPn6NhdgY?rel=1" start="0"></iframe></div><h2 id="recommended-settings">⚡ Recommended Settings</h2><ul><li><p><strong>Trigger Word:</strong> <span style="background-color:rgb(50, 50, 50);color:rgb(252, 252, 252);font-family:&quot;DM Mono&quot;, monospace;font-size:1em">t00thle55</span></p></li><li><p><strong>Base Model:</strong> MiniMax-H3 (<span style="background-color:rgb(50, 50, 50);color:rgb(252, 252, 252);font-family:&quot;DM Mono&quot;, monospace;font-size:1em">I Used the pruned bp16 for the renders</span>)</p></li><li><p><strong>Recommended Weight:</strong> <span style="background-color:rgb(50, 50, 50);color:rgb(252, 252, 252);font-family:&quot;DM Mono&quot;, monospace;font-size:1em">.8 - 1 (If you get heavy noise, turn down weight to .8)</span></p></li><li><p><strong>Task Type:</strong> Text-to-Video (T2V)</p></li></ul><hr /><h2 id="dataset-and-training-specs">📊 Dataset &amp; Training Specs</h2><ul><li><p><strong>Total Clips:</strong> 163 clips (ranging from 17 to 101 frames) across 3 movies</p></li><li><p><strong>Training Steps:</strong> 8,000 steps (~22 epochs)</p></li></ul><h3 id="frame-length-breakdown:">Frame Length Breakdown:</h3><ul><li><p><strong>17 Frames:</strong> 13 videos</p></li><li><p><strong>33 Frames:</strong> 30 videos</p></li><li><p><strong>41 Frames:</strong> 28 videos</p></li><li><p><strong>53 Frames:</strong> 34 videos</p></li><li><p><strong>69 Frames:</strong> 23 videos</p></li><li><p><strong>85 Frames:</strong> 13 videos</p></li><li><p><strong>101 Frames:</strong> 22 videos</p></li></ul><h3 id="links-and-resources">🔗 Links &amp; Resources</h3><ul><li><p>💾 <strong>Mirror:</strong> <a target="_blank" rel="ugc" href="https://www.melloai.art/renders/models/httyd_minimax/"><strong>Link</strong></a></p></li><li><p>🎬 <strong>Tutorial Video (Only use for more prompting info, same link as wan):</strong> <a target="_blank" rel="ugc" href="https://www.youtube.com/watch?v=TCcHq87aC4c"><strong>Link</strong></a></p></li><li><p><strong>The workflow I used:</strong> <a target="_blank" rel="ugc" href="https://civarchive.com/models/2834514/minimax-h3-t2v-i2v-ref2v-advanced-filmmaking-workflow-or-all-speedups-qol-features"><strong>Link</strong></a></p></li></ul><hr /><h2 id="modular-prompt-reference-guide">📋 Modular Prompt Reference Guide</h2><p>💡 <strong>How to use this guide:</strong> Text inside <span style="background-color:rgb(50, 50, 50);color:rgb(252, 252, 252);font-family:&quot;DM Mono&quot;, monospace;font-size:1em">(parentheses)</span> is meant to be replaced with your specific details. Plain text outside parentheses can stay as-is. (This is the same template from Wan btw)</p><h3 id="base-prompt-template">Base Prompt Template</h3><pre><code>t00thle55, (Enter style ex. HTTYD1 Render Style, HTTYD2 Render Style, HTTYD3 Render Style), (If another character is in frame name them here ex. Hiccup). A (shot type ex. wide establishing, medium close-up, low-angle tracking, wide angle from behind) shot of (describe the main focus of the video ex. a 3D rendered black dragon, a 3D rendered teenage boy). (If a dragon or subject is in frame, only describe their primary action, posture, and movement without detailing their specific anatomy yet ex. walks in a circle on all fours in a grass field, flies rapidly through the clouds, crouches defensively with his right paw stretched out). (If a character is in frame and is wearing clothes or gear, describe it here ex. The boy is wearing a green tunic, a brown fur vest, and leather boots).

IF THE DRAGON IS FLYING, ADD THESE TO THE PROMPT, IF NOT REMOVE:
The dragon is in mid-flight with his body (describe aerodynamic posture ex. streamlined and angled slightly upward, banking sharply to the left, pitched straight down for a dive). His main wings are (describe wing state and movement ex. fully extended and gliding smoothly on the updraft, beating with powerful rhythmic downstrokes, tucked tightly to his body to reduce drag). The dragon's legs are (describe leg position ex. tucked flush against his underbelly for aerodynamics, dangling downward as he prepares to land). His tail and tail fins (describe tail and fin mechanics ex. trail straight behind him acting as a rudder, flare wide open to act as an airbrake, shift and tilt to steer through the turn). (If the red prosthetic tail fin and saddle gear are visible, describe them acting in the wind ex. the leather cables pull taut as the red prosthetic fin snaps open). (Optional: describe environmental flight interactions ex. Wingtip vortices trail behind his wingtips, the wind aggressively rushes past his sleek form).

IF TOOTHLESS (THE BLACK DRAGON) IS IN FRAME, ADD THESE TO THE PROMPT, IF NOT REMOVE:
The dragon has a round head with black horns on the sides of his face along with long ears on the top of his head that are (pulled back/perked up/flat) (Remove this or change it if his head isn't visible). The dragon has detailed black scales. The dragon (Describe where and how the dragon is looking, ex. is looking down to the ground, tracks a flying object past the viewer's right). (If the dragon is NOT flying but his wings are visible, add "The dragon's wings are [describe grounded state ex. folded neatly against his sides/resting partially extended on the ground]"). (If the dragon is NOT flying but his tail is visible, add "The dragon's tail [describe grounded movement ex. sweeps over the grass/rests curled around his paws]"). His green eyes are (Describe the dragon's eyes ex. intermittently open, wide open with a curious expression, narrowed aggressively against the wind) showing his (elliptical/round/vertical slit) pupils. He (Describe his mouth and expression ex. has a neutral expression with a closed mouth, is snarling with his teeth exposed, has a gummy toothless smile). (If the dragon blinks, add "The dragon blinks").

IF HICCUP IS IN FRAME, ADD THESE TO THE PROMPT, IF NOT REMOVE:
The boy has messy auburn-brown hair and pale skin. He has a slender face with a small nose and faint freckles (remove this and change it if his head isn't visible). His green eyes are (Describe the boy's eyes ex. wide open with an amazed expression, squinting against the wind). The boy (Describe where and how the boy is looking, ex. looks off to the side at the dragon, stares directly forward while leaning into the wind). He (Describe his mouth and expression ex. has a closed mouth with a subtle nervous smile[if he is talking just say "He is talking with a [describe expression]"]). (If the boy blinks, add "The boy blinks").

IF ANOTHER DRAGON OR VIKING IS IN FRAME, APPLY THE PROMPT CHARACTERISTICS AS THE PREVIOUS SUBJECTS:
(Describe their scales/fur/skin texture. Describe their head shape, horns/spikes, and ears. Describe their wings and tail. Describe their eye color, pupil shape, and gaze direction. Describe their mouth, teeth, and overall expression. Note if they are blinking.)

The camera (enter the camera movements here ex. follows the subject from behind with handheld shake, then rotates towards the front of the man as he stops, is steady). The background is of a (describe the environment ex. blurred forest floor covered in moss and damp earth along with large blurred stone rock cliffs with green moss, a clear blue sky above a vast ocean, a rocky canyon). The lighting is (describe the lighting conditions ex. from an offscreen setting sun and slightly overcast sky, dramatic directional lighting from the fire, neutral daylight).</code></pre><p></p>

Files with SHA256: eccd1ab1229758f7dc850f59f82c993468c84dffec6e4c5f183a56f5f31f36c1