I have some other failed attempts (in terms of frame bucket or resolution bucket attempts on 2x 3090s) that I will post if there is any interest, but this one I threw more hardware at it. I ended up going all out and trying renting an H100 on Runpod for around 24 hours. I'll edit this post with the config next time I spin up a Runpod session.