2D IMG/Video to 180°/360° real 3D Stereoscopic conversion Experiment
Just drag and drop the images in Comfyui for the workflow or in your MetaQuest/Apple VR to test.
step 1
changing the regular 2D image/video Perspective to Panoramic image
https://github.com/9nate-drake/ComfyUI-PanoTools
https://github.com/nomadoor/ComfyUI-Panorama-Stickers
Step 2: First Frame Out painting to 180°
use flux or SDXL to out paint
Flux fill model
https://huggingface.co/yichengup/flux.1-fill-dev-OneReward/tree/main
360 panorama flux Lora
https://github.com/Insta360-Research-Team/DiT360
https://huggingface.co/Insta360-Research/DiT360-Panorama-Image-Generation/tree/main
https://huggingface.co/crafiq/flux-2-klein-9b-360-panorama-lora
https://huggingface.co/kalle07/FLUX.2-klein-9B-turbo-lora-set/tree/main
https://huggingface.co/nomadoor/flux-2-klein-9B-360-erp-outpaint-lora/tree/main
360 images dataset to train your own lora
https://huggingface.co/datasets/Insta360-Research/Matterport3D_polished
Flux-klein
https://huggingface.co/black-forest-labs/FLUX.2-klein-base-9b-fp8/tree/main
Text-Encoder
https://huggingface.co/Comfy-Org/vae-text-encorder-for-flux-klein-9b/tree/main/split_files
VAE
https://huggingface.co/Comfy-Org/vae-text-encorder-for-flux-klein-9b/tree/main/split_files/vae
WAN-VACE for video out painting
https://huggingface.co/QuantStack/Wan2.2-VACE-Fun-A14B-GGUF/tree/main
https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/tree/main/split_files/vae
OTHER links
https://huggingface.co/rehan-fal/minimax-h3-vr180-sbs-lora
Pls buy me 8X B200s ;(
Description
v1
Comments (1)
Hi. Thanks for posting but I'm not seeing any 3D effect in your example images. As far as I can tell, both eyes are getting exactly the same image. Can you clarify if this lora should produce pictures with actual 3D depth?