FLUX Monte Carlo

Note: This model has undergone deterministic bias correction + stochastic regularization. 



Even this took around 2GW of power.



To train a FLUX at FP32 it would take a supercomputer and power-plant.

• This model has 1 Trillion Iterations to restore FP32 precision.

• Do to the complexity of the tensor shape this was done at 10,000 steps per element, with noise guidance based on the tensor.

• FP32 T5 & FP32 CLIP