Scaling online optimal transport minibatches to improve flow matching training stability
Scaling Online Optimal Transport Minibatches for Flow Matching
Researchers propose a scalable approximation of online entropic optimal transport that substantially increases the pairing batch size between source samples and data in flow matching training while retaining the benefits of optimal transport. They theoretically prove that the method strictly reduces full stochastic gradient variance and integration error in both the unregularized and entropy-regularized cases, and that the improvement grows as the online coupling batch size increases. Experiments on single-cell gene interpolation flows and image flow training verify that larger online coupling consistently improves training stability and final generation performance.
Open original arxiv.org