Difference between BN and IN

It is well known that IN is simply 1-batch of BN. It is true in training phase, but not in inference.

In inference phase, BN uses popular mini-batch statistic for mean and standard variation, while IN uses them unchanged from training time, as noted in AdaIN paper below.

Reference: arxiv.org/abs/1703.06868