I would try to check the parameters of the affine step in each case. Do they look reasonable? Also beware of things like flips in the Z axis slice order.