Holographic diversity interferometry (HDI) enables single-shot phase measurement by using two image sensors. However, misalignment between image sensors decreases the phase measurement accuracy. Virtual shifting method, which virtually compensates the misalignment after capturing images, can reduce the influence of the misalignment to the measuring accuracy. In this paper, we confirmed the basic operation of virtual shifting method by a numerical simulation, and report how deference of captured images influences the measurement accuracy of HDI.