Based on the viewpoint of Fourier optics, we have analysed systematically the (monochromatic) point spread function and transfer function of rainbow holographic imaging limited by an arbitrary aperture, revealed the essential relation between the function and the aperture, then established a unified theory which is analogous to that of conventional imaging system. Thus we provided a simple and clear mathematical basis for calculation of the limited resolution and the cut-off frequency.