Multi-modal imaging of muon uses both the information of scattering muons penetrating the material and the information of muons stopped by material and generating secondary induced neutrons effectively. In order to evaluate the image quality of multi-modal imaging of muon, the detection model was set up based on Geant4 and the reliability of the detection model was verified. Both the multiple Coulomb scattering module and the muon induced neutron module were proved to be reliable. The simulation programs of multi-modal imaging of muon, muon scattering imaging and muon imaging in coincidence with muon induced neutrons were developed using Cosmic-ray Shower Library as particle source, and the imaging algorithms and reconstructed images were implemented respectively on the basis of the simulated data. Four imaging models were set up, the first one was line pair model used to study the spatial resolution of reconstructed images with imaging time ranging from two hours to two weeks. The second one was cube model used to study the material resolution of reconstructed images with imaging time ranging from one hour to twelve hours. The third one was cladding model used to test the reliability of multi-modal imaging images in complex shielding situations. The last letter model was used to calculate the Structural Similarity of reconstructed images with imaging time ranging from half an hour to twelve hours. The spatial resolution reaches 4 mm when imaging time was more than 2 days. 235U and other common high-z, medium-z, and low-z materials can be distinguished when imaging time is in the order of hours. Muon scattering imaging image of the cladding model will cause misjudgment. However, multi-modal imaging image can correctly reflect the existence of 235U. The Structure Similarity of the reconstructed images and the reference image in different imaging time proves that multi-modal imaging has higher quality than muon scattering imaging and muon imaging in coincidence with muon induced neutrons. Study indicated that multi-modal imaging of muon has better imaging quality，can adapt to more complex imaging scenes and has more advantages in the detection and recognition of special nuclear material compared with muon imaging method with single interaction information.