In our experiment, firstly, we carry out the loading of single atoms in the magneto-optical trap (MOT) by increasing the quadrupole magnetic field gradient, improving the background vacuum, and reducing the diameters of the cooling and trapping laser beams. Secondly, we get the single atomic fluorescence signal of a high signal-to-background ratio in the MOT by means of reducing the detuning of cooling light and increasing its intensity appropriately, and using the polarization spectroscopy locking technique to suppress the fluctuations of cooling laser. In addition, with the real-time feedback on quadrupole magnetic field gradient, we demonstrate a probability of loading single atoms in the MOT as high as 98%. We also measure the statistical properties of the single atomic fluorescence which is excited by continuous light in the MOT; the measured second-order correlation is g(2)( = 0) = 0.09.