Quantum criticality emerges when the collective fluctuations of matter undergo a continuous phase transition at zero temperature and has been a research focus in conventional condensed-matter physics over the past several decades. In the quantum critical regime, the exotic and universal properties are expected. These properties are independent of the microscopic details of the system, but depend only on a few general properties of the system, such as its dimensionality and the symmetry of the order parameter. The research of quantum criticality can not only help us to understand quantum phase transitions, but also provide a novel route to new material design and discovery.Ultracold bosonic gases have provided a clean system for studying the quantum critical phenomena. The critical behavior of a weakly interacting three-dimensional (3D) Bose gas should be identical to that of 4He at the superfluid transition, which belongs to the 3D XY universality class. From the normal fluid to the superfluid, the system undergoes a phase transition from completely disorder to long-range order, while in the vicinity of the phase transition point, the system parameters will show some singularity characteristics. In this paper, we observe the critical behavior of 87Rb Bose gas in a quadrupole-Ioffe configuration (QUIC) trap near the phase transition temperature Tc. A novel singularity behavior of the full width at half maximum of momentum distribution (FWHMMD) of atomic gas is discovered in the experiment. Prior to our experiment, we prepare a sample with 7.8105 87Rb atoms in the 5S1/2 |F=2, mF=2 state. Then the sample is held in a QUIC trap for a presetting period of time to control the temperature of atom sample precisely. During the holding time, the sample is heated up due to background gas collisions or fluctuations of the trap potential. In our experiment, the heating rate is deduced to be 0.3480.078 nK/ms from the absorption image. For a bosonic gas in a harmonic trap, critical gas can only cover a finite-size region due to a spatially varying density. We define the finite-size region as a critical region determined by the Ginzburg criterion. Then the FWHMMDs of atomic gas in the critical region are measured for different temperatures near the critical point. To this aim, we first extract the momentum distribution of atomic gas from the absorption image of the atomic clouds released from the QIUC trap after free expansion. Thus momentum distribution of atomic gas in the critical region can be extracted from the absorption image by subtracting the momentum distribution of thermal gas outside the critical region. According to the statistical results of the FWHMMD at different temperatures, we find that the FWHMMD suddenly reduces, thus revealing a very notable singularity behavior when the temperature is very close to the phase transition temperature Tc.