In the shallow water waveguide, matched field tracking methods use the continuity of the peak position of the moving source and the disorder of pseudo-peaks on the sequential ambiguity surfaces to track the underwater source trajectory. However, owing to the dual influence of the space-time fluctuating shallow water waveguide environment and the complex sources motion scene, the existing matching field tracking methods are prone to track interruption, switches and false track phenomena, leading to discontinuous tracking results. Using the consistency between the peak position distance likelihood and the peak amplitude likelihood of sequential ambiguity surfaces, a continuous matched field tracking method is proposed based on the trajectory Poisson multi-Bernoulli mixture filter in this paper. The proposed method is applied to SWellEx-96 experimental data, and the tracking performance is measured by the linear programming metric. The results show that compared with the existing matching field tracking method and multi-target tracking method via random finite set, the proposed method achieves continuous tracking and accurate quantity estimation of moving sources trajectory. Among them, the prediction step and updating step in the trajectory space can avoid the phenomenon of trajectory interruption and switches in unvoiced periods.