A new scheme of measuring ultra-short optical pulses, based on the photo-elastic effect and cross-phase modulation (XPM) effect in a single-mode fiber, is proposed. In this novel scheme, a variable delay is generated in the former part of the single-mode fiber, and the nonlinear effect is produced in the latter part as a nonlinear medium. The structure including only one single-mode fiber is very simple and low-cost, and needs no complex optical circuit calibration. In addition, XPM effect in the fiber can be realized easily without phase matching. Measured pulses can be retrieved by using principal component generalized projects algorithm based on matrix, and the influences of fiber length and the pulse width on amplitude and phase are studied by numerically simulating the scheme proposed. The results show that the ultra-short optical pulses can be measured when fiber length is equal to 2 km, and the accuracy of measurement is improved by increasing the fiber length. The proposed scheme can realize the measurement of optical ultra-short pulse whose pulse width is above 80 fs.