Using ideas of supersymmetric quantum mechanics, two new classes of conditionally exactly solvable potentials are constructed from the displaced harmonic oscillator potential. The supersymmetry as well as the space symmetry is broken in one class of them. Furthermore we construct the nonlinear spectrum-generating algebras for them.