Quantum scar is an intriguing phenomenon in quantum or wave dynamics that the wavefunction takes an exceptionally large value around an unstable periodic orbit. It has attracted much attention and advances the understanding of the semiclassical quantization. Most of previous researches involving quantum scars focus on hard-wall quantum billiards. Here we investigate the quantum billiard with a smooth confinement potential which possesses complex classical dynamics. We demonstrate that the semiclassical quantization approach works well for both the stable and unstable classical periodic orbit, besides the fact that the shape of the orbits varies as the energy increases or even the stability switches. The recurrence rule of the quantum scars in this complex solf-wall billiard differs from that of the hard-wall nonrelativistic quantum billiard, such as being equally spaced in energy instead of being equally spaced in the square root of energy. These results implement the previous knowledge and may be used for understanding the measurements of density of states and transport properties in two-dimensional electron systems with random long-range impurities.