In this paper, we propose a new scheme to guide cold atoms (or cold molecules) using a bundle of four single-mode optical fibers with a sub-micrometer size, and calculate the evanescent-wave field in the hollow region of four-fiber bundle and its optical potential for 85Rb atoms. Our study shows that such a blue-detuned hollow evanescent-wave field can also be used to realize the laser waveguide of cold atoms (or cold molecules), and, compared with the traditional atomic guiding scheme using a hollow optical fiber, our scheme is not only simple and cheap, but also easier to realize the single-mode waveguide of cold atomic matter-wave with high efficiency.