Majority-vote model is a commonly used model in the study of opinion dynamics. In the original majority-vote model, the influence of node is determined by their neighbors. But there are nodes with low degree surrounded by nodes with high degree so they also have a great influence on the evolution of opinions. Therefore, the influence of a node should not only be measured by neighbors but also be connected to itself directly. Thus, this paper adds collective influence with hierarchical structures into the majority-vote model and measures opinion weight of center node by degree of their neighbors on hierarchical structures surround it with the set distance. The collective influence parameters used in this paper are related to the value of collective influence mentioned above and normalized by the maximum value of all nodes in system. The opinions’ evolution of majority-vote model with collective influence is studied in ER random networks and scale-free networks with different degree distribution exponents by Monte Carlo simulations. It is found that all systems have order-to-disorder phase transitions with the increase of noise parameter. When the depth of hierarchical structure is not zero, the system with collective influence is much easier to turn to disordered states so their critical noise parameters of phase transition are smaller than those of 0-depth systems and original majority-vote model. The reason is that high degree nodes in original majority-vote model have high influence because they are connected to more neighbors and nodes’ influence is also directly determined by degree in 0-depth collective influence model. Furthermore, nodes’ collective influence parameters in the system will all decrease when hierarchical structure of nonzero depth is considered, only a small number of individuals have high influence parameters in the system and they will make the opinions of surrounding individuals follow theirs, so if the opinions of a few highly influential individuals are out of order, then the system will reach a state of disorder. Because of the above factors, the collective influence model of nonzero depth is much easier to disorder with the increase of noise parameter. Besides, the system proves to be easier to reach a disordered state with the increase of degree distribution exponents in scale-free networks because all nodes’ degree will be lower so that the system will be dominated by less nodes with high degree. This conclusion verifies that scale-free networks are more similar to ER random networks with the increase of degree distribution exponents. Finally, through the finite-size scaling method, it is found that the phase transition of the majority-vote model with collective influence of hierarchical structures belongs in the Ising model universal class, whether in ER random networks or in scale-free networks.