Experimental and theoretical studies have demonstrated that single magnon mode and cavity photon can be coupled coherently and dissipatively, in which the interference between two types of coupling will give rise to zero damping condition. In magnetic bilayers or multilayers, there exist more than one magnon modes which could be directly coupled by interface exchange interaction. In this work, we extend single magnon mode to two magnon modes and study the effect of two magnon modes on zero damping condition. Using eigenfrequency analysis and microwave transmission spectra, we derive analytical expressions of zero damping condition and the frequency detuning. By comparing analytical results to numerical results, we obtain the dependence of zero damping condition on system parameters. In the absence of direct interface exchange magnon-magnon coupling, the zero damping condition occurs for dissipative coupling or hybrid coupling. As the coupling strength increases, the distance between two zero damping conditions increases. For hybrid coupling, the curves become asymmetric around the point of zero detuning, which is different from pure coupling. Moreover, we study the effect of interface exchange magnon-magnon interaction on zero damping condition. The interface exchange coupling results in the splitting of microwave transmission spectra, but the zero damping condition occurs for low-frequency mode only. As the interface exchange coupling strength increases, the frequency at which the zero damping condition happens will shift to lower frequency. Due to extremely narrow line-width of microwave transmission dip at the zero damping condition, our work is expected to be useful for the design of magnon-based quantum sensing devices.