The hot and warm recycled SMA asphalt mixtures with 0%, 20% and 30% RAP were designed. Four point bending fatigue test was conducted on the recycled SMA mixtures, and the energy dissipation method was employed to analyze the fatigue characteristics of the recycled SMA asphalt mixtures. It shows that the relationship between the fatigue life and cumulative dissipated energy of recycled asphalt mixtures does not change with the variation of RAP content and mixing mode. In a double logarithmic coordinate, there is a good linear relationship between the fatigue life and cumulative dissipated energy of recycled asphalt mixtures. At the same time, the regulation that the cumulative dissipated energy of recycled asphalt mixture varies with RAP content and mixing mode is found.