Using the digital image processing technique, a statistical research was undertaken on the cross section of the specimen of recycled aggregate concrete after fatigue failure. The statistical characteristics of the fracture surface and the relationship between the debonding area ratio of the aggregate and the fatigue stress level was established and analyzed. A two dimensional numerical model that can reflect the distribution of recycled coarse aggregate was built, which provides the important base for the analysis of the behavior of recycled aggregate concrete.