Based on the concept of damping energy dissipation, this paper proposed a new type of vibration-damping measure—rubber self-compacting concrete filling layer structure. In this paper, the dynamic mechanical properties of rubber self-compacting concrete were studied, the damping enhancement mechanism was explained, and the vibration reduction performance of rubber self-compacting concrete filling layer structure was analyzed by using an environmental vibration prediction model. The results showed that the rubber reduced the dynamic elastic modulus and dynamic shear modulus of self-compacting concrete, resulting in an increase in Poisson’s ratio. The damping ratio increased linearly with the rubber content. The rubber increased the consumption of stress wave energy by the matrix, thus improving the damping performance. The acceleration level of the rubber self-compacting concrete filling layer structure in the frequency range of 1~200Hz was lower than that of the ordinary self-compacting concrete filling layer structure, and for low-frequency vibration below 20Hz, the reduction was about 3-5dB.