With the development of urbanization, pervious concrete has been increasingly used in urban road pavement structures. The objective of this paper was to investigate the effect of stress levels and modifier (ground tire rubber and silica fume) on the fatigue life of pervious concrete and establish the fatigue equations with different survival probabilities. In order to improve the deformability of pervious concrete without sacrificing its strength, ground tire rubber and silica fume were added into pervious concrete. Two kinds of pervious concrete, control pervious concrete and ground tire rubber and silica fume modified pervious concrete, were made in the laboratory. The pervious concrete beam specimens of 100 × 100 × 400 mm were casted, and the static flexural strength and flexural strain of the two kinds of pervious concrete were tested. The fatigue lives of two pervious concretes were tested using MTS fatigue testing machine under four different stress levels (0.85, 0.80, 0.75, and 0.70). The fatigue life was analyzed by two-parameter Weibull distribution. The parameters of Weibull distribution were determined by graphical method, maximum likelihood method and moment method. The Kolmogorov–Smirnov test was used to test the Weibull distribution and the fatigue equations under different survival probabilities were established. The results showed that ground tire rubber and silica fume modified pervious concrete had better deformability while ensuring strength compared to control pervious concrete. The addition of ground tire rubber and silica fume improved the fatigue life of pervious concrete. The two-parameter Weibull distribution was suitable to characterize the fatigue characteristics and predict the fatigue life of pervious concrete. Fatigue equations with different survival probabilities were a good guide for pervious concrete design.