This paper summarizes the effects of materials commonly used for infiltration media in rainwater infiltration facilities, including natural materials (e.g., zeolite, silica sand, and wood), waste materials (e.g., coal ash and crab shell), and artificial materials (e.g., fibrous membranes, activated carbon, and zero-valent iron). The properties of different materials and the efficiency and mechanisms of the materials used as improved infiltration media to remove contaminants are analyzed and summarized. It is concluded that contaminants in the runoff, such as heavy metals and polycyclic aromatic hydrocarbons (PAHs), cannot be completely removed by ordinary infiltration materials such as soil. Improved infiltration media can not only control water pollution, but also enhance the efficiency of infiltration facilities and reduce congestion caused by infiltration media. Since each kind of material has its pros and cons, it is shown that, according to different rainwater qualities and treatment requirements, combining different materials as infiltration media or developing new materials may improve the efficiency of infiltration facilities.