With the gradually effective control and governance of point source pollution, the non-point source pollution in the rural area turns into the major pollution source which affects the environment, especially the water environment. The current status and causes of the non-point source pollution in the rural area are investigated. A game model for the production ways of the collective's and the farmers'lands is established. The game analysis shows that the rural non-point source pollution is influenced by various factors, and the regulation of the local government has an important influence on the choice of farmers'management mode. Besides the efforts of technical treatment of eternal pollutants, the government should pay more attention to controlling the source pollution, that is, the local government should adopt the appropriate governance policies to adjust farmers'behaviors, and make the traditional management mode of high consumption and investment be switched to the ecological one with environmental protection.