As the link between the farmers and the grass-roots government, new rural sages are not only the main body of participation and supervision in rural governance, but also the advocate of rural civilization. They are a brand-new group derived from the modern social situation on the basis of the inheritance and development of the advantages of the traditional rural sages. Since talent revitalization is the key factor of rural revitalization, as an important part of rural talents, new rural sages play an important role in promoting the modernization of rural governance and rural revitalization. However, in the process of practice, there are some problems, such as their vague role positioning, the imperfect and incomplete participation and security system for them, and villagers’ low-level recognition of them. Accordingly, via investigation and comprehensive analysis of the role mechanism of new rural sages in the modernization of rural governance, this paper proposes some specific countermeasures based on actual situation and provides practical reference for new rural sages, so that they can better promote rural revitalization.