Under the influence of globalization and modernization, the local residents have an identity crisis on local culture, which seriously affects the protection and inheritance of local traditional culture. The construction of residents' local cultural identity is of great practical significance to the protection and inheritance of local culture. Based on the perspective of place of memory, addressing the case study of protecting Hui, constructing Hui and changing Hui in Huangshan city, the research shows that protecting Hui inherits Huizhou cultural place of memory, constructing Hui creates Huizhou cultural place of memory, and changing Hui expands Huizhou cultural place of memory. The study suggests that the inheritance, creation and expansion of local cultural place of memory can effectively arouse residents' memory of local culture, strengthen residents' identification of local culture, and promote the long-term protection and inheritance of local culture.