The cultivation of innovative talents is the mainstream trend of education, and the outstanding characteristic of innovative talents is that they have strong critical thinking ability. The lack of critical thinking ability is a common problem for Japanese majors. How to overcome this problem is an urgent problem for Japanese education in Colleges and universities. By analyzing the specific performance of the weak critical thinking ability of Japanese majors, and sum up the reasons, on the basis of fully studying the model of critical thinking ability at home and abroad, this paper holds that the reform should be carried out in the aspects of teaching objectives, curriculum system and teaching methods so as to train and improve the students' critical thinking ability.