With the rapid development and innovation of Internet technology, the scope of online public space continues to expand, which brings new challenges to the traditional rule of law order. The lag and lack of responsiveness of the hard legal system indicate that the online public space is inseparable from the soft law governance, which provides a more flexible and adaptable normative system for the governance of the online public space through various forms such as industry norms, self-discipline conventions, and community rules. However, in the process of soft law governance in public space, there are also problems such as imperfect soft law formulation procedures, obstacles to the implementation of soft law, and poor connection between soft law and hard law. Based on this, in view of these problems in the soft law governance of online public space, the path is optimized, and the soft law governance of online public space is promoted and improved from several aspects, such as standardizing the soft law formulation process, innovating the soft law implementation mechanism, and promoting the coordination and co-governance of soft law and hard law.