Shanghai University of Finance and Economics President Liu Yuanchun: AI governance must be proactive, not reactive

At the "Digital Humanities and Innovation Ecosystem" high-level dialogue held on March 24, Liu Yuanchun, President of Shanghai University of Finance and Economics, stated that artificial intelligence is not a traditional technological upgrade but a quintessential "super technology." From shifts in traditional economic growth pathways to real-world impacts on humanities disciplines in higher education, and further into the deep waters of governance concerning survival, distribution, and organizational systems, humanity's existing response frameworks are facing a systemic test.

"Actually, the traditional path through which technology influences growth is fundamentally different from the path through which this super technology impacts human society and economic growth," Liu said.

He emphasized that the key to understanding AI lies in recognizing its disruptive nature. "This requires us to rethink AI as a super technology. The intensity, timeline, and manner of economic growth it may trigger go beyond our conventional understanding of technology."

Impact on Education and Existing Systems

When addressing the frequently discussed topic of AI legislation and governance in recent years, Liu outlined several underlying considerations that must be confronted.

First Concern: Human Agency at the Technological Frontier

The primary concern centers on the survival of human agency at the endpoint of technological development. "The first consideration is whether, at the end of the road for AI technology, it can completely break free from human control and replace humans as another form of consciousness and agency."

This concern is not unfounded. Liu noted that several leaders of major technology companies have publicly called for regulation of AI technology, primarily because unchecked development "could bring devastating impacts to humanity." Citing recent industry developments, he mentioned that Elon Musk, in a recent video, specifically discussed the situation regarding ChatGPT-6. For non-technical personnel, Liu stressed the importance of heeding signals from these core industry figures: "If what these people say is true, then humanity as a whole must systematically guard against the potential destructiveness of this technology in the future. We must comprehensively regulate AI and establish safety nets."

Second Layer: Efficiency and Equity

The second layer of governance concerns efficiency and equity. Liu referenced an open letter dated July 13, signed by nearly 200 researchers and entrepreneurs, including 16 Nobel laureates. The letter conveyed three core consensuses:

• This AI technology is fundamentally different from previous technologies
• Its impacts and implications surpass traditional imagination
• Governments must establish corresponding regulatory and preventive mechanisms

Liu observed that with comprehensive technological advances over the past two years, many economists who previously held pessimistic views on AI's impact have changed their perspectives. For example, economist Daron Acemoglu, in extensive recent research, has argued that AI will affect employment structures and wealth inequality.

"Even if it does not bring about catastrophic consequences at the technical level, it will certainly impact our existing social structures," Liu warned. He emphasized that the governance threshold must be significantly moved forward, and a core aspect of governance is to proactively arrange within the entire social system to address the impact AI will have on traditional systems while benefiting humanity.

Third Layer: Moving Beyond Spontaneous Order

Liu argued that the third layer of governance involves moving beyond spontaneous order and building a "subject foundation" for technology that serves the greater good.

From a historical perspective, Liu said, every major technological revolution inevitably triggers a revolution in production methods. Consequently, the relationship between technology and the humanities has become the core foundation of governance.

The impact on the humanities, the reconstruction of subjective meaning, and the restatement of subjective value are not only key pathways to seeking "technology for good" but also the core elements for building defenses against technological risks. He specifically noted that top technical experts such as Albert Einstein and J. Robert Oppenheimer often ultimately turned to deeper philosophical thinking.

Unlike the technological characteristics of the three previous industrial revolutions, AI's nature means humanity cannot passively wait for the system to self-correct. Liu stated that in the macro-level organizational structure of society, the idea that "spontaneous order can automatically achieve a soft landing" must be abandoned. Only through proactive institutional design can humanity fully enjoy the growth momentum brought by AI while effectively mitigating the potential impacts on human consciousness and social structures.

(Source: Yicai)