Shanghai releases a two-year action plan for key technology research in the Metaverse, focusing on Micro LED and other technologies

On June 13, the Shanghai Municipal Science and Technology Commission issued a notice on the issuance of the "Shanghai "Metaverse" Key Technology Research Action Plan (2023-2025)" (hereinafter referred to as the "Action Plan").

The "Action Plan" stated that in view of the cross-border composite technical characteristics of the "Metaverse" such as immersion, openness, sustainable real-time, and people-centered, focusing on the technical aspects of the "Metaverse" content, storage and computing, transmission and terminals, combined with domestic and foreign industry development conditions and Shanghai's R&D foundation, Focusing on the two main directions of immersive technology and Web3.0 technology (Editor's note: the original text of the "Action Plan" is "Web3 Technology", this term will be used below), we will create new heights in key technology fields such as immersive audio and video, immersive computing, new displays, perceptual interaction and blockchain.

Regarding the layout of immersive audio and video technology, the "Action Plan" points out that in order to meet the demand for the production of massive immersive audio and video content in the "Metaverse", based on the technical route of AI empowering virtual and real integration, it will focus on the development of key technologies such as artificial intelligence generated content (AIGC), cross-scale acquisition and reconstruction, digital human generation and driving, and virtual space three-dimensional engines to achieve automated and low-cost production of hyper-realistic "Metaverse" immersive audio and video content and support the construction of the "Metaverse" content creation ecosystem.

Regarding accelerating breakthroughs in the research and development of immersive computing technology, the "Action Plan" points out that around the immersive experience technical requirements of the "Metaverse" virtual and real integration, the immersive computing technology route based on device-cloud collaboration will focus on the development of key technologies such as spatial computing, intelligent coding, and distributed rendering distribution to improve the efficiency of "Metaverse" content computing and distribution.

Regarding the layout of new display key technologies, the "Action Plan" points out that in response to the development trends and needs of high-definition and deep immersion in the content presentation of the "Metaverse", the focus will be on laying out key technological breakthroughs such as high-performance and low-power micro-display devices, high-brightness lightweight optical modules, holographic and light field displays, seizing key entrances to the "Metaverse", and promoting the high-quality development of new display industries such as near-eye displays and naked-eye holography.

Regarding strengthening breakthroughs in perceptual interaction technology, the "Action Plan" points out that in order to meet the needs of long-term, high response and diversity in natural interactions in the "metaverse", focus on the development of key software and hardware technologies such as low-power interaction algorithms, multi-mode sensing, gesture and eye tracking, and brain-computer interfaces to achieve multi-modal information perception interaction such as vision, hearing, touch, and body posture in the natural environment.

Regarding the layout of blockchain technology research and development, the "Action Plan" points out that it is oriented to the decentralized/multi-centered organizational rules of the "Metaverse" and based on the heterogeneous multi-chain integration technology route, focusing on the development of supporting technologies such as Web3 network operating systems, blockchain digital identities, distributed trusted storage, and trusted computing chips, as well as digital supervision technology research and development, building a high-performance, scalable, safe and controllable new blockchain system architecture, and forming an infrastructure to carry large-scale innovative applications of the "Metaverse".

The "Action Plan" also proposes to form a "Metaverse" key technology research working group and establish an expert group. Facing major cutting-edge scientific issues, explore long-term government support methods for scientific research, encourage social investment, and further stimulate the vitality of basic research. Facing the application needs of major scenarios, strengthen the status of corporate innovation entities, build an innovation consortium, and carry out major key technologies, major strategic products, and major experimental verification research. Explore mechanisms such as “unveiling the leaderboard”, milestone management, and horse racing systems to accelerate the application of innovative results.