ShengShu-AI, a Chinese technology company, in collaboration with Tsinghua University, unveiled “Vidu” at the “Zhong Guan Tsun 2024” tech forum in Beijing. Vidu is an artificial intelligence model that transforms text into video.
The introduction of Vidu marks a significant step in China’s rapid progress in the field of bio artificial intelligence, positioning itself against the capabilities of OpenAI’s Sora.
The video, which can generate a 16-second clip in 1080 pixels with a single click, was designed on the innovative structure of Universal Vision Transformer (U-ViT). Advanced models for text-to-video conversion in AI, Diffusion, and Transformer, were integrated into Vidu, as reported by “Global Times”.
Tsu Jun, a prominent scientist at Tsinghua University and the vice dean of the Tsinghua Institute of Artificial Intelligence, emphasized the revolutionary features of Vidu during its debut. Jun noted that Vidu represents a new evolution in self-innovation, making breakthroughs in various domains.
Jun pointed out that Vidu possesses vast imagination, stimulating the physical world by producing videos that include diverse characters, scenes, and coherent timelines, showcasing its ability to incorporate “Chinese elements”.
Media reports emphasize Vidu’s deep understanding of Chinese factors, enabling it to produce images of culturally significant characters like the panda and dragon.
Indeed, comparisons will be made with Sora – where Vidu shines not only in its match with Sora but also in surpassing it in certain aspects, especially in the temporal consistency of video scenes.
Vidu entered the arena just two months after the release of Sora, showcasing China’s flexibility in responding to global advancements in artificial intelligence.
During the live demonstration, Vidu displayed its ability to mimic real-world physics and create intricate detailed scenes, such as realistic lighting effects, shadows, and precise facial expressions.
Shengshu Technology was established in March 2023 and boasts its headquarters in Beijing with a core team primarily composed of members from the Tsinghua Institute of Artificial Intelligence, along with employees from tech giants: Alibaba, Tencent, Baidu. Shengshu recently received significant investments from prominent companies, including Qiming Ventures, Zhipu AI, and Baidu Ventures.
