The announcement by Tencent about the release of a new version of DynamiCrafter, an open-source model for generating videos using artificial intelligence, reflects the efforts of some major technology companies in China to transform texts and images into videos.
In fields such as video games and chat applications like WeChat, the renowned Chinese empire uses an open-source artificial intelligence video generation model to convert descriptive labels and static images into short video clips, similar to other video generation tools available in the market.
The updates in the new version of Tencent’s DynamiCrafter model involve producing videos with higher clarity up to 640 × 1024 pixels, a significant upgrade compared to the previous version that included videos with a resolution of 320 × 512 pixels released in October.
An academic paper published by Tencent’s team indicates that the DynamiCrafter technology is different from that used by competitors, offering extensive potential for applying motion techniques to public visual content.
The research study states: “The main idea focuses on leveraging prior motion of diffusion models that turn text into video, by integrating the image in the generation process to act as guidance.”
Traditional techniques focus on animating natural scenes using random dynamics, such as fluid motion, or specific range motions, like human hair movement or body actions.
The results of Tencent’s model demonstrate vitality compared to other models in the comparative presentation between DynamiCrafter, video stabilization, and Picas Labs.
AI-generated clips are making a mark on the AI race, being considered the next significant phase after successful text and image generation.
Startups and technology companies are expected to invest in this field, following suit with China leading the way.
Bytedance, Baidu, and Alibaba have released innovative models for video production using AI technology. Alibaba has open-sourced its VGen model for video production in the same manner as Tencent.
This strategy is gaining popularity among Chinese technology companies striving to reach the global developer community.
