Kling AI 3.0 Launches on VEED, Enabling Cinematic Sequences

Kling AI 3.0 is now available through the video platform VEED, offering a significant upgrade in text-to-video and image-to-video capabilities. The new version allows creators to generate multi-shot cinematic sequences with native audio, improved character consistency, and better story structure. The platform aims to accelerate production by handling prompting, asset assembly, and iteration, addressing previous AI video weaknesses like hand and arm warping.

- Kling AI is developed by Kuaishou, a Chinese technology company that operates a major short-video platform and has invested heavily in AI to power content creation, recommendations, and e-commerce. Since its initial launch in June 2024, the model has undergone over 30 iterations, now serving more than 45 million global creators. - A key feature of Kling 3.0 is its multi-shot storyboarding capability, which allows creators to generate a sequence of up to six distinct camera cuts within a single 15-second clip, controlling the shot size, perspective, and camera movement for each. - The model introduces native audio-visual generation, creating dialogue, sound effects, and ambient audio simultaneously with the video in one process. It supports multiple languages, including English, Spanish, Chinese, Japanese, and Korean, and achieves 96% lip-sync accuracy. - Kling 3.0 is built on a diffusion-based transformer (DiT) architecture, enhanced by Kuaishou's proprietary 3D VAE network for more efficient spatiotemporal compression, which improves the quality of complex motion. - Compared to competitors, Kling 3.0 excels at rendering complex human motion and action sequences without the body distortion common in earlier models. While OpenAI's Sora 2 is noted for hyper-realistic single scenes and Google's Veo 3.1 offers longer durations up to 60 seconds, Kling's strength lies in its multi-shot narrative control and integrated audio. - Kuaishou has already used the technology to co-produce the world's first AI-generated anthology drama series, "Loading the New World." While praised for its innovation, the production highlighted current AI limitations in maintaining consistent character portrayal and nuanced emotional expression. - The integration into VEED places Kling alongside other top models like Sora and Veo, allowing creators to use different generators within a single browser-based editing workflow. This platform approach combines AI generation with professional editing tools, auto-subtitling, and team collaboration features. - The commercial strategy for Kling is a significant focus for Kuaishou, with the tool already generating substantial revenue. The company's goal is for Kling to become a foundational infrastructure for video creation across industries like advertising, film, and gaming.

Get your own daily briefing

Scout delivers personalized news, insights, and conversations tailored to your role and industry.

Download on the App Store

Shared from Scout - Be the smartest in the room.