AI video tools are getting more sophisticated all the time. Most AI enthusiasts have tried Runway, Dream Machine and Kling in the past. While they are not the only ones capable of producing great video, they are among the most popular. There are differences between how these tools will interpret your prompts though. I have always wanted to test them but someone already beat me to it. As Sachin Kamath explains on X, he used FLUX Realism LoRA to generate an image of a runner. Next, he uses a custom GPT to generate a prompt for the video. This GPT even gives you a prompt to use with AI music video tools such as Suno.
Runway <-> Luma <-> Kling
AI video comparison đź’ŻI used the same prompt and starting image for this simple test.
The steps I followed:
– Image of the runner created with FLUX Realism LoRA
– Uploaded the image in my AI image to video GPT which I designed to craft perfect… pic.twitter.com/mBlkHRDBUI
— Sachin Kamath (@DesigningFlow) October 9, 2024
As he explains, Runway generates more intense videos with more natural movements. It is also the fastest. Dream Machine features slower motion. Kling gets the job done but requires long wait time. I went ahead and tried to recreate this video with Hailuo. I still like Runway better but Hailuo is a close second.
This is just one test. As it is the case with many of these tools, they tend to do certain scenes better than others. Which one have you had the most success with?
