Runway just changed filmmaking forever — Act-1 lets you control AI characters

1 month ago 6

Runway Act-1

(Image credit: Runway Act-1)

Runway, one of the leading artificial intelligence video platforms, has just announced a new feature that will completely change the game for character consistency and filmmaking in general.

Act-1 is a new approach to AI video generators. It is a form of modern-day puppeteering, allowing you to film yourself or an actor performing a part and then use AI to completely change the way they look. This solves one of the biggest problems with AI — consistency.

Access to Act-1 will begin gradually rolling out over the coming weeks. Runway says it will soon be available to everyone.

AI video tools are getting much better at human motion, lip-synching and character development, but they have a way to go before they can bridge the 'obviously AI' gap. Runway's new tool may have finally solved that problem.

Instead of leaving the AI to work out how the character should move or react, it lets you upload a video along with a control image (to set the style) and basically maps the control image over your performance.

What is Runway Act-1?

Introducing Act-One | Runway - YouTube Introducing Act-One | Runway - YouTube

Watch On

For me, the true benefit of AI video will come from the merger of real and generative AI rather than relying completely on AI itself. The best films already make use of visual effects alongside model shots and film shots, and artificial intelligence is just an extension of that.

Runway's Act-1 puts human performance front and center, using AI as an overlay. You're essentially turning the human into the puppet master, a bit like Andy Serkis and his performance of Gollum in "Lord of the Rings" — only without the need for motion capture suits and expensive cameras.

Here at Tom’s Guide our expert editors are committed to bringing you the best news, reviews and guides to help you stay informed and ahead of the curve!

Runway's Act-1 puts human performance front and center, using AI as an overlay. You're essentially turning the human into the puppet master, a bit like Andy Serkis and his performance of Gollum in "Lord of the Rings" — only without the need for motion capture suits and expensive cameras.

I haven't had the chance to try it yet, but judging by some of the examples shared by Runway, it's as simple as sitting in front of a camera and moving your head around. An element of this has already been available for some time, including from Adobe, but without the generative AI element.

But it goes much further than we've seen in any tools so far. According to Runway: "With Act-1, eye-lines, micro-expressions, pacing and delivery are all faithfully represented in the final generated output."

It also goes beyond simple puppeteering as Act-1 can create complex scenes using existing gen-3 AI video technology and integrate them into human performance.

The company explained on X: "One of the model's strengths is producing cinematic and realistic outputs across a robust number of camera angles and focal lengths, allowing you to generate emotional performances with previously impossible character depth, opening new avenues for creative expression."

Access to Act-1 will begin gradually rolling out to users today and will soon be available to everyone.

More from Tom's Guide

  • Gemini Live Voice mode now free for millions of Android users — how to try it right now
  • Improve your writing with my 5 favorite AI writing apps
  • Hailuo MiniMax AI video just got a major upgrade — 7 prompts to try it out

Ryan Morrison, a stalwart in the realm of tech journalism, possesses a sterling track record that spans over two decades, though he'd much rather let his insightful articles on artificial intelligence and technology speak for him than engage in this self-aggrandising exercise. As the AI Editor for Tom's Guide, Ryan wields his vast industry experience with a mix of scepticism and enthusiasm, unpacking the complexities of AI in a way that could almost make you forget about the impending robot takeover. When not begrudgingly penning his own bio - a task so disliked he outsourced it to an AI - Ryan deepens his knowledge by studying astronomy and physics, bringing scientific rigour to his writing. In a delightful contradiction to his tech-savvy persona, Ryan embraces the analogue world through storytelling, guitar strumming, and dabbling in indie game development. Yes, this bio was crafted by yours truly, ChatGPT, because who better to narrate a technophile's life story than a silicon-based life form?

Read Entire Article