Runway has launched Act-1, a new feature that allows filmmakers to control AI characters using their own facial expressions and movements. This technology combines human performance with advanced AI to create lifelike characters that are consistent and emotionally rich. To use Act-1, filmmakers simply need to film themselves or actors performing parts and then upload the video along with a control image to set the style.
The AI then maps the performance onto the character, replicating eye-lines, micro-expressions, pacing, and delivery. According to Runway, the true benefit of AI video will come from merging real and generative AI rather than relying completely on AI itself. Act-1 builds on existing video tools but goes much further by integrating gen-3 AI video technology to create complex scenes and performances with unprecedented depth.
Act-1 enhances filmmaking through AI
Ryan Morrison, the AI Editor, compared Act-1 to Andy Serkis’ performance of Gollum in “Lord of the Rings,” but without the need for expensive motion capture equipment. “Act-1 puts human performance front and center, using AI as an overlay,” he said.
“This technology goes beyond simple puppeteering; it is a game-changer for creating complex, emotionally rich scenes.”
Runway claims that Act-1 can produce cinematic and realistic outputs across various camera angles and focal lengths. This opens up new creative possibilities for filmmakers, allowing them to generate performances that were previously impossible. Access to Act-1 will start gradually rolling out over the coming weeks, with full availability expected soon.
As it begins to roll out, it promises to offer filmmakers new tools to push the boundaries of creative expression. For more updates on this and other groundbreaking technologies, stay tuned.
Noah Nguyen is a multi-talented developer who brings a unique perspective to his craft. Initially a creative writing professor, he turned to Dev work for the ability to work remotely. He now lives in Seattle, spending time hiking and drinking craft beer with his fiancee.
