Generative artificial intelligence is bringing the biggest changes to movies and videos in 100 years, and it’s affecting everyone’s favorite Hollywood, tech.eu reports.

But first – what does it actually represent?

Generative AI is a subfield of machine learning, used mostly in text-to-speech and text-to-design software.

Seeing your work ruined – the frustration of filmmakers

Co-CEO and founder of the neural network lab Flawless Scott Mann, a Hollywood director and producer who has worked with Hollywood’s top actors, expresses his concerns about the interference of artificial intelligence in filmmaking.

“I had written a script with the actors, directed it, edited it, adjusted it and been so careful with not just the words, but the nuance of the sound of a word or the inflexion in what’s implied or, the detail of expression. And then to see it ruined or almost like a caricature with all the wrong dialogue – it was awful.”

said Scott Mann.

The solution

The action he took was the development of his company’s own software called TrueSync. Through a process Flawless calls “vubbing,” he makes the actor’s mouth movements match the dubbed dialogue when the film is translated into another language.

Generative artificial intelligence is applied to videos to create something that didn’t exist before, using very basic training data of the original to make it as real as the original.
For Mann, it’s a way to make the speech authentic and capture the nuances of the actor.

The company is currently working with studios in the area of post-production editing.

F-bombs are the enemy of film censors

The company has discovered a second use case for its technology – removing obscene words from film footage.

Mann notes that the film industry already has frameworks in place on issues such as film rights, permissions, compensation and consent, and also that it is working on updating them to adapt to new technologies.

AI replaces humans?

Mann notes that voiceovers won’t go away anytime soon.

“Synthetic audio is not at the stage where there are nuances to make it better than a human. And that’s going to be the case for some time.”

Mann believes that in the next five years, more filmmaking tools will emerge that will allow film technicians to bring things to the post-production environment that were previously confined to the sets.

Although Flawless is developing software for high-level use cases, such as the IMAX cinematic experience, there is an opportunity to push it into a variety of sectors in the future, including B2C and YouTube.

The future of film production in doubt

According to Mann, reducing production costs will not only improve film production, but also increase quality and expand audiences.

With each passing day, artificial intelligence is becoming more and more preferred and taking over all industries, even the beloved Hollywood, which very soon might not be as we have always known it.