What is deepfake? Deepfake or hypertrucage is a multimedia synthesis technique based on AI. It can be used to superimpose existing video or audio files on other video files (e.g. change the face of a person on a video) or audio files (e.g. reproduce the voice of a person to make him say invented things).
Deepfake and dubbing
Deepfake technology aims to revolutionize the dubbing of films and series. TrueSync, an artificial intelligence developed by Flawless AI, is able to automatically synchronize the actors' lips with the spoken words.
TRUESYNC wants to revolutionize dubbing
The AI swaps the lips by a digital mouth simulation. This eliminates the need to synchronize and rewrite the text to match the actors' lip movements. This process allows the audio and lips of a character in a series or movie to be perfectly synchronized, while remaining true to the director's and writer's intentions.
"The technology synthesizes the actors' faces, converting them into a 3D model. This process creates millions of models, which the artificial intelligence uses as reference points," explains Scott Man. "We designed the system so that it doesn't paralyze the filmmaking process," adds the British director.
TrueSync is not the only deepfake technology that aims to revolutionize dubbing. LipGAN, an artificial intelligence developed by Indian researchers, works in the same way as TrueSync.
Will this technology soon be used in the film industry?
.svg)
.svg)
.svg){kind=icon}
