This is what voice actors fear so much: an AI that imitates your voice in any language

The world of dubbing in the entertainment industry is in danger as we have known it.

Oliver Thansan
Oliver Thansan
12 September 2023 Tuesday 10:27
3 Reads
This is what voice actors fear so much: an AI that imitates your voice in any language

The world of dubbing in the entertainment industry is in danger as we have known it. Artificial intelligence (AI) is transforming the way film and television are produced and consumed. It is a revolution that is here to stay and the main reason for the strikes of actors and scriptwriters that have shaken the sector in recent months. In the spotlight are tools such as HeyGen AI, an innovative technology that allows you to generate high-quality dubbing in a matter of minutes.

In recent social media posts, HeyGen AI has presented striking examples of its ability to generate multi-language dubbing with astonishing quality. This includes well-known personalities such as Elon Musk, YouTuber Marques Brownlee and even actor Pedro Pascal. All of them have appeared in videos speaking fluently in languages ​​other than their own: Spanish, French and Hindi. The most impressive thing about these dubs is the clarity and fidelity with which they reproduce the tone and timbre of the original people's voices.

The process HeyGen AI uses to achieve these results begins with adapting lip movements to words, using deepfake technology. The AI ​​then applies the original person's voice and intonation to the new language, resulting in a high-quality dubbing. The most surprising thing is that this process is completed in just a few minutes thanks to the efficiency of artificial intelligence.

Despite the notable advances of this application, it is important to highlight that this technology still has limitations. In some cases, the dubbing can sound a bit robotic, especially in languages ​​like Spanish. However, considering that it is a technology in development with only a few months of existence, the results obtained are surprising. The images of Leo Messi speaking in English at a press conference thanks to this artificial intelligence have attracted a lot of attention.

HeyGen AI is not free for now and has its details to improve, such as possible robotic intonation in some languages. However, its potential to revolutionize the way online content is created and consumed is undeniable. Content creators now have the ability to reach global audiences more efficiently, offering their videos in multiple languages ​​to meet the demands of a diverse audience.

However, the proliferation of this technology raises important ethical and legal questions that must be resolved. Using a person's image and voice for any purpose, without their consent, raises concerns about the privacy and integrity of artists and content creators. Thus, questions must be resolved about how the rights of artists and creators will be regulated and protected in this new era of AI.