icon bookmark-bicon bookmarkicon cameraicon checkicon chevron downicon chevron lefticon chevron righticon chevron upicon closeicon v-compressicon downloadicon editicon v-expandicon fbicon fileicon filtericon flag ruicon full chevron downicon full chevron lefticon full chevron righticon full chevron upicon gpicon insicon mailicon moveicon-musicicon mutedicon nomutedicon okicon v-pauseicon v-playicon searchicon shareicon sign inicon sign upicon stepbackicon stepforicon swipe downicon tagicon tagsicon tgicon trashicon twicon vkicon yticon wticon fm

Speaking in tongues: Russia's tech giant Yandex working on AI video translator to allow viewers to watch anything with voiceover

Speaking in tongues: Russia's tech giant Yandex working on AI video translator to allow viewers to watch anything with voiceover
What do you want to watch? Well, if the answer is a foreign-language film or TV show, and there’s no translated version available, you might be out of luck. Now one of Russia’s biggest tech firms is working on a solution.

In a statement released last week, digital services giant Yandex revealed it has been working on a software prototype that would allow users to watch videos in their browser in another language. The program is capable of simultaneously translating the content, and dubbing it with a computer-generated voiceover.

If that weren’t enough, the team behind the innovation say it is able to detect the gender of the speaker and match it with a male or female voice, as well as keeping to the speed and rhythm of their voice.

Also on rt.com One giant leap for robot-kind? Russian humanoid robots slated for spacewalks & moon missions

“Consumption and creation of video content has been growing super-fast over the past years. This was true even before the pandemic, but the last two years have only accelerated this trend,” said David Talbot, head of the natural language processing team at Yandex. “Individuals are creating their own content and companies are using video content more and more for training, education and marketing purposes. The trend seems unstoppable.”

According to him, the goal of the project is “to help people to enjoy video content in any language,” without requiring them to find a pre-translated version of the clip, or making them dependent on creators to produce transcripts.

READ MORE: ‘Stuck in traffic’: Soyuz manned by Russian robot Fedor docks at ISS on 2nd attempt

However, Talbot added, “We are just at the start of this project and we don’t underestimate the amount of work that lies ahead.” At the moment, the prototype only allows video to be converted from Russian to English. In addition, for the future, Yandex is planning to integrate emotion and other characteristics into the AI-generated voice overs, adding to the sense of realism and immersion.

Like this story? Share it with a friend!

Dear readers and commenters,

We have implemented a new engine for our comment section. We hope the transition goes smoothly for all of you. Unfortunately, the comments made before the change have been lost due to a technical problem. We are working on restoring them, and hoping to see you fill up the comment section with new ones. You should still be able to log in to comment using your social-media profiles, but if you signed up under an RT profile before, you are invited to create a new profile with the new commenting system.

Sorry for the inconvenience, and looking forward to your future comments,

RT Team.

Podcasts