AI translation for short videos has appeared on Instagram

Meta introduced an AI-powered automatic video translation feature. The innovation allows synchronizing the voice track with lip movements in the video, as well as cloning the author's voice timbre and intonation, reports VC.

Content creators on Instagram and Facebook can enable translation when publishing, as well as preview the result. If necessary, the synthesized audio track or automatic lip synchronization can be disabled. Viewers will see translated videos in their "preferred language" with a Meta AI Translation label.

In the first phase, translation between English and Spanish is supported in both directions. In the future, the company plans to expand the list of languages, however, the timeline for launching additional language pairs has not been disclosed.

The feature is free for all Instagram creators. On Facebook, access is provided to bloggers with an audience of at least 1,000 subscribers. Additionally, they will have access to viewing statistics by language. Facebook also introduced the ability to upload up to 20 custom audio tracks for a single video.