Meta Unveils AI-Powered Translation for Instagram and Facebook Reels

Meta has introduced an AI-powered voice translation feature to Instagram and Facebook users. According to Business Standard, Meta AI translation for Reels uses the voice of individual creators, enabling them to preserve their tone and style while aligning lip movement to the audio.

How Meta’s AI Translation Works

The new Meta AI dubbing tool for creators allows users to translate content to and from English and Spanish so that more people can view it. The social media giant is expected to add more languages soon.

“We believe there are lots of amazing creators out there who have potential audiences who don’t necessarily speak the same language. And if we can help you reach those audiences who speak other languages, reach across cultural and linguistic barriers, we can help you grow your following and get more value out of Instagram and the platform,” Instagram head Adam Mosseri posted on the social media platform.

Although Meta is rolling out the new feature to all Instagram accounts, the social media giant to creators who have at least 1,000 followers. To use the Meta automatic voice dubbing Reels tool, creators will see a ‘Translate your voice with Meta AI’ option before posting their Reel. They can toggle the voice translation on or off and decide whether or not to add lip-syncing. AI generates the dubbed track, with preview available, and publishes with your reel when enabled.

The tool also allows creators to preview the appearance and sound of translated Reels, and even turn off either feature when it does not meet their expectations. Videos that are created using the Meta translation tool have a message that shows the video was translated using Meta AI.
If they prefer to view the dubbed content in specific languages, the tool allows them to change preferences through the settings. The launch of AI translation tools is part of Meta’s wider plan to automate its entire ad campaigns by the end of the year.

Meta’s New Metric Feature

Meta is also offering creators a new metric feature on its insights panel. Through this feature, creators can track views based on language. This enables them to understand the language translations are enabling them to reach new audiences.
Meta advises ad creators who wish to use its translation feature to record face forward and speak clearly without covering their mouth. Creators should also ensure minimal background noise.

Currently, the Meta automatic lip sync translation feature only supports two speakers. For the translation to work, one person should talk at a time, speakers should avoid talking over each other.

Facebook Reels Update

Meta is also providing a new way for Facebook creators to reach global audiences by uploading up to 20 of their own voice-dubbed audio tracks to a single Reel. This will enable them to connect better with viewers who speak languages other than English or Spanish.

The new Facebook update will be available on the Meta Business Suite. Unlike the AI voice translation tool, this update allows creators more control, enabling them to add or update translations even after Reels have been published.
Meta has launched the new AI feature and Facebook Reels update at a time when reports indicate that the social media giant is restructuring its AI team to focus on superintelligence, research, infrastructure, and products.