YouTube has officially rolled out its AI dubbing feature for creators worldwide through the YouTube Partner Program. YouTube AI auto-dubbing first came out in a test last year at Vidcon and is now live for channels that focus on knowledge and information. The service will make YouTube content more accessible, as dubbed versions of videos will now be available in multiple languages.
Creators can upload videos normally without taking any additional action. YouTube will automatically detect the video's original language and generate dubbed versions in multiple languages.
Dubbed videos will be visible in the ‘Languages’ section of YouTube Studio. The creators can listen to these dubbed tracks before they are aired and can opt to publish, unpublish, or delete them.
If the feature is available for a channel, it will be found under ‘Advanced Settings’ in YouTube Studio. This technology is still in its early stages, and while YouTube is working to improve its accuracy, some translations may not always be perfect.
An English video can be dubbed into French, German, Hindi, Indonesian, Italian, Japanese, Portuguese, and Spanish, or vice versa.
YouTube has created the ‘Auto-Dubbed’ label to indicate dubbed audio tracks. Alternatively, users can switch the track selector to hear the video in its original language.
YouTube is partnering with Google DeepMind and Google Translate to make the audio more accurate and descriptive. Dubbed videos will hence sound more natural, bringing forth the speaker's original tone and conveying better meaning. YouTube is further expected to support more kinds of content in the future.
Thus, the YouTube AI Auto Dubbing feature showcases the company’s commitment to making its content more accessible and representative of a global audience.