With Single-Actor Projects, you can now translate & create audio directly on the platform
Automatic Translation: Easily translate the actor’s voice from one language to another.
- We currently support 29 languages, and more are on the way! 🙂
Limitations of this feature
- Original video must have original audio - If you upload a muted video, LipDub AI cannot translate a muted video.
- Potential alignment issues - when the hand movement may not 100% perfectly match the new translated audio like the original
- why? - For example, Spanish may take twice as long to say the same sentence in English. This has the potential for not perfect alignment due to the automatic translation lip-sync.
- note: For optimal results to have clean audio stems (i.e. no background music/SFX) in the original language audio.
Here is the list of supported languages that LipDub AI can translate to:
- English
- Japanese
- Chinese
- German
- Hindi
- French
- Korean
- Portuguese
- Italian
- Spanish
- Indonesian
- Dutch
- Turkish
- Filipino
- Polish
- Swedish
- Bulgarian
- Romanian
- Arabic
- Czech
- Greek
- Finnish
- Croatian
- Malay
- Slovak
- Danish
- Tamil
- Ukrainian
- Russian
Translation Editor
If you’d like to double check and edit the translation before generating your result, you absolutley can! Simply turn the toggle on below:
Once the LipDub AI finishes automatically translating into your new language, you can proof read and double check everything looks good before you move on to generate the final lip-synced video 😊
Limitations of Translation Editor
- Maximum video size is 10 minutes in length
- Only the supported languages (29) are available
- Unable to edit the original language transcript
- Only available with automatic voice clone. Unable to use it if you want to use default off-the-shelf voices
- May have alignment issues
- E.g. when the hand movement may not 100% perfectly match the new translated audio like the original