Supported File Types
list of audio formats supported by LipDub AI.
Audio Format | Comments |
WAV | SUPPORTS |
MP3 | SUPPORTS |
AAC | SUPPORTS |
If you have your own audio that you’d like to use for lip-sync then please read below:
Differences between Multi-Actor vs Single Actor audio.
Multi-Actor projects is built for multi-people videos therefore the functionality is slightly different compared to Single-Actor projects.
- For example:
- Multi-Actor project: If you upload a 10 second audio file but the original video is 5min, the output will be a 5min video
- Single-Actor project: If you upload a 10 second audio file but the original video is 5min, the output will be a 10 second video.
Why? - this is common in multi-speaker videos. For example, one person only speaks for the first 10 seconds but then is silent the remaining of the video, then another person starts to speak later in the video. Single-Actor projects know for a certainty there is only one person so LipDub assumes it can cut the video length to match the shorter audio length because only one person is speaking
Three requirements to ensure highest quality of results
- Isolated audio tracks
- Audio tracks per actor
- Same length as video
Note: All three of these are required when you are uploading dub audio for Multi-Actor projects
ISOLATED AUDIO TRACKS
The dub audio that you upload to LipDub should be without any background noise, music, SFX, crowd chatter etc. Lipdub AI is HIGHLY sensitive and will even make the mouth move to breathing or birds chirping in the background. Therefore, The best dub videos are those with dialogue audio stems. The mix can be applied after LipDub has been generated.
PER ACTOR
Another key ingredient to great LipDub is that the dub audio stems that you as the user provide must be per actor. This allows LipDub to handle scenarios when there is overlapping audio of two characters because LipDub AI is lip-syncing the two characters separately.
SAME LENGTH
Dub tracks must be the same length as the video you want to LipDub. The LipDub platform DOES NOT automatically align the dub audio files. It simply takes each dub audio file you upload of each actor and places it at 0:00 of the video.
- For example, if you are trying to LipDub multiple actors in a 1:12 min video, then each of the actor’s audio files should be 1:12 min long before you upload to the LipDub App.