Dub and re-voice
Put a part of your video, or all of it, into another language, or say the same words in another voice, keeping the delivery.
Dub & re-voice replaces the voice in a part of your video. Translate speaks it in another language. Re-voice says the same words in another voice and keeps the original timing and emotion. The result goes on the timeline over that part, and your original voice is muted there.
Before you start
- You need a key for at least one of the providers below, added in Settings › AI › Providers. See Connect an AI account.
- Line by line translates your script, so the project needs a transcript. See Transcription.
- Every engine sends the audio of the part to its provider, and the provider charges you. The panel shows an estimate, and nothing is sent until you press the button.
- Copying someone's voice needs their permission. When an option copies the speaker's voice, the panel asks you to confirm you have it.
Dub or re-voice a part
- In the script, select the words you want to dub.
- Open AI & speed in the selection toolbar, or right-click and open Add audio, then choose Dub this part… or Re-voice this part….
- The Dub & re-voice panel opens in Media with your selection. To dub everything instead, choose Whole video.
You can also open it from Media › Generate › Dub & re-voice. Without a selection it works on the whole video.
Translate
- Choose Translate and the Language.
- Choose How:
- ElevenLabs Dubbing keeps each speaker's own voice and tone, and the background sound, in one step. It uses your ElevenLabs key. You cannot edit single lines afterwards.
- ElevenLabs Dubbing on fal.ai is the same dubbing, billed by fal.ai.
- Line by line translates your script with your AI (the one set in Settings › AI › AI director), then speaks each line where it was said. Choose Speaker's own to copy the speaker's voice (Fish on OpenRouter, ElevenLabs, or Chatterbox on fal.ai), or A preset voice to pick any voice from ElevenLabs, fal.ai, OpenRouter or OpenAI.
- Press Dub into and the language name.
A translated line is often longer or shorter than the original. Line by line speeds a line up by at most a quarter to fit its place. If the dub still runs past the part, a message says by how much.
Re-voice
- Choose Re-voice.
- Choose How: ElevenLabs Voice Changer (any of your ElevenLabs voices), ElevenLabs Voice Changer on fal.ai (ElevenLabs' preset voices), or ChatterboxHD on fal.ai (nine preset voices, the cheapest).
- Pick the new voice. Every voice has a play button.
- Press Re-voice.
The new voice keeps your timing, so it fits the part exactly.
After it is made
The dub is an ordinary audio clip on its own track, so you can move it, trim it and set its volume. The original voice is muted over the part with a muted speed region at 1×, or for the whole video on the main track. Press ⌘ Z to take back the clip and the muting in one step.
Ask the AI
In the AI chat you can ask, for example, "dub the intro into Spanish" or "re-voice 0:10 to 0:40 with George". The AI shows a card with the price, and nothing runs until you press Run. Running a card that copies a voice confirms you have the speaker's permission.
Related
Was this page helpful?
Comments
Longer questions go better in the forum.
No comments yet. Ask a question or add what you found.
Sign in with GitHub or Google to comment.
Sign in to comment