Please support VA2V video + audio, and lip-sync.
#6
by sunnyboxs - opened
Please support VA2V video + audio, and lip-sync.
Input video and audio, and have the LTX-2 synchronize lip movements with the video.
Is this possible? Can it maintain consistency?
Might be possible.
Perhaps the best way would be to take 1st frame of the input video - use much same way as I2V.
And then use controlnet (canny edge or depth) to recreate the video to look same/similar.
With the audio as audio input and lipsync to the new created video.
I'll try a workflow for that ;-)