Support for transcripts/subtitles when auto lip syncing
Allow support for importing a transcript or subtitle file, so the auto lip sync could analyse both the audio and the transcript for a more accurate result.
If the program knows exactly what words are said, it should presumably have a much better idea of which 'Visemes' to use.
(Though obviously this wouldn't work for a live stream aha!
David Simons (Adobe) commented
This is now available in the beta version. See https://community.adobe.com/t5/character-animator-beta-discussions/feature-focus-transcript-based-lip-sync/td-p/12189879
aron mani commented
The person I have to lip sync to most often is british, so the program has a lot of trouble telling what he's saying. Almost consistenatly, funny enough. Sometimes I get away by changing a few mouth poses to the correct one in photoshop so character animator will read right.
It would be nice if the program showed the text it thinks the audio says so I could modify that to get a little closer to a final result.