#posetalk β Public Fediverse posts
Live and recent posts from across the Fediverse tagged #posetalk, aggregated by home.social.
-
π #PoseTalk: Advanced one-shot talking head generation system
β’ π£οΈ Synthesizes lip-synchronized videos with customizable head poses
β’ π Generates poses from both #audio and #text inputs for better motion control
β’ π§ Utilizes Pose Latent Diffusion (#PLD) model to create motion latent from text and audio cues
β’ π¬ Addresses loss-imbalance issue with two-stage refinement strategy: #CoarseNet and #RefineNet
β’ ποΈ Improves lip-synchronization by progressively estimating lip motions
β’ π Outperforms state-of-the-art methods in natural head motion synthesis