Facial performance capture is the primary method for generating facial animation in video games, feature films, and virtual environments, and recent advances have produced very compelling results. Still, one of the most challenging regions is the mouth, which often contains systematic errors due to the complex appearance and occlusion/dis-occlusion of the lips. We present a novel user-guided approach to correcting these common lip shape errors present in traditional capture systems. Our approach is to allow a user to manually correct a small number of problematic frames, and then our system learns the types of corrections desired and automatically corrects the entire performance. As correcting even a single frame using traditional 3D sculpting tools can be time-consuming and require great skill, we also propose a simple and fast 2D sketch-based method for generating plausible lip corrections for the problematic key frames. We demonstrate our results on captured performances of three different subjects and validate our method with an additional sequence that contains ground truth lip reconstructions.
-
Ice Attac FX in Unreal Engine 5.1 Niagara
-
Modeling for VFX in Unreal Engine 5.1 Tutorial
-
Motion Poster in UE5 Niagara SpeedArt
-
Stylized Volcano in Unreal Engine 5.1 Niagara Tutorial
-
Parallax with Bump Offset in UE5 Material Tutorial
-
Flaming Sword in UE5 Niagara Tutorial
-
Material FX in Unreal Engine 5 Tutorial
-
Screen Slice FX in UE5 Niagara
-
UE5 Niagara & Custom Stencil Buffer
-
UE5 Niagara & Custom Stencil Buffer | Download...
-
900+ UE4 – UE5 Niagara Tutorial
-
Power Spell in UE5.1 Niagara
-
FX in UE5.1 Niagara Tutorial
-
FX Texture in Photoshop to UE5 Tutorial
-
Northern Lights – Aurora in Unreal Engine 5.1...
-
Stylized Projectile in Unreal Engine 5.1 Niagara Tutorial
-
Soul FX in UE5 Niagara Breakdown
-
Power Up Vortex FX in UE5 Niagara
0 Comments