Additional developments to the automatic rig creation process
The disclosure provides methods and systems for automatically generating an animatable object, such as a 3D model. In particular, the present technology provides fast, easy, and automatic animatable solutions based on unique facial characteristics of user input. Various embodiments of the present technology include receiving user input, such as a two-dimensional image or three-dimensional scan of a user's face, and automatically detecting one or more features. The methods and systems may further include deforming a template geometry and a template control structure based on the one or more detected features to automatically generate a custom geometry and custom control structure, respectively. A texture of the received user input may also be transferred to the custom geometry. The animatable object therefore includes the custom geometry, the transferred texture, and the custom control structure, which follow a morphology of the face.
1. A method for automatically generating an animatable object, the method comprising:
automatically detecting one or more features of a received user input for a face, the automatically detecting comprising automatically determining a plurality of spatial coordinates for the face, each spatial coordinate of the plurality of spatial coordinates for the face being associated with one of the one or more features of the received user input for the face, the plurality of spatial coordinates for the face being determined using ray casting techniques;
automatically deforming a template geometry based on the one or more detected features to automatically generate a custom geometry;
automatically transferring a texture of the received user input to the custom geometry;
automatically deforming a template control structure based on the one or more detected features to automatically generate a custom control structure; and
automatically generating an animatable object having the custom geometry, the transferred texture, and the custom control structure.
2. The method of claim 1 , further comprising automatically segmenting a light artifact on a facial texture.
3. The method of claim 2 , where the light artifact is a shadow.
4. The method of claim 2 , where the light artifact is a specular reflection.
5. The method of claim 1 , further comprising automatically correcting light non-uniformity on a facial texture.
6. The method of claim 5 , wherein the light non-uniformity is a level of brightness.
7. The method of claim 5 , wherein the light non-uniformity is a level of color.
8. The method of claim 1 , further comprising automatically producing a map for a facial texture.
9. The method of claim 1 , further comprising synthesizing a normal map and an ambient occlusion map from an input texture to create a shading effect.
10. The method of claim 1 , further comprising automatically using a depth image as an input for an image.