Automatic 3D modeling
View Patent ↗An automatic 3D modeling system and method are described in which a 3D model may be generated from a picture or another image. For example, a 3D model for a face of a person may be automatically generated. The system and method also permits gestures/behaviors associated with a 3D model to automatically generated so that the gestures/behaviors may be applied to any 3D models.
1. A method comprising:
determining a two dimensional variable indicating a first change of a surface of a first object represented in an image, the first change occurring during a movement of the first object;
determining a three dimensional variable indicating a second change of a vertex associated with the first object, the second change occurring during the movement of the first object;
generating, by a processor, a model comprising the two dimensional variable and the three dimensional variable; and
applying the model to a second object to animate the second object.
2. The method of claim 1 , further comprising:
determining a scalar field variable representing a mapping between a feature space of the movement and a model space to enable transformation of the vertex.
3. The method of claim 1 , wherein the model further comprises a third variable indicating a third change in a coloration occurring during the movement of the first object.
4. The method of claim 1 , wherein the scalar field variable comprises an array having respective entries for a plurality of vertices, the entries comprising respective three-dimensional vectors configured to store data representing changes in scale of the plurality of vertices in the feature space between an undeformed state and a deformed state.
5. The method of claim 3 , wherein the scalar field variable is based on a weighted interpolation of respective positions of the vertex mapped to a second space associated with a polygon in the feature space.
6. The method of claim 3 , further comprising:
generating the model, wherein generating the model includes generating the feature space and mapping the movement between the feature space and the model space.
7. A non-transitory computer readable medium having computer instructions stored thereon, the instructions comprising:
instructions for determining a two dimensional variable indicating a first change of a surface of a first object represented in an image, the first change occurring during a movement of the first object;
instructions for determining a three dimensional variable indicating a second change of a vertex associated with the first object, the second change occurring during the movement of the first object;
instructions for generating a model comprising the two dimensional variable and the three dimensional variable; and
instructions for applying the model to a second object to animate the second object.
8. The non-transitory computer readable medium of claim 6 , further comprising:
instructions for determining a scalar field variable representing a mapping between a feature space of the movement and a model space to enable transformation of the vertex.
9. The non-transitory computer readable medium of claim 7 , wherein the model further comprises a third variable indicating a third change in a coloration occurring during the movement of the first object.
10. The non-transitory computer readable medium of claim 7 , wherein the scalar field variable comprises an array having respective entries for a plurality of vertices, the entries comprising respective three-dimensional vectors configured to store data representing changes in scale of the plurality of vertices in the feature space between an undeformed state and a deformed state.
11. The non-transitory computer readable medium of claim 9 , wherein the scalar field variable is based on a weighted interpolation of respective positions of the vertex mapped to a second space associated with a polygon in the feature space.
12. The non-transitory computer readable medium of claim 9 , further comprising:
instructions for generating the model, wherein generating the model includes generating the feature space and mapping the movement between the feature space and the model space.
13. An apparatus comprising:
means for determining a two dimensional variable indicating a first change of a surface of a first object represented in an image, the first change occurring during a movement of the first object;
means for determining a three dimensional variable indicating a second change of a vertex associated with the first object, the second change occurring during the movement of the first object;
means for generating a model comprising the two dimensional variable and the three dimensional variable; and
means for applying the model a second object to animate the second object.
14. The apparatus of claim 13 , further comprising:
means for determining a scalar field variable representing a mapping between a feature space of the movement and a model space to enable transformation of the vertex.
15. The apparatus of claim 13 , wherein the model further comprises a third variable indicating a third change in a coloration occurring during the movement of the first object.
16. The apparatus of claim 13 , wherein the scalar field variable comprises an array having respective entries for a plurality of vertices, the entries comprising respective three-dimensional vectors configured to store data representing changes in scale of the plurality of vertices in the feature space between an undeformed state and a deformed state.
17. The apparatus of claim 15 , wherein the scalar field variable is based on a weighted interpolation of respective positions of the vertex mapped to a second space associated with a polygon in the feature space.
18. The apparatus of claim 15 , further comprising:
means for generating the model, wherein generating the model includes generating the feature space and mapping the movement between the feature space and the model space.