Generating efficient, stylized mesh deformations using a plurality of input meshes
The present disclosure includes methods and systems for manipulating digital models based on user input. In particular, disclosed systems and methods can generate modified meshes in real time based on a plurality of input meshes and user manipulation of one or more control points. For example, one or more embodiments of the disclosed systems and methods generate modified meshes from a plurality of input meshes based on a combined shape-space, deformation interpolation measure. Moreover, in one or more embodiments, the disclosed systems and methods utilize an as-rigid-as-possible-deformation measure to combine input meshes into a modified mesh. Further, the disclosed systems and methods can variably combine input shapes over different portions of a modified mesh, providing increased expressiveness while reducing artifacts and increasing computing efficiency.
1. A computer-implemented method for generating an enhanced digital mesh through different combinations of a set of input digital meshes using combined shape-space energy interpolation measures, the method comprising:
receiving an input to manipulate a digital model defined by a mesh of vertices, the input comprising an indication of a movement of a control point of the digital model to a new location;
identifying a plurality of input meshes of the digital model, each input mesh comprising the mesh of vertices in a different configuration;
generating a modified mesh based on the plurality of input meshes and the movement of the control point to the new location by:
generating a first portion of the modified mesh utilizing a first combination of the plurality of input meshes based on a first combined shape-space energy interpolation measure; and
generating a second portion of the modified mesh utilizing a second combination of the plurality of input meshes based on a second combined shape-space energy interpolation measure, wherein the first combination is different than the second combination.
2. The method of claim 1 , wherein the first combination is based on a first set of weights applied to the plurality of input meshes; and wherein the second combination is based on a second set of weights applied to the plurality of input meshes, and the first set of weights is different than the second set of weights.
3. The method of claim 2 , further comprising:
determining the first set of weights by iteratively modifying the first set of weights to reduce the first combined shape-space energy interpolation measure; and
determining the second set of weights by iteratively modifying the second set of weights to reduce the second combined shape-space energy interpolation measure.
4. The method of claim 2 , further comprising, determining the first combined shape-space energy interpolation measure by:
determining a first interpolation measure corresponding to moving the control point to the new location for the plurality of input meshes based on the first set of weights; and
determining a first shape-space measure of a blended mesh generated by blending the plurality of input meshes according to the first set of weights.
5. The method of claim 1 , wherein the first combined shape-space energy interpolation measure comprises a first as-rigid-as-possible deformation measure corresponding to the first portion of the modified mesh and the second combined shape-space energy interpolation measure comprises a second as-rigid-as-possible deformation measure corresponding to the second portion of the modified mesh.
6. The method of claim 5 , further comprising determining the first as-rigid-as-possible deformation measure by determining a first as-rigid-as-possible combined shape-space, deformation interpolation measure associated with moving a vertex corresponding to the control point to the new location based on an as-rigid-as-possible input mesh deformation interpolation measure and an as-rigid-as-possible shape-space deformation measure.
7. The method of claim 1 , wherein the first combination of the plurality of input meshes utilizes a first set of input meshes from the plurality of input meshes; and wherein the second combination utilizes a second set of input meshes from the plurality of input meshes, wherein the first set of input meshes is different than the second set of input meshes.
8. The method of claim 1 , further comprising in response to receiving the indication of the movement of the control point of the digital model to the new location, providing the modified mesh with the control point at the new location for display.
9. The method of claim 1 , further comprising generating an animation in real-time as the control point moves to the new location, wherein the animation includes the modified mesh.
10. A non-transitory computer readable medium storing instructions thereon that, when executed by at least one processor, cause a computer system to:
receive an input to manipulate a digital model defined by a mesh of vertices, the input comprising an indication of a movement of a control point of the digital model to a new location;
identify a plurality of input meshes of the digital model, each input mesh comprising the mesh of vertices in a different configuration;
generate a first portion of a modified mesh utilizing a first combination of the plurality of input meshes based on a first combined shape-space energy interpolation measure;
generate a second portion of the modified mesh utilizing a second combination of the plurality of input meshes based on a second combined shape-space energy interpolation measure; and
in response to receiving the indication of the movement of the control point of the digital model to the new location, provide the modified mesh with the control point at the new location for display.
11. The non-transitory computer readable medium of claim 10 , wherein the first combination is based on a first set of weights applied to the plurality of input meshes; and wherein the second combination is based on a second set of weights applied to the plurality of input meshes, wherein the first set of weights is different than the second set of weights.
12. The non-transitory computer readable medium of claim 11 , further comprising instructions that, when executed by the at least one processor, cause the computer system to:
determine the first set of weights by iteratively modifying the first set of weights to reduce the first combined shape-space energy interpolation measure; and
determine the second set of weights by iteratively modifying the second set of weights to reduce the second combined shape-space energy interpolation measure.
13. The non-transitory computer readable medium of claim 11 , further comprising instructions that, when executed by the at least one processor, cause the computer system to determine the first combined shape-space energy interpolation measure by:
determining a first interpolation measure corresponding to moving the control point to the new location for the plurality of input meshes based on the first set of weights; and
determining a first shape-space measure of a blended mesh generated by blending the plurality of input meshes according to the first set of weights.
14. The non-transitory computer readable medium of claim 10 , wherein the first combined shape-space energy interpolation measure comprises a first as-rigid-as-possible combined shape-space, deformation interpolation measure and further comprising instructions that, when executed by the at least one processor, cause the computer system to determine the first as-rigid-as-possible combined shape-space, deformation interpolation measure based on an as-rigid-as-possible input mesh deformation interpolation measure and an as-rigid-as-possible shape-space deformation measure.
15. The non-transitory computer readable medium of claim 10 , wherein the first combination of the plurality of input meshes utilizes a first set of input meshes from the plurality of input meshes; and wherein the second combination utilizes a second set of input meshes from the plurality of input meshes, wherein the first set of input meshes is different than the second set of input meshes.
16. A system comprising:
at least one processor; and
at least one non-transitory computer readable storage medium storing instructions that, when executed by the at least one processor, cause the system to:
receive an input to manipulate a digital model defined by a mesh of vertices, the input comprising an indication of a movement of a control point of the digital model to a new location;
identify a plurality of input meshes of the digital model, each input mesh comprising the mesh of vertices in a different configuration;
generate a first portion of a modified mesh by:
determining a first set of weights corresponding to the plurality of input meshes by iteratively reducing a first combined shape-space deformation interpolation measure corresponding to the first portion; and
combining the plurality of input meshes based on the first set of weights; and
generate a second portion of the modified mesh by:
determining a second set of weights corresponding to the plurality of input meshes by iteratively reducing a second combined shape-space deformation interpolation measure corresponding to the second portion; and
combining the plurality of input meshes based on the second set of weights.
17. The system of claim 16 , further comprising instructions that, when executed by the at least one processor, cause the system to, provide the modified mesh with the control point at the new location for display.
18. The system of claim 17 , further comprising instructions that, when executed by the at least one processor, cause the system to determine the first combined shape-space energy interpolation measure by:
determining a first interpolation measure corresponding to moving the control point to the new location for the plurality of input meshes based on the first set of weights; and
determining a first shape-space measure of a blended mesh generated by blending the plurality of input meshes according to the first set of weights.
19. The system of claim 16 , wherein the first combined shape-space energy interpolation measure comprises a first as-rigid-as-possible combined shape-space, deformation interpolation measure and further comprising instructions that, when executed by the at least one processor, cause the system to determine the first as-rigid-as-possible combined shape-space, deformation interpolation measure based on an as-rigid-as-possible input mesh deformation interpolation measure and an as-rigid-as-possible shape-space deformation measure.
20. The system of claim 16 , further comprising instructions that, when executed by the at least one processor, cause the system to generate an animation in real-time as the control point moves to the new location, wherein the animation includes the modified mesh.