Motion retargeting method for character animation and apparatus thererof
The present disclosure relates to a motion retargeting method and apparatus for character animation, and the method may include generating an intermediate object including at least one of a skeleton and a mesh based on a source motion and a target character, extracting keyframes of the intermediate object, constituting target rig parameters based on the extracted keyframes, and performing spacetime optimization on the target rig parameters to minimize a pose error between the intermediate object and the target character.
1. A motion retargeting method of a motion retargeting apparatus for character animation comprising:
generating an intermediate object including at least one of a skeleton and a mesh based on a source motion and a target character;
extracting keyframes of the intermediate object;
constituting target rig parameters based on the extracted keyframes; and
performing spacetime optimization on the target rig parameters to minimize a pose error between the intermediate object and the target character,
wherein the generating the intermediate object comprises:
when a plurality of corresponding points between the source motion and the target character are selected by a user, generating a source mesh structure based on the corresponding points of the source motion;
generating an intermediate mesh that has the same structure as the source mesh structure and is formed with the corresponding points of the target character; and
transferring deformation gradients from the source mesh structure to the intermediate mesh for each frame to obtain an intermediate mesh animation.
2. The motion retargeting method of a motion retargeting apparatus for character animation of claim 1 , wherein the source motion is a skeletal motion, a mesh animation, 3D marker data, or a combination of at least one of the skeletal motion, the mesh animation and the 3D marker data.
3. The motion retargeting method of a motion retargeting apparatus for character animation of claim 1 , wherein the generating the intermediate object comprises:
generating an intermediate skeleton having the same proportion and structure as the target character, and retargeting the skeletal motion of the source motion to the intermediate skeleton to obtain a skeletal motion of the intermediate object.
4. The motion retargeting method of a motion retargeting apparatus for character animation of claim 1 , wherein the extracting the keyframes comprises:
measuring multiscale motion saliency of the intermediate object, and selecting only frames with the multiscale motion saliency that is equal to or higher than a preset value as the keyframes.
5. The motion retargeting method of a motion retargeting apparatus for character animation of claim 4 , wherein the estimating comprises:
optimizing the skeletal rig parameters and the deformation rig parameters through an energy functional equation of
“
min
E
(
M
_
l
.
M
_
c
)
=
∑
t
=
1
N
k
E
(
p
l
(
t
)
.
p
(
c
(
t
)
)
)
”
,
in which the E(p I (t),p(c(t))) is calculated according to the equation of
“
E
p
(
p
I
·
p
(
c
)
)
+
λ
sp
E
sp
(
c
)
+
λ
ac
E
ac
(
c
)
”
,
the M I is the intermediate object, the M C is the target character, the p I (t) and p I is the pose of the intermediate object, the p(c(t)) and p(c) are the target character pose, the c(t) is the rig space parameters, the E(p I ,p(c)) is pose difference energy between the intermediate object pose and the target character, the E sp is sparse regularization energy, the E ac is temporal smoothness, the λ sp is a weight of the E sp , and the λ ac is a weight of the E ac .
6. The motion retargeting method of a motion retargeting apparatus for character animation of claim 1 , wherein the minimizing the error between the intermediate object and the target character comprises:
constituting target rig parameters through skeletal rig parameters and deformation rig parameters, and determining a pose of the target character based on the target rig parameters; and
estimating optimal skeletal rig parameters to minimize a skeleton error between the intermediate object and the target character, and estimating optimal deformation rig parameters using the estimated skeletal rig parameters to minimize a mesh error between the intermediate object and the target character.
7. A motion retargeting apparatus for character animation comprising:
an intermediate object generation unit configured to generate an intermediate object including at least one of a skeleton and a mesh based on a source motion and a target character;
a keyframe extraction unit configured to extract keyframes of the intermediate object; and
a target rig parameter optimization unit configured to constitute target rig parameters based on the extracted keyframes, and perform spacetime optimization on the target rig parameters to minimize a pose error between the intermediate object and the target character,
wherein when a plurality of corresponding points between the source motion and the target character are selected by a user, the intermediate object generation unit generates a source mesh structure based on the corresponding points of the source motion, generates an intermediate mesh that has the same structure as the source mesh structure and is formed with the corresponding points of the target character, and then transfers deformation gradients from the source mesh structure to the intermediate mesh for each frame to obtain an intermediate mesh animation.
8. The motion retargeting apparatus for character animation of claim 7 , wherein the source motion is a skeletal motion, a mesh animation, 3D marker data, or a combination of at least one of the skeletal motion, the mesh animation and the 3D marker data.