Articulated model registration apparatus and method
The present invention relates to an articulated model registration method and apparatus which three-dimensionally restore an articulated model of a body, such as a hand, an upper body, and a whole body, from an image and to acquire a two-dimensional landmark from a two-dimensional image to generate and estimate a three-dimensional articulated model corresponding thereto.
1. An articulated model registration method, comprising:
a body image detecting step of detecting an image of a body area from an original image;
a landmark extracting step of extracting one or more landmarks including an articulated point from the detected image of the body area;
a body shape model generating step of generating an average three-dimensional body shape model;
a conversion estimating step of estimating a position on a three-dimensional coordinate of the generated body shape model from a conversion estimating landmark including any one or more landmarks among the extracted landmarks; and
a posture estimating step of estimating a position on a three-dimensional coordinate of the generated body shape model from any one or more landmarks among the extracted landmarks,
wherein the posture estimating step estimates the position on the three-dimensional coordinate of the landmark from a reference straight line connecting the position on the three-dimensional coordinate estimated from any one or more of the landmarks, in an arbitrary position on the three-dimensional coordinate,
the posture estimating step includes a step of calculating a reference straight line connecting a camera matrix on a three-dimensional coordinate of the original image and a landmark at which a position on the three-dimensional coordinate is estimated, and
the posture estimating step includes a step of moving an estimation start landmark to a position on the three-dimensional coordinate which is the closest from the reference straight line.
2. The articulated model registration method of claim 1 , wherein the step of calculating the reference straight line includes a step of calculating the reference straight line by the camera matrix which is a projection reference matrix on the three-dimensional coordinate from the original image and the landmark on the two-dimensional coordinate projected by the camera matrix.
3. An articulated model registration method, comprising:
a body image detecting step of detecting an image of a body area from an original image;
a landmark extracting step of extracting one or more landmarks including an articulated point from the detected image of the body area;
a body shape model generating step of generating an average three-dimensional body share model;
a conversion estimating step of estimating a position on a three-dimensional coordinate of the generated body shape model from a conversion estimating landmark including any one or more landmarks among the extracted landmarks; and
a posture estimating step of estimating a position on a three-dimensional coordinate of the generated body shape model from any one or more landmarks among the extracted landmarks, wherein
the posture estimating step estimates the position on the three-dimensional coordinate of the landmark from a reference straight line connecting the position on the three-dimensional coordinate estimated from any one or more of the landmarks, in an arbitrary position on the three-dimensional coordinate,
the posture estimating step includes an iterative estimative step of estimating a position on a three-dimensional coordinate of the landmark in a connecting order from the estimation start landmark to an end landmark, and
the iterative estimating step includes a step of calculating a landmark root satisfying a condition in which a distance from the straight line on the three-dimensional coordinate calculated by a landmark at which estimation is completed and a landmark which is a next connecting order is equal to the distance between the landmark at which estimation is completed and the landmark which is a next connecting order, with respect to the landmark at which estimation is completed.
4. The articulated model registration method of claim 3 , wherein when there are two landmark roots, the iterative estimating step includes a step of estimating a root included in a movable area of a body joint as a landmark which is a next connecting order of a landmark at which estimation is completed.
5. The articulated model registration method of claim 3 , wherein when there is no landmark root, the iterative estimating step includes a step of estimating a position which is the shortest distance from Pc in the reference straight as a landmark which is a next connecting order.