Image processing apparatus, image processing method, and program

1. An image processing apparatus comprising at least one processor, wherein the image processing apparatus is configured to:

display a human-figure virtual object image in a calibration pose over an image including a user using the at least one processor, to give visual guidance to the user for adjusting the user's posture in accordance with the calibration pose, wherein the calibration pose is a pose leading the user to take by bending the user's appropriate joints;

extract joint distance information from an image of the user doing the calibration pose using the at least one processor;

search for a protruded region where a region of the user's body is protruded from a displayed virtual clothing;

perform a protruded region adjustment process to the protruded region; and

display the virtual clothing to have a shape determined based on the protruded region adjustment process,

wherein the protruded region adjustment process is performed to expand the displayed virtual clothing, or to narrow areas other than the protruded region of the displayed virtual clothing.

2. The image processing apparatus according to claim 1 , wherein the image processing apparatus is configured to present information for prompting the user to take a posture conforming to the pose using the at least one processor.

3. The image processing apparatus according to claim 1 , wherein the human-figure virtual object image is an image of virtual clothes for try-on purposes.

4. The image processing apparatus of claim 1 , wherein the joint distance information is extracted from the image of the user by comparing the image of the user to a plurality of sample images of an image dictionary using the at least one processor.

5. The image processing apparatus of claim 4 , wherein each of the plurality of sample images corresponds to different postures of different body types that is compared to the user based on the captured image of the user.

6. The image processing apparatus of claim 5 , wherein a selected sample image of the plurality of sample images is used to estimate joint distances of the user, wherein the estimated joint distances of the user are used in generating an augmented reality environment with real-time movement that emulates the movements of the user after the image of the user is captured.

7. The image processing apparatus according to claim 1 , wherein the image processing apparatus is further configured to identify an upper-body clothes region.

8. The image processing apparatus according to claim 7 , wherein the upper body region is determined by groups of pixels bearing similar color.

9. The image processing apparatus according to claim 7 , wherein the image processing apparatus is further configured to identify a special processing region in the upper body region, and wherein the special processing region is replaced with image other than a background image.

10. The image processing apparatus according to claim 9 , wherein the special processing region is a collar, bottom edge or sleeve of the virtual clothing determined by a shape of the virtual clothing.

11. The image processing apparatus according to claim 1 , wherein the image processing apparatus is further configured to identify a lower-body clothes region.

12. The image processing apparatus according to claim 1 , wherein the protruded region is expanded by circumferentially expanding the virtual clothing by an appropriate number of pixels until the virtual clothing covers the upper body region.

13. The image processing apparatus according to claim 1 wherein the protruded region is narrowed by replacing the protruded region with a predetermined image.

14. The image processing apparatus according to claim 13 , wherein the predetermined image is a background image.

15. The image processing apparatus according to claim 14 , wherein the background image is modified based on a warmth index of the virtual clothing.

16. The image processing apparatus according to claim 1 , wherein the displayed virtual clothing is modified based on a texture stiffness of real clothing associated with the virtual clothing.

17. The image processing apparatus according to claim 1 , wherein the displayed virtual clothing is modified to show a degree of tightness of the virtual clothing.

18. The image processing apparatus according to claim 17 , where an animation is displayed to show the degree of tightness of the virtual clothing.

19. An image processing method implemented by at least one processor, wherein the method comprising:

displaying a human-figure virtual object image over an image including a user using the at least one processor, to give visual guidance to the user for adjusting the user's posture in accordance with the calibration pose, wherein the calibration pose is a pose leading the user to take by bending the user's appropriate joints;

extracting joint distance information from an image of the user doing the calibration pose;

searching for a protruded region where a region of the user's body is protruded from a displayed virtual clothing;

performing protruded region adjustment process to the protruded region; and

display the virtual clothing to have a shape determined based on the protruded region adjustment process,

wherein the protruded region adjustment process is performed to expand the displayed virtual clothing, or to narrow areas other than the protruded region of the displayed virtual clothing.

20. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a processor of a computer causes the processor to perform a method, the method comprising:

displaying a human-figure virtual object image over an image including a user using the at least one processor, to give visual guidance to the user for adjusting the user's posture in accordance with the calibration pose, wherein the calibration pose is a pose leading the user to take by bending the user's appropriate joints;

extracting joint distance information from an image of the user doing the calibration pose;

searching for a protruded region where a region of the user's body is protruded from a displayed virtual clothing,

performing a protruded region adjustment process to the protruded region; and

display the virtual clothing to have a shape determined based on the protruded region adjustment process,

wherein the protruded region adjustment processing is performed to expand the displayed virtual clothing, or to narrow areas other than the protruded region of the displayed virtual clothing.