IP Library Granted Patent US 10,043,212
Granted Patent B2
US 10,043,212 · App. 15/333,656 · Granted Aug 7, 2018

Image processing apparatus, image processing method, and program

Inventors: Seiji Suzuki (Kanagawa, JP); Shunichi Kasahara (Kanagawa, JP)
Assignee: SONY CORPORATION
G06Q30/0643G06F3/04845G06K9/00362G06T7/0004G06T7/251G06T7/90G06T11/60G06Q30/0621G06T2207/20221G06T2207/30108G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,043,212
App. No.
15/333,656
Granted
Aug 7, 2018
Kind
B2
Abstract

Disclosed herein is an image processing apparatus including a display control part configured to display a human-figure virtual object image in a pose from which to extract information necessary for motion capture, the human-figure virtual object image being the object to be handled corresponding to a person targeted to be recognized.

Claims (32)

1. An image processing apparatus for providing virtual try-on experience, comprising at least one processor, wherein the image processing apparatus is configured to:

cause a displaying of a human-figure virtual object image in a calibration pose over an image including a user so as to lead the user to take a pose corresponding to a human-figure virtual object;

extract skeletal information from an image of the user doing the pose corresponding to the human-figure virtual object;

overlay virtual clothes on images taken of the user based on the extracted skeletal information; and

cause a displaying of the virtual clothes overlaid on the images taken of the user.

2. The image processing apparatus according to claim 1 , wherein the human-figure virtual object image is displayed in the calibration pose to lead the user to take a similar pose as the human-figure virtual object.

3. The image processing apparatus according to claim 1 , wherein the image processing apparatus is further configured to:

cause a displaying of a warmth index of a virtual clothes being tried on in the image to indicate a sensation of warmth corresponding to the virtual clothes.

4. The image processing apparatus according to claim 3 , wherein the warmth index is expressed by replacing a background image of the image.

5. The image processing apparatus according to claim 4 , wherein the warmth index is expressed by replacing the background image of the image with an image of another region.

6. The image processing apparatus according to claim 3 , wherein the warmth index is expressed by replacing a color tone of a background image of the image.

7. The image processing apparatus according to claim 3 , wherein the warmth index is expressed by adding a virtual object to the image.

8. The image processing apparatus according to claim 1 , wherein the image processing apparatus is further configured to:

cause a displaying of a texture index of a virtual clothes being tried on in the image to indicate a stiffness of the virtual clothes.

9. The image processing apparatus according to claim 8 , wherein the texture index is expressed by reshaping the virtual clothes being tried on in the image.

10. The image processing apparatus according to claim 9 , wherein the texture index is further expressed by displaying the virtual clothes being fluttered over the user in the image.

11. The image processing apparatus according to claim 1 , wherein the image processing apparatus is further configured to:

cause a displaying of a texture of a virtual clothes being tried on in the image to indicate sizes corresponding to the virtual clothes.

12. The image processing apparatus according to claim 11 , wherein the image processing apparatus is further configured to apply an expression corresponding to a degree of tightness to the virtual clothes being tried on in the image.

13. The image processing apparatus according to claim 12 , wherein the expression is represented by the virtual clothes being torn apart.

14. The image processing apparatus according to claim 12 , wherein the expression is represented by a color of the virtual clothes being fainter.

15. The image processing apparatus according to claim 12 , wherein the expression is represented by a sound indicative of the virtual clothes being ripped.

16. An image processing method for providing virtual try-on experience, implemented by at least one processor, the method comprising:

causing a display of a human-figure virtual object image in a calibration pose over an image including a user so as to lead the user to take a pose corresponding to a human-figure virtual object;

extracting skeletal information from an image of the user doing the pose corresponding to the human-figure virtual object;

overlaying virtual clothes on images taken of the user based on the extracted skeletal information; and

causing a display of the virtual clothes overlaid on the images taken of the user.

17. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising:

causing a display of a human-figure virtual object image in a calibration pose over an image including a user so as to lead the user to take a pose corresponding to a human-figure virtual object;

extracting skeletal information from an image of the user doing the pose corresponding to the human-figure virtual object;

overlaying virtual clothes on images taken of the user based on the extracted skeletal information; and

causing a display of the virtual clothes overlaid on the images taken of the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 17, 2016
From: SUZUKI, SEIJI; KASAHARA, SHUNICHI
To: SONY CORPORATION
Reel/Frame 040355/0580 →
Priority Claims (1)
JP 2011-123194 · Jun 1, 2011 · national
Continuity (2)
Continuation 13479814 · May 24, 2012
Related Publication 20170039629A1 · Feb 9, 2017