IP Library Granted Patent US 10,685,394
Granted Patent B2
US 10,685,394 · App. 16/053,261 · Granted Jun 16, 2020

Image processing apparatus, image processing method, and program

Inventors: Seiji Suzuki (Kanagawa, JP); Shunichi Kasahara (Kanagawa, JP)
Assignee: SONY CORPORATION
G06Q30/0643G06F3/04845G06K9/00362G06T7/0004G06T7/251G06T7/90G06T11/60G06Q30/0621G06T2207/20221G06T2207/30108G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,685,394
App. No.
16/053,261
Granted
Jun 16, 2020
Kind
B2
Abstract

Disclosed herein is an image processing apparatus including a display control part configured to display a human-figure virtual object image in a pose from which to extract information necessary for motion capture, the human-figure virtual object image being the object to be handled corresponding to a person targeted to be recognized.

Claims (34)

1. An image processing apparatus, comprising at least one processor, wherein the image processing apparatus is configured to:

cause a displayer to display a calibration image, at least one of a shape or a size of the calibration image signifying to a user to take a calibration pose by bending the user's joints to calculate distances between the joints;

acquire a captured image of the user including the user taking the calibration pose, the captured image being different than the calibration image; and

cause the displayer to display a virtual object corresponding to the user and overlaid on the captured image.

2. The image processing apparatus according to claim 1 , wherein the virtual object is a virtual garment.

3. The image processing apparatus according to claim 1 , wherein the at least one of the shape or the size of the calibration image is similar to at least one of a shape or a size of the calibration pose.

4. The image processing apparatus according to claim 1 , wherein the image processing apparatus is further configured to:

extract, based on the captured image, figure information of the user.

5. The image processing apparatus according to claim 4 , wherein the image processing apparatus is further configured to:

cause the displayer to adjust, based on the extracted figure information, the display of the virtual object.

6. The image processing apparatus according to claim 4 , wherein the extracted figure information indicates a shape and a position of the user in the captured image.

7. The image processing apparatus according to claim 4 , wherein the figure information comprises skeletal information of the user.

8. The image processing apparatus according to claim 4 , wherein the figure information comprises feature information of the user.

9. The image processing apparatus according to claim 4 , wherein the image processing apparatus is further configured to:

overlay, based on the extracted figure information, the virtual object on images taken of the user.

10. The image processing apparatus according to claim 9 , wherein the image processing apparatus is further configured to:

cause the displayer to display the virtual object overlaid on the images taken of the user.

11. The image processing apparatus according to claim 4 , wherein the extracted figure information comprises a plurality of points and a plurality of lines.

12. The image processing apparatus according to claim 11 , wherein a line of the plurality of lines links at least two points of the plurality of points.

13. The image processing apparatus according to claim 1 , wherein the image processing apparatus is further configured to:

extract a user region from the captured image based on an area where the calibration image is displayed.

14. The image processing apparatus according to claim 1 , wherein the image processing apparatus is further configured to:

cause the displayer to display the calibration image before acquiring the captured image of the user.

15. The image processing apparatus according to claim 1 , wherein the at least one of the shape or the size of the calibration image signifies to the user to take the calibration pose by bending the user's joints to calculate distances between the bent joints of the user.

16. The image processing apparatus according to claim 1 , wherein the at least one of the shape or the size of the calibration image signifies to the user to take the calibration pose by bending the joints of the user's arms or the user's legs to calculate distances between the joints.

17. The image processing apparatus according to claim 1 , wherein the at least one of the shape or the size of the calibration image signifies to the user to take the calibration pose by bending at least two of the user's joints to calculate distances between the at least two of the user's joints.

18. An image processing method implemented by at least one processor, the method comprising:

displaying a calibration image, at least one of a shape or a size of the calibration image signifying to a user to take a calibration pose by bending the user's joints to calculate distances between the joints;

acquiring a captured image of the user including the user taking the calibration pose, the captured image being different than the calibration image; and

displaying a virtual object corresponding to the user and overlaid on the captured image.

19. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising:

displaying a calibration image, at least one of a shape or a size of the calibration image signifying to a user to take a calibration pose by bending the user's joints to calculate distances between the joints;

acquiring a captured image of the user including the user taking the calibration pose, the captured image being different than the calibration image; and

displaying a virtual object corresponding to the user and overlaid on the captured image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2018
From: SUZUKI, SEIJI; KASAHARA, SHUNICHI
To: SONY CORPORATION
Reel/Frame 046540/0643 →
Priority Claims (1)
JP 2011-123194 · Jun 1, 2011 · national
Continuity (3)
Continuation 15333656 · Oct 25, 2016
Continuation 13479814 · May 24, 2012
Related Publication 20180342009A1 · Nov 29, 2018