IP Library Granted Patent US 10,091,474
Granted Patent B2
US 10,091,474 · App. 14/431,755 · Granted Oct 2, 2018

Image processing device, image processing method, program and computer-readable storage medium

Inventors: Soh Masuko (Tokyo, JP); Yasuyuki Hayashi (Tokyo, JP)
Assignee: RAKUTEN, INC.
H04N9/3176G03B17/54G06F3/1415G06Q30/0643G06T7/11G06T11/001G06T11/40G06T11/60H04N5/7408H04N9/3179H04N9/3188H04N9/3194G06T2207/10028G06T2207/30196G06T2210/16G09G2340/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,091,474
App. No.
14/431,755
Granted
Oct 2, 2018
Kind
B2
Abstract

Coordination of two actual objects can be checked even if it is difficult to match the objects each other at the same place. An image processing device acquires a projection image that includes an image of a first object projected on a projection surface, and identifies an area, in the projection image projected by projecting means, blocked by a second object in front of the projection surface. The image processing device has projection control means for controlling the projecting means so that a size of the image of the first object projected on the projection surface is life-size, and the projecting means projects the projection image in which a color of the area identified by the object identifying means is replaced by a predetermined color.

Claims (36)

1. An image processing device comprising:

at least one processor; and

at least one memory device that stores a plurality of instructions, which when executed by the at least one processor, causes the at least one processor to:

obtain a ratio of skin color in a skin detection area of a plurality of projection images each of which includes an image of a human body to be projected on a projection surface;

select one of the plurality of projection images;

identify an area, in an image projected by a projector on the projection surface, blocked by real clothes which is not included in the projection image and in front of the projection surface; and

control, based on information on an original size of the human body, the projector to project the selected projection image in which a size of the image of the human body projected on the projection surface is the same size as the human body regardless of the distance of the projector to the projection surface, and a color of the identified area blocked by the real clothes is replaced by a predetermined color image,

wherein, in the selection, the processor selects one of the plurality of projection images based on the obtained ratio of skin color and whether the real clothes blocks a detection area that is determined according to the human body included in each of the plurality of projection images.

2. The image processing device according to claim 1 ,

wherein the processor further identifies the area blocked by the real clothes based on a depth image that indicates a distance from each pixel to an imaging device.

3. The image processing device according to claim 1 ,

wherein the processor further periodically identifies the area blocked by the real clothes, and

wherein, every time the area blocked by the real clothes is identified, the processor further causes the projector to project the selected projection image in in which the color of the identified area is replaced by a predetermined color image.

4. The image processing device according to claim 1 ,

wherein the processor further adjusts a position of the acquired one of the plurality of projection images based on a position of the image of the human body included in the selected one of the plurality of projection images.

5. The image processing device according to claim 1 ,

wherein the processor further acquires, from a user, information indicating a change of size of the projected human body, and controls the projector to change a size of the projection image from life-size based on the information indicating the change of size.

6. The image processing device according to claim 5 ,

wherein the processor further adjusts the position of the projection image in a case where the projection image in life-size is changed in size based on the position of the identified area.

7. The image processing device according to claim 1 ,

wherein the processor further controls the projector to further project a predetermined image on the identified area.

8. The image processing device according to claim 1 ,

wherein, in a first mode, the processor further controls the projector to project the selected projection image in which the color of the identified area is replaced by a predetermined color image, and

wherein, in a second mode, the processor further controls the projector to project the selected projection image on an area, in the identified area, that has been identified as not being blocked by the real clothes at a timing instructed by a user.

9. An image processing method comprising the steps of:

obtain a ratio of skin color in a skin detection area of a plurality of projection images each of which includes an image of a human body to be projected on a projection surface;

select one of the plurality of projection images;

identifying an area, in an image projected by a projector on the projection surface, blocked by real clothes which is not included in the projection image and in front of the projection surface; and

controlling, based on information on an original size of the human body, the projector to project the projection image in which a size of the image of the human body projected on the projection surface is the same size as the human body regardless of the distance of the projector to the projection surface, and a color of the identified area blocked by the real clothes is replaced by a predetermined color image,

wherein, in the selection, one of the plurality of projection images is selected based on the obtained ratio of skin color and whether the real clothes blocks a detection area that is determined according to the human body included in each of the plurality of projection images.

10. A computer-readable non-transitory storage medium for storing a program that causes a computer to execute processing of:

obtain a ratio of skin color in a skin detection area of a plurality of projection images each of which includes an image of a human body to be projected on a projection surface;

select one of the plurality of projection images;

identifying an area, in an image projected by a projector on the projection surface, blocked by real clothes which is not included in the projection image and in front of the projection surface; and

controlling, based on information on an original size of the human body, the projector to project the projection image in which a size of the image of the human body projected on the projection surface is the same size as the human body regardless of the distance of the projector to the projection surface, and a color of the identified area blocked by the real clothes is replaced by a predetermined color image,

wherein, in the selection, one of the plurality of projection images is selected based on the obtained ratio of skin color and whether the real clothes blocks a detection area that is determined according to the human body included in each of the plurality of projection images.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE PATENT NUMBERS 10342096;10671117; 10716375; 10716376;10795407;10795408; AND 10827591 PREVIOUSLY RECORDED AT REEL: 58314 FRAME: 657. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 29, 2024
From: RAKUTEN, INC.
To: RAKUTEN GROUP, INC.
Reel/Frame 068066/0103 →
CHANGE OF NAME Recorded Dec 6, 2021
From: RAKUTEN, INC.
To: RAKUTEN GROUP, INC.
Reel/Frame 058314/0657 →
CHANGE OF ADDRESS Recorded Jan 21, 2016
From: RAKUTEN, INC.
To: RAKUTEN, INC.
Reel/Frame 037567/0507 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2015
From: MASUKO, SOH; HAYASHI, YASUYUKI
To: RAKUTEN, INC.
Reel/Frame 035644/0900 →
Priority Claims (1)
JP 2012-216568 · Sep 28, 2012 · national
Continuity (1)
Related Publication 20150244997A1 · Aug 27, 2015