IP Library Granted Patent US 9,396,570
Granted Patent B2
US 9,396,570 · App. 14/129,501 · Granted Jul 19, 2016

Image processing method to superimpose item image onto model image and image processing device thereof

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,396,570
App. No.
14/129,501
Granted
Jul 19, 2016
Kind
B2
Abstract

An image processing device includes an item image acquisition unit that acquires an item image, a model image acquisition unit that acquires a model image, a correction unit that corrects a tilt of a correction target region being at least a part of an item region being a region where an item is shown in the item image so that a direction of a center of gravity position of the correction target region with respect to a support position of the correction target region is along a direction of gravity in the model image, and an output unit that outputs the model image and the item region so that the item region is displayed superimposed on the model image. A composite image closer to the state where the item is actually worn on the human body is thereby provided.

Claims (37)

1. An image processing device comprising:

at least one non-transitory memory that stores computer program code; and

a processor operable to access said memory and execute said computer program code, said computer program code comprising:

item image acquisition code configured to cause said processor to acquire an item image displaying an item being an accessory worn dangling down;

model image acquisition code configured to cause said processor to acquire a model image where a part on which the item is to be worn is shown;

correction code configured to

cause said processor to correct a tilt of a correction target region being at least a part of an item region being a region where an item is shown in the item image so that a direction of a center of gravity position of the correction target region with respect to a support position of the correction target region is along a direction of gravity in the model image, and

adjust a size of the item region so that a ratio of a size of a part on which the item is to be worn in the model image and the size of the item region is substantially equal to a ratio of an actual size of the part on which the item is to be worn and an actual size of the item based on the size of the part on which the item is to be worn in the model image acquired from the model image, information about the actual size of the part on which the item is to be worn that is set in advance, the size of the item region in the item image acquired from the item image, and information about the actual size of the item that is stored in advance; and

output code configured to cause said processor to output the model image and the item region so that the item region is displayed superimposed on the model image.

2. The image processing device according to claim 1 , wherein

the correction target region is a whole of the item region, and

the support position is a position where an attachment portion of the item is shown in the item region.

3. The image processing device according to claim 1 , wherein

the item includes a first part and a second part joined to each other through a joint portion such that the first part and the second part are able to swing with respect to each other,

the correction target region comprises the first part and the second part, and

the support position is a joint end in the correction target region on a side of the first part.

4. The image processing device according to claim 3 , wherein the correction code is further configured to cause said processor to specify a first region of the item region in which a length of the first region where an item is shown along a predetermined direction in the item image is shorter than adjacent regions of the item region adjacent to the first region in a predetermined range by at least a predetermined amount of difference as the joint portion and specify the adjacent regions as the first part and the second part.

5. The image processing device according to claim 1 , wherein said computer program code further comprises specifying code configured to cause said processor to specify the direction of gravity in the model image based on information that can be acquired from the model image, and

the correction code is further configured to cause said processor to correct the tilt of the correction target region based on the direction of gravity specified according to the specifying code.

6. The image processing device according to claim 1 , wherein the correction code is further configured to cause said processor to, when an item image whose vertical direction is specified is acquired according to the item image acquisition code, specify an uppermost portion in the item region as the attachment portion.

7. The image processing device according to claim 1 , wherein the output code is further configured to cause said processor to specify the part on which the item is to be worn in the model image by searching for the model image using a template indicating characteristics of the part on which the item is to be worn, and superimpose the item region on the model image so that a position where the attachment portion of the item is shown comes at the part on which the item is to be worn in the model image.

8. An image processing method executed by a computer, the method comprising:

an item image acquisition step of acquiring an item image displaying an item being an accessory worn dangling down;

a model image acquisition step of acquiring a model image where a part on which the item is to be worn is shown;

a correction step of correcting a tilt of a correction target region being at least a part of an item region being a region where an item is shown in the item image so that a direction of a center of gravity position of the correction target region with respect to a support position of the correction target region is along a direction of gravity in the model image, and of adjusting a size of the item region so that a ratio of a size of a part on which the item is to be worn in the model image and the size of the item region is substantially equal to a ratio of an actual size of the part on which the item is to be worn and an actual size of the item based on the size of the part on which the item is to be worn in the model image acquired from the model image, information about the actual size of the part on which the item is to be worn that is set in advance, the size of the item region in the item image acquired from the item image, and information about the actual size of the item that is stored in advance; and

an output step of outputting the model image and the item region so that the item region is displayed superimposed on the model image.

9. An image processing device comprising:

at least one non-transitory memory that stores computer program code; and

a processor operable to access said memory and to execute said computer program code, said computer program code comprising:

item image acquisition code configured to cause said processor to acquire an item image displaying an item being an accessory worn dangling down;

model image acquisition code configured to cause said processor to acquire a model image where a part on which the item is to be worn is shown;

correction code configured to cause said processor to correct a tilt of a correction target region being at least a part of an item region being a region where an item is shown in the item image so that a direction of a center of gravity position of the correction target region with respect to a support position of the correction target region is along a direction of gravity in the model image; and

output code configured to cause said processor to output the model image and the item region so that the item region is displayed superimposed on the model image,

wherein the item comprises a first part and a second part joined to each other through a joint portion such that the first part and the second part are able to swing with respect to each other,

wherein the correction target region comprises the first part and the second part,

wherein the support position is a joint end in the correction target region on a side of the first part, and

wherein the correction code is further configured to cause said processor to specify a first region of the item region in which a length of the first region where an item is shown along a predetermined direction in the item image is shorter than adjacent regions of the item region adjacent to the first region in a predetermined range by at least a predetermined amount of difference as the joint portion and specify the adjacent regions as the first part and the second part.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE PATENT NUMBERS 10342096;10671117; 10716375; 10716376;10795407;10795408; AND 10827591 PREVIOUSLY RECORDED AT REEL: 58314 FRAME: 657. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 29, 2024
From: RAKUTEN, INC.
To: RAKUTEN GROUP, INC.
Reel/Frame 068066/0103 →
CHANGE OF NAME Recorded Dec 6, 2021
From: RAKUTEN, INC.
To: RAKUTEN GROUP, INC.
Reel/Frame 058314/0657 →
CHANGE OF ADDRESS Recorded Feb 3, 2016
From: RAKUTEN, INC.
To: RAKUTEN, INC.
Reel/Frame 037690/0315 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2013
From: HAYASHI, YASUYUKI
To: RAKUTEN, INC.
Reel/Frame 031853/0841 →