IP Library Granted Patent US 9,240,064
Granted Patent B2
US 9,240,064 · App. 14/354,135 · Granted Jan 19, 2016

Image processing device, method for controlling image processing device, program, and information storage medium

Inventors: Keita Yaegashi (Tokyo, JP); Soh Masuko (Tokyo, JP); Shinya Takami (Tokyo, JP)
Assignee: RAKUTEN, INC.
G06T11/60G06T3/00G06T7/0081G06T2207/20132G06T2210/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,240,064
App. No.
14/354,135
Granted
Jan 19, 2016
Kind
B2
Abstract

Provided is an image processing device capable of obtaining a trimming image including a characteristic part of a target image without having a person to select the characteristic part of the target image. A setting unit sets a plurality of trimming candidate areas in a target image. A calculation unit calculates, with respect to each of a plurality of trimming candidate areas, a total value of edge amounts of pixels in the trimming candidate area. A determination unit determines a trimming area from among the plurality of trimming candidate areas, based on the total value of each of the plurality of trimming candidate areas. An obtaining unit obtains an image in the trimming area.

Claims (132)

1. An image processing device, comprising:

a setting unit that sets a plurality of trimming candidate areas in a target image;

a calculation unit that calculates, with respect to each of the plurality of trimming candidate areas, a total value of edge amounts of pixels in the trimming candidate area;

a determination unit that determines a trimming area from among the plurality of trimming candidate areas, based on the total value of each of the plurality of trimming candidate areas; and

an obtaining unit that obtains an image in the trimming area,

wherein the calculation unit calculates the total value of edge amounts of each of the pixels in the trimming candidate area, by summing up the edge amounts of each of the individual pixels in the trimming candidate area to thereby calculate the total value of the trimming candidate area, and

the determination unit comprises a unit that determines a trimming candidate area of which the total value is a maximum among the plurality of trimming candidate areas as the trimming area.

2. The image processing device according to claim 1 , wherein

the edge amount is an amount relevant to a difference in brightness between a pixel and a pixel around the pixel.

3. The image processing device according to claim 1 , wherein

the edge amount is an amount relevant to a difference in hue between a pixel and a pixel around the pixel.

4. The image processing device according to claim 1 , wherein

the setting unit sets a partial area in the target image as a trimming candidate area, and moves the trimming candidate area vertically and/or horizontally in the target image to thereby set the plurality of trimming candidate areas.

5. An image processing device, comprising:

a setting unit that sets a plurality of trimming candidate areas in a target image;

a calculation unit that calculates, with respect to each of the plurality of trimming candidate areas, a total value of edge amounts of pixels in the trimming candidate area;

a determination unit that determines a trimming area from among the plurality of trimming candidate areas, based on the total value of each of the plurality of trimming candidate areas; and

an obtaining unit that obtains an image in the trimming area,

wherein the calculation unit calculates the total value of edge amounts of each of the pixels in the trimming candidate area, by summing up the edge amounts of each of the individual pixels in the trimming candidate area to thereby calculate the total value of the trimming candidate area,

the image processing device further comprises a second calculation unit that calculates, with respect to each of the plurality of trimming candidate areas, a divided value or an inverted value thereof, the divided value being obtained by dividing the total value of the trimming candidate area by the total value of edge amounts of pixels in at least one boundary part of the trimming candidate area, and

the determination unit determines the trimming area from among the plurality of trimming candidate areas, based on the divided value or the inverted value of each of the plurality of trimming candidate areas.

6. The image processing device according to claim 5 , wherein

the determination unit comprises a unit that determines a trimming candidate area of which the divided value is a maximum or a trimming candidate area of which the inverted value is a minimum among the plurality of trimming candidate areas as the trimming area.

7. The image processing device according to claim 5 , further comprising:

a unit that calculates, with respect to each of the plurality of trimming candidate areas, a total value of edge amounts of pixels in a first boundary part of the trimming candidate area as a first total value; and

a unit that calculates, with respect to each of the plurality of trimming candidate areas, a total value of edge amounts of pixels in a second boundary part of the trimming candidate area as a second total value, the second boundary part being opposite to the first boundary part, wherein

the second calculation unit calculates, with respect to each of the plurality of trimming candidate areas, a divided value or an inverted value thereof, the divided value being obtained by dividing the total value of the trimming candidate area by larger one of the first total value and the second total value of the trimming candidate area.

8. An image processing device, comprising:

a setting unit that sets a plurality of trimming candidate areas in a target image;

a calculation unit that calculates, with resect to each of the plurality of trimming candidate areas, a total value of edge amounts of pixels in the trimming candidate area;

a determination unit that determines a trimming area from among the plurality of trimming candidate areas, based on the total value of each of the plurality of trimming candidate areas; and

an obtaining unit that obtains an image in the trimming area,

wherein the calculation unit calculates the total value of edge amounts of each of the pixels in the trimming candidate area, by summing up the edge amounts of each of the individual pixels in the trimming candidate area to thereby calculate the total value of the trimming candidate area,

the calculation unit calculates a weighted total value of the edge amounts of the pixels in the trimming candidate area as the total value of the edge amounts of the pixels in the trimming candidate area, and

the calculation unit sets a higher weight for an edge amount of a first pixel in a middle part of the trimming candidate area than a weight for an edge amount of a second pixel in a boundary part of the trimming candidate area.

9. An image processing device, comprising:

a setting unit that sets a plurality of trimming candidate areas in a target image;

a calculation unit that calculates, with respect to each of the plurality of trimming candidate areas, a total value of edge amounts of pixels in the trimming candidate area;

a determination unit that determines a trimming area from among the plurality of trimming candidate areas, based on the total value of each of the plurality of trimming candidate areas; and

an obtaining unit that obtains an image in the trimming area,

wherein the calculation unit calculates the total value of edge amounts of each of the pixels in the trimming candidate area, by summing up the edge amounts of each of the individual pixels in the trimming candidate area to thereby calculate the total value of the trimming candidate area, and

the image processing device further comprises a unit that removes a part which includes an end part of the image in the trimming area, but does not include a pixel of which an edge amount is equal to or larger than a reference amount.

10. An image processing device, comprising:

a setting unit that sets a plurality of trimming candidate areas in a target image;

a calculation unit that calculates, with respect to each of the plurality of trimming candidate areas, a total value of edge amounts of pixels in the trimming candidate area;

a determination unit that determines a trimming area from among the plurality of trimming candidate areas, based on the total value of each of the plurality of trimming candidate areas; and

an obtaining unit that obtains an image in the trimming area,

wherein the calculation unit calculates the total value of edge amounts of each of the pixels in the trimming candidate area, by summing up the edge amounts of each of the individual pixels in the trimming candidate area to thereby calculate the total value of the trimming candidate area,

the image processing device further comprises storage that stores correlation data for correlating distribution pattern information to each of a plurality of different kinds of trimming area determination processings for determining the trimming area from among the plurality of trimming candidate areas, the distribution pattern information being information on a distribution pattern of an edge amount of an image, and

the determination unit determines the trimming area from among the plurality of trimming candidate areas based on the total value of each of the plurality of trimming candidate areas, through trimming area determination processing correlated to a distribution pattern of an edge amount of the target image.

11. The image processing device according to claim 10 , wherein

the determination unit comprises a unit that determines a plurality of trimming areas corresponding to the plurality of different kinds of trimming area determination processings by determining the trimming area from among the plurality of trimming candidate areas based on the total value of each of the plurality of trimming candidate areas, through each of the plurality of different kinds of trimming area determination processings, and

the image processing device further comprises:

a display control unit that displays images in the plurality of trimming areas on a display unit;

a receiving unit that receives at least one image selected by a user among the images in the plurality of trimming areas; and

an update unit that updates the correlation data based on a result of selection by the user.

12. The image processing device according to claim 10 , wherein

the plurality of different kinds of trimming area determination processings include:

trimming area determination processing for determining a trimming candidate area of which the total value is a maximum among the plurality of trimming candidate areas as the trimming area, and

trimming area determination processing for determining a trimming candidate area of which a divided value is a maximum among the plurality of trimming candidate areas as the trimming area, the divided value being obtained by dividing the total value by a total value of edge amounts of pixels in at least one boundary part of the trimming candidate area.

13. The image processing device according to claim 10 , wherein

the calculation unit comprises:

a first calculation unit that calculates, with respect to each of the plurality of trimming candidate areas, a total value of first edge amounts of pixels in the trimming candidate area as a first total value, and

a second calculation unit that calculates, with respect to each of the plurality of trimming candidate areas, a total value of second edge amounts of pixels in the trimming candidate area as a second total value,

the first edge amount is an amount relevant to a difference in hue between a pixel and a pixel around the pixel,

the second edge amount is an amount relevant to a difference in brightness between a pixel and a pixel around the pixel, and

the plurality of different kinds of trimming area determination processings include:

trimming area determination processing for determining a trimming area from among the plurality of trimming candidate areas based on the first total value of each of the plurality of trimming candidate areas, and

trimming area determination processing for determining a trimming area from among the plurality of trimming candidate areas based on the second total value of each of the plurality of trimming candidate areas.

14. An image processing device, comprising:

a setting unit that sets a plurality of trimming candidate areas in a target image;

a calculation unit that calculates, with respect to each of the plurality of trimming candidate areas, a total value of edge amounts of pixels in the trimming candidate area;

a determination unit that determines a trimming area from among the plurality of trimming candidate areas, based on the total value of each of the plurality of trimming candidate areas; and

an obtaining unit that obtains an image in the trimming area,

wherein the calculation unit calculates the total value of edge amounts of each of the pixels in the trimming candidate area, by summing up the edge amounts of each of the individual pixels in the trimming candidate area to thereby calculate the total value of the trimming candidate area,

the image processing device further comprises storage that stores correlation data for correlating distribution pattern information to each of a plurality of different kinds of trimming area determination processings for determining the trimming area from among the plurality of trimming candidate areas, the distribution pattern information being information on a distribution pattern of an edge amount of an image, and

the determination unit comprises a unit that determines a plurality of trimming areas corresponding to the plurality of different kinds of trimming area determination processings by determining the trimming area from among the plurality of trimming candidate areas based on the total value of each of the plurality of trimming candidate areas, through each of the plurality of different kinds of trimming area determination processings,

the image processing device further comprises:

a display control unit that displays images in the plurality of trimming areas on a display unit; and

a receiving unit that receives at least one image selected by a user among the images in the plurality of trimming areas; and

the display control unit displays preferentially or distinctively an image in a trimming area corresponding to trimming area determination processing correlated to a distribution pattern of an edge amount of the target image, among the images in the plurality of trimming areas.

15. The image processing device according to claim 14 , further comprising an update unit that updates the correlation data based on a result of selection by the user.

16. A method for controlling an image processing device, the method comprising:

setting a plurality of trimming candidate areas in a target image;

calculating, with respect to each of the plurality of trimming candidate areas, a total value of edge amounts of pixels in the trimming candidate area;

determining a trimming area from among the plurality of trimming candidate areas, based on the total value of each of the plurality of trimming candidate areas; and

obtaining an image in the trimming area,

wherein the calculating calculates the total value of edge amounts of each of the pixels in the trimming candidate area, by summing up the edge amounts of each of the individual pixels in the trimming candidate area to thereby calculate the total value of the trimming candidate area, and

the determining comprises determining a trimming candidate area of which the total value is a maximum among the plurality of trimming candidate areas as the trimming area.

17. A method for controlling an image processing device, the method comprising:

setting a plurality of trimming candidate areas in a target image;

calculating, with respect to each of the plurality of trimming candidate areas, a total value of edge amounts of pixels in the trimming candidate area;

determining a trimming area from among the plurality of trimming candidate areas, based on the total value of each of the plurality of trimming candidate areas; and

obtaining an image in the trimming area,

wherein the calculating calculates the total value of edge amounts of each of the pixels in the trimming candidate area, by summing up the edge amounts of each of the individual pixels in the trimming candidate area to thereby calculate the total value of the trimming candidate area,

the method further comprises calculating, with respect to each of the plurality of trimming candidate areas, a divided value or an inverted value thereof, the divided value being obtained by dividing the total value of the trimming candidate area by the total value of edge amounts of pixels in at least one boundary part of the trimming candidate area, and

the determining determines the trimming area from among the plurality of trimming candidate areas, based on the divided value or the inverted value of each of the plurality of trimming candidate areas.

18. A method for controlling an image processing device, the method comprising:

setting a plurality of trimming candidate areas in a target image;

calculating, with respect to each of the plurality of trimming candidate areas, a total value of edge amounts of pixels in the trimming candidate area;

determining a trimming area from among the plurality of trimming candidate areas, based on the total value of each of the plurality of trimming candidate areas; and

obtaining an image in the trimming area,

wherein the calculating calculates the total value of edge amounts of each of the pixels in the trimming candidate area, by summing up the edge amounts of each of the individual pixels in the trimming candidate area to thereby calculate the total value of the trimming candidate area,

the calculating calculates a weighted total value of the edge amounts of the pixels in the trimming candidate area as the total value of the edge amounts of the pixels in the trimming candidate area, and

the calculating sets a higher weight for an edge amount of a first pixel in a middle part of the trimming candidate area than a weight for an edge amount of a second pixel in a boundary part of the trimming candidate area.

19. A method for controlling an image processing device, the method comprising:

setting a plurality of trimming candidate areas in a target image;

calculating, with respect to each of the plurality of trimming candidate areas, a total value of edge amounts of pixels in the trimming candidate area;

determining a trimming area from among the plurality of trimming candidate areas, based on the total value of each of the plurality of trimming candidate areas; and

obtaining an image in the trimming area,

wherein the calculating calculates the total value of edge amounts of each of the pixels in the trimming candidate area, by summing up the edge amounts of each of the individual pixels in the trimming candidate area to thereby calculate the total value of the trimming candidate area, and

the method further comprises removing a part which includes an end part of the image in the trimming area, but does not include a pixel of which an edge amount is equal to or larger than a reference amount.

20. A method for controlling an image processing device, the method comprising:

setting a plurality of trimming candidate areas in a target image;

calculating, with respect to each of the plurality of trimming candidate areas, a total value of edge amounts of pixels in the trimming candidate area;

determining a trimming area from among the plurality of trimming candidate areas, based on the total value of each of the plurality of trimming candidate areas; and

obtaining an image in the trimming area,

wherein the calculating calculates the total value of edge amounts of each of the pixels in the trimming candidate area, by summing up the edge amounts of each of the individual pixels in the trimming candidate area to thereby calculate the total value of the trimming candidate area,

the method further comprises referring correlation data for correlating distribution pattern information to each of a plurality of different kinds of trimming area determination processings for determining the trimming area from among the plurality of trimming candidate areas, the distribution pattern information being information on a distribution pattern of an edge amount of an image, and

the determining determines the trimming area from among the plurality of trimming candidate areas based on the total value of each of the plurality of trimming candidate areas, through trimming area determination processing correlated to a distribution pattern of an edge amount of the target image.

21. A method for controlling an image processing device, the method comprising:

setting a plurality of trimming candidate areas in a target image;

calculating, with respect to each of the plurality of trimming candidate areas, a total value of edge amounts of pixels in the trimming candidate area;

determining a trimming area from among the plurality of trimming candidate areas, based on the total value of each of the plurality of trimming candidate areas; and

obtaining an image in the trimming area,

wherein the calculating calculates the total value of edge amounts of each of the pixels in the trimming candidate area, by summing up the edge amounts of each of the individual pixels in the trimming candidate area to thereby calculate the total value of the trimming candidate area,

the method further comprises referring correlation data for correlating distribution pattern information to each of a plurality of different kinds of trimming area determination processings for determining the trimming area from among the plurality of trimming candidate areas, the distribution pattern information being information on a distribution pattern of an edge amount of an image,

the determining comprises determining a plurality of trimming areas corresponding to the plurality of different kinds of trimming area determination processings by determining the trimming area from among the plurality of trimming candidate areas based on the total value of each of the plurality of trimming candidate areas, through each of the plurality of different kinds of trimming area determination processings,

the method further comprises:

displaying images in the plurality of trimming areas on a display; and

receiving at least one image selected by a user among the images in the plurality of trimming areas; and

the displaying displays preferentially or distinctively an image in a trimming area corresponding to trimming area determination processing correlated to a distribution pattern of an edge amount of the target image, among the images in the plurality of trimming areas.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE PATENT NUMBERS 10342096;10671117; 10716375; 10716376;10795407;10795408; AND 10827591 PREVIOUSLY RECORDED AT REEL: 58314 FRAME: 657. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 29, 2024
From: RAKUTEN, INC.
To: RAKUTEN GROUP, INC.
Reel/Frame 068066/0103 →
CHANGE OF NAME Recorded Dec 6, 2021
From: RAKUTEN, INC.
To: RAKUTEN GROUP, INC.
Reel/Frame 058314/0657 →
CHANGE OF ADDRESS Recorded Jan 21, 2016
From: RAKUTEN, INC.
To: RAKUTEN, INC.
Reel/Frame 037567/0507 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 18, 2014
From: YAEGASHI, KEITA; MASUKO, SOH; TAKAMI, SHINYA
To: RAKUTEN, INC.
Reel/Frame 033338/0878 →
Priority Claims (1)
JP 2011-245871 · Nov 9, 2011 · national
Continuity (1)
Related Publication 20140327697A1 · Nov 6, 2014