IP Library Granted Patent US 9,489,361
Granted Patent B2
US 9,489,361 · App. 14/397,201 · Granted Nov 8, 2016

Image processing device, image processing device control method, program, and information storage medium

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,489,361
App. No.
14/397,201
Granted
Nov 8, 2016
Kind
B2
Abstract

Provided is an image processing device capable of executing a determination of a display position of annotation information in consideration of a characteristic part of a target image without having a person designate a characteristic part of the target image or a part other than a characteristic part of the target image. An area setting unit sets a plurality of areas within a target image. A calculation unit calculates, as to each of the plurality of areas, a total value of edge amounts of the pixels within the area. An annotation information display area determination unit determines a display area of annotation information, based on the total value of each of the plurality of areas. A data output unit outputs data on the target image with the annotation information displayed in the display area determined by the annotation information display area determination unit.

Claims (69)

1. An image processing device, comprising:

a first area setting unit that sets, within a target image, a plurality of first areas for specifying a characteristic area of the target image;

a first calculation unit that calculates, as to each of the plurality of first areas, a total value of edge amounts of pixels within the first area;

a characteristic area detection unit that specifies the characteristic area, based on the total value of each of the plurality of first areas;

a second area setting unit that sets, within the target image, a plurality of second areas for determining a display area of annotation information;

a second calculation unit that calculates, as to each of the plurality of second areas, a total value of edge amounts of pixels within the second area; and

an annotation information display area determination unit that determines the display area of the annotation information, based on the total value of each of the plurality of second areas and the characteristic area.

2. The image processing device according to claim 1 , wherein

the annotation information display area determination unit determines one of the second areas, which are positioned outside the characteristic area, to be the display area of the annotation information, based on the total value of each of the second areas positioned outside the characteristic area.

3. The image processing device according to claim 2 , wherein

the annotation information display area determination unit determines one of the second areas, which has a smallest total value among the second areas positioned outside the characteristic area, to be the display area of the annotation information.

4. The image processing device according to claim 2 , wherein

the annotation information display area determination unit determines one of the second areas, which are positioned outside the characteristic area and have a total value less than a reference value, to be the display area of the annotation information.

5. The image processing device according to claim 1 , wherein

the annotation information display area determination unit determines one of the second areas, which are positioned within the characteristic area, to be the display area of the annotation information, based on the total values of each of the second areas positioned within the characteristic area.

6. The image processing device according to claim 5 , wherein

the annotation information display area determination unit determines one of the second areas, which has a smallest total value among the second areas positioned within the characteristic area, to be the display area of the annotation information.

7. The image processing device according to claim 5 , wherein

the annotation information display area determination unit determines one of the second areas, which are positioned within the characteristic area and have a total value less than a reference value, to be the display area of the annotation information.

8. The image processing device according to claim 5 , further comprising:

a unit that obtains a cropped image obtained by cropping the characteristic area, and

a unit that outputs data on the cropped image with the annotation information displayed in the determined display area.

9. The image processing device according to claim 1 , wherein

the annotation information display area determination unit determines the display area of the annotation information, based on the total value of each of the plurality of second areas and a distance between the second area and a representative point or a boundary of the characteristic area.

10. The image processing device according to claim 9 , wherein

the annotation information display area determination unit determines one of the second areas, which has a shortest distance among a subset of the second areas whose total value is less than a reference value, to be the display area of the annotation information.

11. The image processing device according to claim 9 , wherein

the annotation information display area determination unit determines one of the second areas, which have a total value less than a reference value and a distance shorter than a reference distance, to be the display area of the annotation information.

12. The image processing device according to claim 1 , wherein

the annotation information display area determination unit determines the display area of the annotation information, based on the total value of each of the plurality of second areas, the characteristic area, and a combination of color information of the second area and display color information of the annotation information.

13. The image processing device according to claim 1 , further comprising:

a unit that calculates, as to each of the plurality of second areas, a divided value or a multiplicative inverse thereof, the divided value being obtained by dividing the total value of the second area by a total value of edge amounts of pixels in at least one boundary portion of the second area, wherein

the annotation information display area determination unit determines the display area of the annotation information, based on the divided value of each of the plurality of second areas or the multiplicative inverse thereof and the characteristic area.

14. The image processing device according to claim 1 , wherein

the second calculation unit calculates a weighted total value of the edge amounts of the pixels in the second area as the total value of the edge amounts of the pixels in the second area, and

the second calculation unit sets a weight for an edge amount of a pixel in a middle portion of the second area higher than a weight for an edge amount of a pixel in a boundary portion of the second area.

15. The image processing device according to claim 1 , wherein

the edge amount is an amount relevant to a difference in brightness between a first pixel and a second pixel located around the first pixel.

16. The image processing device according to claim 1 , wherein

the edge amount is an amount relevant to a difference in color phase between a first pixel and a second pixel located around the first pixel.

17. The image processing device according to claim 1 , wherein

based on association data obtained by associating distribution pattern information concerning a distribution pattern of an edge amount of an image with each of a plurality of kinds of display area determination processing for determining the display area of the annotation information,

the annotation information display area determination unit executes determination of the display area of the annotation information based on the total value of each of the plurality of second areas, through display area determination processing associated with a distribution pattern of an edge amount of the target image.

18. The image processing device according to claim 17 , wherein

the second calculation unit comprises:

a unit that calculates, as to each of the plurality of second areas, a total value of first edge amounts of the pixels within the second area as a first total value, and

a unit that calculates, as to each of the plurality of second areas, a total value of second edge amounts of the pixels within the second area as a second total value,

the first edge amount is an amount relevant to a difference in color phase between a first pixel and a second pixel located around the first pixel,

the second edge amount is an amount relevant to a difference in brightness between the first pixel and the second pixel, and

the plurality of kinds of display area determination processing comprises:

display area determination processing for determining the display area of the annotation information, based on the first total value of each of the plurality of second areas, and

display area determination processing for determining the display area of the annotation information, based on the second total value of each of the plurality of second areas.

19. The image processing device according to claim 1 , wherein

the first area setting unit moves an area vertically and/or horizontally within the target image to thereby set the plurality of first areas, and

the second area setting unit moves an area vertically and/or horizontally within the target image to thereby set the plurality of second areas.

20. An image processing device control method, comprising:

setting, within a target image, a plurality of first areas for specifying a characteristic area of the target image;

calculating, as to each of the plurality of first areas, a total value of edge amounts of pixels within the first area;

specifying the characteristic area, based on the total value of each of the plurality of first areas;

setting, within the target image, a plurality of second areas for determining a display area of annotation information;

calculating, as to each of the plurality of second areas, a total value of edge amounts of pixels within the second area; and

determining the display area of the annotation information, based on the total value of each of the plurality of second areas and the characteristic area.

21. A non-transitory computer readable information storage medium storing a program for causing a computer to:

set, within a target image, a plurality of first areas for specifying a characteristic area of the target image;

calculate, as to each of the plurality of first areas, a total value of edge amounts of pixels within the first area;

specify the characteristic area, based on the total value of each of the plurality of first areas;

set, within the target image, a plurality of second areas for determining a display area of annotation information;

calculate, as to each of the plurality of second areas, a total value of edge amounts of pixels within the second area; and

determine the display area of the annotation information, based on the total value of each of the plurality of second areas and the characteristic area.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE PATENT NUMBERS 10342096;10671117; 10716375; 10716376;10795407;10795408; AND 10827591 PREVIOUSLY RECORDED AT REEL: 58314 FRAME: 657. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 29, 2024
From: RAKUTEN, INC.
To: RAKUTEN GROUP, INC.
Reel/Frame 068066/0103 →
CHANGE OF NAME Recorded Dec 6, 2021
From: RAKUTEN, INC.
To: RAKUTEN GROUP, INC.
Reel/Frame 058314/0657 →
CHANGE OF ADDRESS Recorded Jan 21, 2016
From: RAKUTEN, INC.
To: RAKUTEN, INC.
Reel/Frame 037567/0507 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2014
From: MASUKO, SOH
To: RAKUTEN, INC.
Reel/Frame 034035/0156 →