IP Library Granted Patent US 8,614,838
Granted Patent B2
US 8,614,838 · App. 12/973,118 · Granted Dec 24, 2013

Image processing apparatus and image processing method

Inventors: Ryo Kosaka (Toyko, JP); Reiji Misawa (Tokyo, JP); Tomotoshi Kanatsu (Tokyo, JP); Hidetomo Sohma (Yokohama, JP)
Assignee: Canon Kabushiki Kaisha
H04N1/40H04N1/387G09G5/00G06F17/00G06F17/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,614,838
App. No.
12/973,118
Granted
Dec 24, 2013
Kind
B2
Abstract

According to the present invention, it is possible to create electronic document data capable of highlighting an object detected through a search so that a user can easily recognize it. An image processing apparatus extracts an object from an input image and extracts metadata related to the object. The image processing apparatus, when determines to describe with a shape in accordance with the shape of the object, creates a vector path description of frame described with a shape in accordance with the shape of the object. Then, the image processing apparatus creates an electronic document including data of the input image and the vector path description of frame with which the metadata is associated. When a keyword search is performed on the created electronic document, highlight display is performed in accordance with the vector path description of frame with which metadata that matches the keyword is associated.

Claims (46)

1. An image processing apparatus comprising:

an object extraction unit configured to extract an object from an input image;

a metadata extraction unit configured to extract metadata related to the object;

a determination unit configured to determine, on the basis of whether or not another object exists near the object, whether to describe a first vector path description or to describe a second vector path description, wherein the first vector path description is data of a first frame which circumscribes the object with a shape similar to a shape of the object, and wherein the second vector path description is data of a second frame which circumscribes the object with a predetermined shape, and wherein the determination unit determines to describe the first vector path description when another object exists near the object, and wherein the determination unit determines to describe the second vector path description when another object does not exist near the object;

a frame creation unit configured to create the first vector path description in the case that the determination unit determines to describe the first vector path description, and to create the second vector path description in the case that the determination unit determines to describe the second vector path description; and

a document creation unit configured to create an electronic document including data of the input image and the created first or second vector path description with which the metadata is associated,

wherein when a keyword search is performed on the created electronic document, highlight display is performed in accordance with the created first or second vector path description with which metadata that matches the keyword is associated.

2. The image processing apparatus according to claim 1 , wherein the determination unit determines, on the basis of i) whether or not the object is described in a vector path description, ii) the size of the object, and iii) whether or not another object exists near the object, whether to describe the first vector path description or to describe the second vector path description, and

wherein, when the object is described in a vector path description and when the size of the object is small or another object exists near the object, the determination unit determines to describe the first vector path description, and

wherein, when the object is not described in a vector path description, or when the object is described in a vector path description, the size of the object is large, and there is no adjacent object near the object, the determination unit determines to describe the second vector path description.

3. The image processing apparatus according to claim 1 , wherein the first vector path description is the data of the first frame which circumscribes the object with a shape similar to the shape of an outer contour of the object.

4. The image processing apparatus according to claim 1 , wherein the first vector path description includes an enlargement parameter description for making a frame larger than the object.

5. The image processing apparatus according to claim 1 , wherein a drawing color of the first and second vector path description is a transparent color.

6. The image processing apparatus according to claim 1 , wherein the first and second vector path description includes a parameter description of a highlighting color used for highlight display when the keyword search is performed.

7. The image processing apparatus according to claim 6 , wherein the highlighting color used for performing highlight display is different from the color of the object.

8. The image processing apparatus according to claim 1 , wherein

the frame creation unit further creates a third vector path description of supplementary information which supplementarily indicates the object,

the document creation unit creates an electronic document including the input image, the first or second vector path description with which the metadata is associated, and the third vector path description of supplementary information, and

when a keyword search is performed on the electronic document, highlight display is performed in accordance with the first or second vector path description with which metadata that matches the keyword is associated and the third vector path description of supplementary information.

9. An image processing apparatus comprising:

an object extraction unit configured to extract an object from an input image;

a metadata extraction unit configured to extract metadata related to the object;

a determination unit configured to determine, on the basis of whether or not another object exists near the object, whether to describe a first vector path description or to describe a second vector path description, wherein the first vector path description is data of a frame which circumscribes the object with a shape similar to an outer contour of the shape of the object, and wherein the second vector path description is data of a frame which circumscribes the object with a predetermined shape, and wherein the determination unit determines to describe the first vector path description when another object exists near the object, and wherein the determination unit determines to describe the second vector path description when another object does not exist near the object;

a frame creation unit configured to create the first vector path description that is data of a frame which circumscribes the object with a shape similar to an outer contour of the shape of the object in the case that the determination unit determines to describe the first vector path description; and

a document creation unit configured to create an electronic document including data of the input image and the first vector path description with which the metadata is associated,

wherein when a keyword search is performed on the created electronic document, highlight display is performed in accordance with the first vector path description with which metadata that matches the keyword is associated.

10. An image processing apparatus comprising:

an extraction unit configured to extract an object from an input image and obtain area information of the object;

a determination unit configured to determine, on the basis of whether or not another object exists near the object, whether to describe a first vector path description or to describe a second vector path description, wherein the first vector path description is data of a transparent frame which circumscribes the extracted object with a shape of the obtained area information, and wherein the second vector path description is data of a frame which circumscribes the object with a predetermined shape, and wherein the determination unit determines to describe the first vector path description when another object exists near the object, and wherein the determination unit determines to describe the second vector path description when another object does not exist near the object;

a frame creation unit configured to create the first vector path description that is data of a transparent frame which circumscribes the extracted object with a shape of the obtained area information in a case that the determination unit determines to describe the first vector path description; and

an electronic document creation unit configured to create an electronic document including the input image and the created vector path description,

wherein the created vector path description of the transparent frame includes a parameter description of a highlighting color for highlighting the frame when an object is searched for and detected as a search result from the created electronic document.

11. An image processing method comprising:

an object extracting step of extracting, by an object extraction unit, an object from an input image;

a metadata extraction step of extracting, by a metadata extraction unit, metadata related to the object;

a determination step of determining, on the basis of whether or not another object exists near the object, by a determination unit, whether to describe a first vector path description or to describe a second vector path description, wherein the first vector path description is data of a first frame which circumscribes the object with a shape similar to a shape of the object, and where the second vector path description is data of a second frame with circumscribes the object with a predetermined shape, and wherein the determination unit determines to describe the first vector path description when another object exists near the object, and wherein the determination unit determines to describe the second vector path description when another object does not exist near the object;

a frame creation step of creating, by a frame creation unit, the first vector path description when determining to describe the first vector path description in the determination step, and creating, by the frame creation unit, the second vector path description when determining to describe the second vector path description in the determination step; and

a document creation step of creating, by a document creation unit, an electronic document including data of the input image and the created first or second vector path description with which the metadata is associated,

wherein when a keyword search is performed on the created electronic document, highlight display is performed in accordance with the created first or second vector path description with which metadata that matches the keyword is associated.

12. A non-transitory computer-readable recording medium having recording thereon code of computer-executable instructions that, when executed by an image processing apparatus, causes the apparatus to perform steps comprising:

an object extracting step of extracting by an object extraction unit, an object from an input image;

a metadata extraction step of extracting, by a metadata extraction unit, metadata related to the object;

a determination step of determining, on the basis of whether or not another object exists near the object, by a determination unit, whether to describe a first vector path description or to describe a second vector path description, wherein the first vector path description is data of a first frame which circumscribes the object with a shape similar to a shape of the object, and wherein the second vector path description is data of a second frame which circumscribes the object with a predetermined shape, and wherein the determination unit determines to describe the first vector path description when another object exists near the object, and wherein the determination unit determines to describe the second vector path description when another object does not exist near the object;

a frame creation step of creating, by a frame creation unit, the first vector path description when determining to describe the first vector path description in the determination step, and creating, by the frame creation unit, the second vector path description when determining to describe the second vector path description in the determination step; and

a document creation step of creating, by a document creation unit, an electronic document including data of the input image and the created first or second vector path description with which the metadata is associated,

wherein when a keyword search is performed on the created electronic document, highlight display is performed in accordance with the created first or second vector path description with which metadata that matches the keyword is associated.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2011
From: KOSAKA, RYO; MISAWA, REIJI; KANATSU, TOMOTOSHI; SOHMA, HIDETOMO
To: CANON KABUSHIKI KAISHA
Reel/Frame 026132/0555 →
Priority Claims (1)
JP 2010-000489 · Jan 5, 2010 · national
Continuity (1)
Related Publication 20110167081A1 · Jul 7, 2011