IP Library Granted Patent US 8,644,607
Granted Patent B1
US 8,644,607 · App. 13/801,027 · Granted Feb 4, 2014

Method and apparatus for image processing

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,644,607
App. No.
13/801,027
Granted
Feb 4, 2014
Kind
B1
Abstract

A method is described for processing an image to generate a signature which is characteristic of a pattern within the image. The method includes: receiving an image; overlaying a window at multiple locations on the image to define a plurality of sub-images within the image, with each sub-image each having a plurality of pixels having a luminance level; determining a luminance value for each sub-image where the luminance value is derived from the luminance levels of the plurality of pixels; and combining the luminance values for each of the sub-images to form the signature. The combining is such that the signature is independent of the location of each sub-image. A method of creating a database of images using the method of generating signatures is also described.

Claims (73)

1. A method for processing an image to generate a signature which is characteristic of a pattern within said image comprising:

receiving an image;

overlaying a window at multiple locations on said image to define a plurality of sub-images within said image, with each sub-image each having a plurality of pixels having a luminance level;

determining a luminance value for each said sub-image, wherein said luminance value is derived from said luminance levels of said plurality of pixels;

combining said luminance values for each of said sub-images to form said signature;

wherein said combining is such that said signature is independent of the location of each sub-image.

2. The method according to claim 1 , wherein determining said luminance value comprises:

determining an average luminance for each of said plurality of pixels;

determining whether said average luminance is greater than a threshold value;

setting each of said plurality of pixels to a first value if said average luminance is greater than a threshold value;

setting each of said plurality of pixels to a second value if said average luminance is lower than a threshold value; and

combining said first values and said second values to generate said luminance value for each said sub-image.

3. The method according to claim 2 , wherein said threshold value is the average luminance of the image.

4. The method according to claim 2 , wherein said first value is one and said second value is zero and said luminance value is a binary number.

5. The method according to claim 1 , wherein combining said luminance value comprises defining a histogram having a plurality of slots with each slot representing a luminance value.

6. The method according to claim 5 , wherein combining said luminance value comprises incrementing a slot in said histogram for each sub-image having a luminance value corresponding to said slot.

7. The method according to claim 5 , wherein said histogram has 512 slots and said sub-image has 3×3 pixels.

8. The method according to claim 5 , wherein combining said luminance value comprises converting said histogram to a feature vector to form said signature.

9. The method according to claim 1 , wherein at least some of said plurality of images partially overlap at least one other image.

10. The method according to claim 1 , comprising rescaling said received image before overlaying said window.

11. The method according to claim 1 , comprising converting said received image or said rescaled image to grayscale before determining said luminance values.

12. The method according to claim 1 , comprising converting each said sub-image to greyscale when determining said luminance value for said sub-image.

13. The method according to claim 1 , comprising rescaling said sub-image within said window to reduce the number of pixels within said sub-image to said plurality of pixels.

14. The method according to claim 1 , the method further comprising:

receiving a query image;

retrieving a first retrieved image from a database together with its corresponding signature;

comparing said signature for said query image with said signature for said first retrieved image to generate a similarity value for said retrieved image;

repeating said retrieving and comparing steps to generate similarity values for a second retrieved images;

ranking said similarity values to yield a ranking value; and

outputting a retrieved image having the highest ranking value.

15. A method of creating a database of images comprising:

defining a plurality of sub-sections within said database with each sub-section having a corresponding signature which is generated by

receiving an image representative of said sub-section;

overlaying a window at multiple locations on each said representative image to define a plurality of sub-images within each said representative image, with each sub-image each having a plurality of pixels having a luminance level;

determining a luminance value for each said sub-image, wherein said luminance value is derived from said luminance levels of said plurality of pixels;

combining said luminance values for each of said sub-images to form said signature;

wherein said combining is such that said signature is independent of the location of each sub-image;

receiving an input image to be input into said database;

determining a signature for said input image by:

overlaying a window at multiple locations on said input image to define a plurality of input sub-images within said input image, with each sub-image each having a plurality of pixels having a luminance level;

determining a luminance value for each said input sub-image, wherein said luminance value is derived from said luminance levels of said plurality of pixels;

combining said luminance values for each of said input sub-images to form said signature;

wherein said combining is such that said signature is independent of the location of each input sub-image;

comparing said signature for said input image with each signature of said plurality of sub-sections to generate a similarity value for each of said plurality of sub-sections;

ranking said similarity values; and

allocating said input image to said sub-section having the highest rank.

16. A system for processing an image to generate a signature which is characteristic of a pattern within said image, said system comprising

a processor configured to:

overlay a window at multiple locations on an image to define a plurality of sub-images within said image, with each sub-image each having a plurality of pixels having a luminance level;

determine a luminance value for each said sub-image, wherein said luminance value is derived from said luminance levels of said plurality of pixels;

combine said luminance values for each of said sub-images to form said signature;

wherein said combining is such that said signature is independent of the location of each sub-image.

17. The system of claim 16 , wherein the processor is further configured to:

determine a signature for a query image by:

overlaying a window at multiple locations on said image to define a plurality of sub-images within said image, with each sub-image each having a plurality of pixels having a luminance level,

determining a luminance value for each said sub-image, wherein said luminance value is derived from said luminance levels of said plurality of pixels, and

combining said luminance values for each of said sub-images to form said signature; wherein said combining is such that said signature is independent of the location of each sub-image;

retrieve an image from a database together with its corresponding signature;

compare said signature for said query image with said signature for said retrieved image to generate a similarity value for said retrieved image;

repeat said retrieving and comparing steps to generate similarity values for multiple retrieved images; and

rank said similarity values; and

provide the images having highest ranks.

18. A system for characterizing an image within a database of images, the system comprising:

a database having a plurality of sub-sections with each sub-section having a corresponding signature;

an input for receiving an input image to be input into said database;

a processor which is configured to

determine a signature for said input image by

overlaying a window at multiple locations on said image to define a plurality of sub-images within said image, with each sub-image each having a plurality of pixels having a luminance level;

determining a luminance value for each said sub-image, wherein said luminance value is derived from said luminance levels of said plurality of pixels; and

combining said luminance values for each of said sub-images to form said signature; wherein said combining is such that said signature is independent of the location of each sub-image;

compare said signature for said input image with each signature of said plurality of sub-sections to generate a similarity value for each of said plurality of sub-sections;

rank said similarity values; and

allocate said input image to said sub-section having the highest rank.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2025
From: DEEPMIND TECHNOLOGIES LIMITED
To: GDM HOLDING LLC
Reel/Frame 071109/0414 →
CORRECTIVE ASSIGNMENT TO CORRECT THE DECLARATION AGAINST APPLICATION NO. 13801027 PREVIOUSLY RECORDED AT REEL: 044101 FRAME: 0299. ASSIGNOR(S) HEREBY CONFIRMS THE DECLARATION . Recorded Jan 12, 2022
From: DEEPMIND TECHNOLOGIES LIMITED
To: DEEPMIND TECHNOLOGIES LIMITED
Reel/Frame 058704/0759 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2017
From: GOOGLE INC.
To: DEEPMIND TECHNOLOGIES LIMITED
Reel/Frame 044242/0116 →
CHANGE OF NAME Recorded Oct 2, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044101/0299 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2014
From: DEEPMIND TECHNOLOGIES LIMITED
To: GOOGLE INC.
Reel/Frame 032746/0855 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2013
From: COPPIN, BENJAMIN KENNETH; SULEYMAN, MUSTAFA; NAIR, ARUN
To: DEEPMIND TECHNOLOGIES LIMITED
Reel/Frame 029988/0103 →