IP Library Granted Patent US 9,424,486
Granted Patent B2
US 9,424,486 · App. 14/254,851 · Granted Aug 23, 2016

Method of image processing

Inventors: Anil Anthony Bharath (London, GB); Jeffrey Ng Sing Kwong (London, GB)
Assignee: Cortexica Vision Systems Limited
G06K9/6202G06K9/00228G06K9/00268G06K9/52G06T7/0044
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,424,486
App. No.
14/254,851
Granted
Aug 23, 2016
Kind
B2
Abstract

Disclosed embodiments relate to a systems and methods of identifying a target object in an image using image processing. Template data is stored which represents a template orientation field indicative of an orientation of each of a plurality of features of a template object. Image data may be received and processed to generate an image orientation field indicating an orientation corresponding to the plurality of image features. The image data may be further processed to generate image confidence data based on at least one characteristic for use in identifying the target object in a given image, and the characteristic may be indicative of an increased likelihood that at least one part of the given image represents at least part of the target object, relative to other parts of the given image. The image orientation field is processed using the template orientation field and the image confidence data to generate a match metric indicative of an extent of matching between at least part of the template orientation field and at least part of the image orientation field. The match metric may then be used to determine whether or not the target object has been identified in the image.

Claims (60)

1. A method of identifying a target object in an image including a plurality of image features, the method comprising:

storing template data, the template data representing a template orientation field indicative of an orientation of each of a plurality of features of a template object;

receiving image data representing the image;

processing the image data to generate an image orientation field indicating an orientation corresponding to the plurality of image features;

processing the image data to generate image confidence data based on at least one characteristic for use in identifying the target object in a given image, the characteristic being indicative of an increased likelihood that at least one part of the given image represents at least part of the target object, relative to other parts of the given image;

processing the image orientation field using the template orientation field and the image confidence data to generate a match metric indicative of an extent of matching between at least part of the template orientation field and at least part of the image orientation field; and

using the match metric to determine whether or not the target object has been identified in the image.

2. The method of claim 1 , the method comprises applying the image confidence data to the image orientation field to generate a modified image orientation field indicating both an orientation corresponding to the plurality of image features and a likelihood that at least one part of the image orientation field represents at least part of the target object.

3. The method of claim 1 , wherein the characteristic indicated by the image confidence data relates to an extent of image data errors expected in the image data, and wherein the method further comprises using the image confidence data to generate the match metric according to the expected extent of image data errors.

4. The method of claim 1 , wherein the characteristic indicated by the image confidence data relates to a possible occlusion of part of the target object in the image, and wherein the method further comprises using the image confidence data to generate the match metric according to the possible occlusion.

5. The method of claim 1 , wherein the image data is video image data and wherein the characteristic relates to a possible movement of the target object.

6. The method of claim 5 , wherein the method further comprises using the characteristic relating to the possible movement of the target object and an identified movement of the target object to determine a modified shape of the target object, and wherein the target object is modified from a shape of the target object represented by the template data.

7. The method of claim 1 , wherein the image data represents the image in color, and wherein the characteristic relates to at least one color indicative of the target object.

8. The method of claim 1 , wherein generating the match metric comprises using deformation data indicative of a deformation of template data with respect to image data.

9. The method of claim 1 , wherein at least one of the image data, the template data, the image confidence data, and deformation data used to generate the match metric, is arranged according to a matrix format.

10. The method of claim 1 , wherein each of the image features represents, in the image, a boundary which separates a region of higher light intensity from a region of lower light intensity.

11. The method of claim 10 , wherein the boundary separates two regions, each having a similar light intensity, from each other.

12. A system for identifying a target object in an image including a plurality of image features, the system comprising:

a data store comprising executable software;

a processor in data communication with the data store, the processor configured to execute the software and cause a computing device to:

store template data, said template data representing a template orientation field indicative of an orientation of each of a plurality of features of a template object;

receive image data representing the image;

process the image data to generate an image orientation field indicating an orientation corresponding to the plurality of image features;

process the image data to generate image confidence data based on at least one characteristic for use in identifying the target object in a given image, the characteristic being indicative of an increased likelihood that at least one part of the given image represents at least part of the target object, relative to other parts of the given image;

process the image orientation field using the template orientation field and the image confidence data to generate a match metric indicative of an extent of matching between at least part of the template orientation field and at least part of the image orientation field; and

use the match metric to determine whether or not the target object has been identified in the image.

13. A non-transitory computer-readable storage medium having computer readable instructions stored thereon, wherein, when executed, cause the computerized device to perform a method of identifying a target object in an image including a plurality of image features, the method comprising, the method comprising:

storing template data, said template data representing a template orientation field indicative of an orientation of each of a plurality of features of a template object;

receiving image data representing the image;

processing the image data to generate an image orientation field indicating an orientation corresponding to the plurality of image features;

processing the image data to generate image confidence data based on at least one characteristic for use in identifying the target object in a given image, the characteristic being indicative of an increased likelihood that at least one part of the given image represents at least part of the target object, relative to other parts of the given image;

processing the image orientation field using the template orientation field and the image confidence data to generate a match metric indicative of an extent of matching between at least part of the template orientation field and at least part of the image orientation field; and

using the match metric to determine whether or not the target object has been identified in the image.

14. A method of identifying a target object in an image including a plurality of image features, the method comprising:

storing template data, the template data representing a template orientation field indicative of an orientation of each of a plurality of features of a template object;

receiving template confidence data indicating a likelihood that at least one part of the template accurately represents at least part of the target object;

receiving image data representing the image;

processing the image data to generate an image orientation field indicating an orientation corresponding to the plurality of image features;

processing the image orientation field using the template orientation field and the template confidence data to generate a match metric indicative of an extent of matching between at least part of the template orientation field and at least part of the image orientation field; and

using the match metric to determine whether or not the target object has been identified in the image.

15. The method of claim 14 , wherein the method further comprises applying the template confidence data to the template orientation field to generate a modified template orientation field indicating both an orientation of each of the plurality of features of the template object and a likelihood that at least one part of the template orientation field represents at least part of the target object.

16. The method of claim 14 , wherein generating the match metric comprises using deformation data indicative of a deformation of template data with respect to image data.

17. The method of claim 14 , wherein each of the image features represents a boundary in the image which separates a region of higher light intensity from a region of lower light intensity.

18. The method of claim 17 , wherein the boundary separates two regions, each having a similar light intensity, from each other.

19. A system for identifying a target object in an image including a plurality of image features, the system comprising:

a data store comprising executable software;

a processor in data communication with the data store, the processor configured to execute the software and cause a computing device to:

store template data, the template data representing a template orientation field indicative of an orientation of each of a plurality of features of a template object;

receive template confidence data indicating a likelihood that at least one part of the template accurately represents at least part of the target object;

receive image data representing the image;

process the image data to generate an image orientation field indicating an orientation corresponding to the plurality of image features;

process the image orientation field using the template orientation field and the template confidence data to generate a match metric indicative of an extent of matching between at least part of the template orientation field and at least part of the image orientation field; and

use the match metric to determine whether or not the target object has been identified in the image.

20. A non-transitory computer-readable storage medium having computer readable instructions stored thereon, wherein, when executed, cause the computerized device to perform a method of identifying a target object in an image including a plurality of image features, the method comprising:

storing template data, the template data representing a template orientation field indicative of an orientation of each of a plurality of features of a template object;

receiving template confidence data indicating a likelihood that at least one part of the template accurately represents at least part of the target object;

receiving image data representing the image;

processing the image data to generate an image orientation field indicating an orientation corresponding to the plurality of image features;

processing the image orientation field using the template orientation field and the template confidence data to generate a match metric indicative of an extent of matching between at least part of the template orientation field and at least part of the image orientation field; and

using the match metric to determine whether or not the target object has been identified in the image.

Assignments (6)
SECURITY INTEREST Recorded Apr 12, 2021
From: ZEBRA TECHNOLOGIES CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 056471/0906 →
RELEASE OF SECURITY INTEREST - 364 - DAY Recorded Mar 5, 2021
From: JPMORGAN CHASE BANK, N.A.
To: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
Reel/Frame 056036/0590 →
SECURITY INTEREST Recorded Sep 1, 2020
From: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 053841/0212 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2020
From: CORTEXICA VISION SYSTEMS LIMITED
To: ZEBRA TECHNOLOGIES CORPORATION
Reel/Frame 051565/0503 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 14, 2016
From: BHARATH, ANIL ANTHONY; NG SING KWONG, JEFFREY
To: IMPERIAL INNOVATIONS LTD
Reel/Frame 039160/0581 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 14, 2016
From: IMPERIAL INNOVATIONS LIMITED
To: CORTEXICA VISION SYSTEMS LIMITED
Reel/Frame 039160/0596 →
Priority Claims (1)
GB 0616293.7 · Aug 16, 2006 · national
Continuity (2)
Continuation 12377490
Related Publication 20140226859A1 · Aug 14, 2014