IP Library Granted Patent US 11,176,366
Granted Patent B2
US 11,176,366 · App. 16/442,266 · Granted Nov 16, 2021

Method of searching data to identify images of an object captured by a camera system

Inventors: Mahesh Saptharishi (Arlington, MA); Dimitri A. Lisin (Shrewsbury, MA)
Assignee: AVIGILON ANALYTICS CORPORATION
G06K9/00536G06K9/00718G06K9/00771G06K9/4671G06K9/52G06K9/6201G06T7/246G06T7/73H04N5/23203H04N5/23206H04N5/23219H04N5/232933H04N7/18H04N7/181G06T2207/10016G06T2207/30232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,176,366
App. No.
16/442,266
Granted
Nov 16, 2021
Kind
B2
Abstract

A camera system comprises an image capturing device, object detection module, object tracking module, and match classifier. The object detection module receives image data and detects objects appearing in one or more of the images. The object tracking module temporally associates instances of detected objects, each of which has a signature representing features of the detected object. The match classifier matches object instances by analyzing data derived from the signatures. The match classifier determines whether the signatures match.

Claims (27)

1. A system, comprising:

a user interface;

a processor communicatively coupled to the user interface; and

a memory communicatively coupled to the processor and having stored thereon computer program code that is executable by the processor, wherein the computer program code, when executed by the processor, causes the processor to:

detect a first object in a first image;

generate a first signature that represents a first subset of features selected from a set of features of the first object;

accept input from the user interface indicative of a selection of the first object;

make at least one determination as to whether the first signature matches one or more signatures of a group that correspond to a set of detected objects captured in images of at least one field of view of a camera system, wherein the detected objects in the set correspond to a same physical object, and wherein each signature includes a respective subset of features and the determination is based on matches between subsets of features; and

send a notification indicating a match between the first signature and a second signature of a second object of the set, wherein the second object is an instance of the same physical object.

2. The system of claim 1 , wherein the user interface includes a display and the notification includes displaying an image of the second object on the display.

3. The system of claim 1 , wherein the camera system comprises first and second image capturing devices connected to one another and the user interface, the first and second image capturing devices having, respectively, a first field of view and a second field of view, the field of view of the camera system corresponding to the first field of view and the second field of view in combination, wherein the image of the first object is captured with the first image capturing device and a second image of the second object is captured with the second image capturing device.

4. The system of claim 1 , in which the first object includes a fast signature representing a simplified version of the first signature, and the objects of the set include fast signatures representing simplified versions of the group of signatures, wherein the computer program code, when executed by the processor, further compares the fast signature of the first object with the fast signatures of the objects of the set prior to making determinations as to whether the signatures of the group match the first signature.

5. The system of claim 1 , wherein the computer program code, when executed by the processor, further retrieves the group of signatures from a database.

6. The system of claim 1 , wherein the computer program code, when executed by the processor, further sends the notification when the second signature matches the first signature and when a selected rules violation is associated with the second object.

7. The system of claim 1 , in which a rule violation is associated with each of the objects of the set.

8. A non-transitory computer readable medium having stored thereon computer program code that is executable by a processor and that, when executed by the processor, causes the processor to:

detect a first object in a first image;

generate a first signature that represents a first subset of features selected from a set of features of the first object;

accept input from a user interface indicative of a selection of the first object;

make at least one determination as to whether the first signature matches one or more signatures of a group that correspond to a set of detected objects captured in images of at least one field of view of a camera system, wherein the detected objects in the set correspond to a same physical object, and wherein each signature includes a subset of features and the determination is based on matches between subsets of features; and

send a notification indicating a match between the first signature and a second signature of a second object of the set, wherein the second object is an instance of the same physical object.

9. The non-transitory computer readable medium of claim 8 , wherein the user interface includes a display and the notification includes displaying an image of the second object on the display.

10. The non-transitory computer readable medium of claim 8 , wherein the camera system comprises first and second image capturing devices connected to one another and the user interface, the first and second image capturing devices having, respectively, a first field of view and a second field of view, the field of view of the camera system corresponding to the first field of view and the second field of view in combination, wherein the image of the first object is captured with the first image capturing device and a second image of the second object is captured with the second image capturing device.

11. The non-transitory computer readable medium of claim 8 , wherein the first object includes a fast signature representing a simplified version of the first signature, and the objects of the set include fast signatures representing simplified versions of the group of signatures, wherein the computer program code, when executed by the processor, further compares the fast signature of the first object with the fast signatures of the objects of the set prior to making determinations as to whether the signatures of the group match the first signature.

12. The non-transitory computer readable medium of claim 8 , wherein the computer program code, when executed by the processor, further retrieves the group of signatures from a database.

13. The non-transitory computer readable medium of claim 8 , wherein the computer program code, when executed by the processor, further sends the notification when the second signature matches the first signature and when a selected rules violation is associated with the second object.

14. The non-transitory computer readable medium of claim 8 , wherein a rule violation is associated with each of the objects of the set.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Aug 30, 2022
From: AVIGILON ANALYTICS CORPORATION
To: MOTOROLA SOLUTIONS, INC.
Reel/Frame 060942/0249 →
CHANGE OF NAME Recorded Jun 14, 2019
From: AVIGILON PATENT HOLDING 2 CORPORATION
To: AVIGILON ANALYTICS CORPORATION
Reel/Frame 049478/0348 →
Continuity (8)
Continuation 15802936 · Nov 3, 2017
Continuation 15068433 · Mar 11, 2016
Continuation 14183201 · Feb 18, 2014
Division 13543668 · Jul 6, 2012
Division 12397276 · Mar 3, 2009
Provisional Application 61033284 · Mar 3, 2008
Provisional Application 61033349 · Mar 3, 2008
Related Publication 20190303667A1 · Oct 3, 2019