IP Library Granted Patent US 11,670,086
Granted Patent B2
US 11,670,086 · App. 17/582,760 · Granted Jun 6, 2023

System and process for detecting, tracking and counting human objects of interest

Inventors: Zhiqian Wang (Schaumburg, IL); William C. Kastilahn (Evanston, IL)
Assignee: ShopperTrak RCT LLC
G06V20/52G06F18/22G06F18/28G06T7/285G06T7/292G06T2207/10016G06T2207/10021G06T2207/30242G06V10/62
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,670,086
App. No.
17/582,760
Granted
Jun 6, 2023
Kind
B2
Abstract

A method of identifying, tracking, and counting human objects of interest based upon at least one pair of stereo image frames taken by at least one image capturing device, comprising the steps of: obtaining said stereo image frames and converting each said stereo image frame to a rectified image frame using calibration data obtained for said at least one image capturing device; generating a disparity map based upon a pair of said rectified image frames; generating a depth map based upon said disparity map and said calibration data; identifying the presence or absence of said objects of interest from said depth map and comparing each of said objects of interest to existing tracks comprising previously identified objects of interest; for each said presence of an object of interest, adding said object of interest to one of said existing tracks if said object of interest matches said one existing track, or creating a new track comprising said object of interest if said object of interest does not match any of said existing tracks; updating each said existing track; and maintaining a count of said objects of interest in a given time period based upon said existing tracks created or modified during said given time period.

Claims (26)

1. A computer-implemented method of detecting and tracking objects of interest, comprising:

obtaining, by a processor, stereo image frames from one or more image capturing devices, wherein each image capturing device is associated with a zone;

identifying, by the processor, one or more objects of interest within one or more of the frames, each of the identified objects described by one or more properties;

for each identified object:

determining, by the processor, whether the one or more properties satisfy a specified condition defined by one or more predicate operators; and

determining, by the processor, a position of the identified object based on one or more of i) the corresponding frames and ii) each zone of the one or more corresponding image capturing devices;

comparing, by the processor for each identified object having properties determined to satisfy the specified condition, the determined object one or more existing tracks, each existing track associated with a previously-tracked object of interest, the comparing based at least in part on one or both of the determined position of the identified object and the zone of the corresponding image capturing device;

for each compared object matching an existing track, adding, by the processor to the corresponding existing track, information about the matching object, including one or more of the determined position and the determined zone corresponding to the matching object; and

for each compared object not matching an existing track, creating and storing, by the processor, a track corresponding to the not matching object.

2. The method of claim 1 , wherein a direction of the objects of interest can be determined.

3. The method of claim 1 , wherein a speed of the objects of interest can be determined.

4. The method of claim 1 , wherein an amount of time spent by the objects of interest within one of the zones can be determined.

5. An object tracking system, comprising:

a memory; and

at least one processor coupled to the memory, the memory including instructions executable by the at least one processor to cause the system to:

obtain stereo image frames from one or more image capturing devices, wherein each image capturing device is associated with a zone;

identify, by the processor, one or more objects of interest within one or more of the frames, each of the identified objects described by one or more properties;

for each identified object:

determine by the processor, whether the one or more properties satisfy a specified condition defined by one or more predicate operators; and

determine by the processor, a position of the identified object based on one or more of i) the corresponding frames and ii) each zone of the one or more corresponding image capturing devices;

compare by the processor for each identified object having properties determined to satisfy the specified condition, the determined object one or more existing tracks, each existing track associated with a previously-tracked object of interest, the comparing based at least in part on one or both of the determined position of the identified object and the zone of the corresponding image capturing device;

for each compared object matching an existing track, add, by the processor to the corresponding existing track, information about the matching object, including one or more of the determined position and the determined zone corresponding to the matching object; and

for each compared object not matching an existing track, create and store by the processor, a track corresponding to the not matching object.

6. The system of claim 5 , wherein a direction of the objects of interest can be determined.

7. The system of claim 5 , wherein a speed of the objects of interest can be determined.

8. The system of claim 5 , wherein an amount of time spent by the objects of interest within one of the zones can be determined.

Assignments (2)
CHANGE OF NAME Recorded Jan 18, 2023
From: SHOPPERTRAK RCT CORPORATION
To: SHOPPERTRAK RCT LLC
Reel/Frame 062417/0525 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2022
From: WANG, ZHIQIAN; KASTILAHN, WILLIAM C.
To: SHOPPERTRAK RCT CORPORATION
Reel/Frame 060747/0196 →
Continuity (7)
Continuation 16786436 · Feb 10, 2020
Continuation 15200864 · Jul 1, 2016
Continuation 13870065 · Apr 25, 2013
Continuation 13559824 · Jul 27, 2012
Continuation 13155466 · Jun 8, 2011
Continuation 11773254 · Jul 3, 2007
Related Publication 20220148321A1 · May 12, 2022