IP Library Granted Patent US 11,468,576
Granted Patent B2
US 11,468,576 · App. 17/178,570 · Granted Oct 11, 2022

Tracking within and across facilities

Inventors: Kunal Rao (Monroe, NJ); Utsav Drolia (Milipitas, CA); Murugan Sankaradas (Dayton, NJ); Srimat Chakradhar (Manalapan, NJ)
G06T7/292G06V20/52G06V40/161G06V40/172G06V40/50H04N7/181G06Q30/0226G06T2207/10016G06T2207/30201G06T2207/30232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,468,576
App. No.
17/178,570
Granted
Oct 11, 2022
Kind
B2
Abstract

A method for tracing individuals through physical spaces that includes registering cameras in groupings relating a physical space. The method further includes performing local video monitoring including a video sensor input that outputs frames from inputs from recording with the cameras in the groupings, a face detection application for extracting faces from the output frames, and a face matching application for matching faces extracted from the output frames to a watchlist, and a local movement monitor that assigns tracks to the matched faces. The method further includes performing a global monitor including a biometrics monitor for preparing the watchlist of faces, the watchlist of faces being updated when a new face is detected by the cameras in the groupings, and a global movement monitor that combines the outputs from the assigned tracks to the matched faces to launch a report regarding individual population traveling to the physical spaces.

Claims (31)

1. A computer-implemented method for tracking individuals through physical spaces comprising:

registering cameras in groupings relating to at least one physical space;

recording individuals with the cameras in groupings relating to the at least one physical space;

performing local video monitoring including outputting frames from the recording of the individuals with the cameras in the groupings, extracting faces from the output frames, matching faces extracted from the output frames to a watchlist, and assigning tracks to the matched faces based on the cameras in the groupings and the movement of the individuals across multiple regions of interest in the at least one physical space; and

performing a global monitor including a biometrics monitor for preparing the watchlist of faces, the watchlist of faces being updated when a new face is detected by the cameras in the groupings, and a global movement monitor that combines the outputs from the assigned tracks including the movement of the individuals across multiple regions of interest to the matched faces to launch a report regarding individual population density at the physical space corresponding to the cameras in the groupings, the report being issued in real time and indicating the track of the individuals to the physical space that were detected by the cameras according to the regions of interest.

2. The computer-implemented method of claim 1 wherein the launch of the report is to an application that provides an incentive for individuals to move to a specific region of the physical space.

3. The computer-implemented method of claim 1 wherein the groupings relating to physical space may be a first region within an interior of a building, and a second region of a second adjacent building.

4. The computer-implemented method of claim 1 , wherein said tracking individuals through physical spaces comprises recording when an individual has entered a physical space, recording when an individual is present in said physical space, recording when an individual has moved from one position to another position in the physical space, and when an individual has left a physical space.

5. The computer-implemented method of claim 1 , wherein when the recording individuals with the cameras and the face matching application for matching faces extracted from the output frames to the watchlist can not identify a match, a new identification is self-registered for a non-matching individual.

6. The computer-implemented method of claim 1 , wherein the performing local video monitoring comprises monitoring multiple video streams.

7. The computer-implemented method of claim 1 , wherein the assigning tracks includes a time period measurement for traveling through a sequence of cameras in the cameras in the groupings relating to the at least one physical space.

8. A system for tracking individuals through physical spaces comprising:

cameras in groupings relating to at least one physical space;

a local video monitoring system including a video sensor input that outputs frames from inputs from the recording the individuals with the cameras in the groupings, a face detection application for extracting faces from the output frames, a face matching application for matching faces extracted from the output frames to a watchlist, and a local movement monitor that assigns tracks to the matched faces based on the cameras in the groupings and the movement of the individuals across multiple regions of interest in the at least one physical space; and

a global monitor system including a biometrics monitor for preparing the watchlist of faces, the watchlist of faces being updated when a new face is detected by the cameras in the groupings, and a global movement monitor that combines the outputs from the assigned tracks including the movement of the individuals across multiple regions of interest to the matched faces to launch a report regarding patron population density at the physical space corresponding to the cameras in the groupings, the report being issued in real time and indicating the track of the individuals to the physical space that were detected by the cameras according to the regions of interest.

9. The system of claim 8 , wherein the launch of the report is to an application that provides an incentive for individuals to move to a specific region of the physical space.

10. The system of claim 8 , wherein the groupings relating to physical space may be a first region within an interior of a building, and a second region of a second adjacent building.

11. The system of claim 8 , wherein the face matching application assigns an identification value to the faces.

12. The system of claim 8 , wherein when the recording individuals with the cameras and the face matching application for matching faces extracted from the output frames to the watchlist can not identify a match, a new identification is self-registered for a non-matching individual.

13. The system of claim 8 , wherein the performing local video monitoring comprises multiple video streams to the video sensor input.

14. The system of claim 8 , wherein the assigning tracks includes a time period measurement for traveling through a sequence of cameras in the cameras in the groupings relating to the at least one physical space.

15. A computer program product is provided for tracing individuals through physical spaces, the computer program product comprising a non-transitory computer readable storage medium having computer readable program code embodied therewith, the program instructions executable by a processor to cause the processor to:

register, using the processor, cameras in groupings relating to at least one physical space;

record individuals with the cameras in groupings relating to the at least one physical space;

perform, using the processor, local video monitoring including performing local video monitoring including outputting frames from the recording of the individuals with the cameras in the groupings, extracting faces from the output frames, matching faces extracted from the output frames to a watchlist, and assigning tracks to the matched faces based on the cameras in the groupings and the movement of the individuals across multiple regions of interest in the at least one physical space; and

perform, using the processor, a global monitor including a biometrics monitor for preparing the watchlist of faces, the watchlist of faces being updated when a new face is detected by the cameras in the groupings, and a global movement monitor that combines the outputs from the assigned tracks including the movement of the individuals across multiple regions of interest to the matched faces to launch a report regarding patron population density at the physical space corresponding to the cameras in the groupings, the report being issued in real time and indicating the track of the individuals to the physical space that were detected by the cameras according to the regions of interest.

16. The computer program product of claim 15 , wherein the launch of the report is to an application to provide an incentive for individuals to move to a specific region of the physical space.

17. The computer program product of claim 15 , wherein the groupings relating to physical space may be a first region within an interior of a building, and a second region of two adjacent buildings.

18. The computer program product of claim 15 , wherein the face matching application assigns an identification value to the faces.

19. The computer program product of claim 15 , wherein the recording individuals with the cameras and the face matching application for matching faces extracted from the output frames to the watchlist can not identify a match, a new identification is self-registered for a non-matching individual.

20. The computer program product of claim 15 , wherein the performing local video monitoring comprises monitoring multiple video streams.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2022
From: NEC LABORATORIES AMERICA, INC.
To: NEC CORPORATION
Reel/Frame 060855/0623 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2021
From: RAO, KUNAL; DROLIA, UTSAV; SANKARADAS, MURUGAN; CHAKRADHAR, SRIMAT
To: NEC LABORATORIES AMERICA, INC.
Reel/Frame 055667/0798 →
Continuity (2)
Provisional Application 62979482 · Feb 21, 2020
Related Publication 20210264621A1 · Aug 26, 2021
Cited By (1)
US 12,462,567