IP Library Granted Patent US 9,818,203
Granted Patent B2
US 9,818,203 · App. 14/247,565 · Granted Nov 14, 2017

Methods and apparatuses for monitoring objects of interest in area with activity maps

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,818,203
App. No.
14/247,565
Granted
Nov 14, 2017
Kind
B2
Abstract

An apparatus for monitoring movement of objects of interest in an area includes an activity map generation circuit and a unified activity map generation circuit. The activity map generation circuit is configured to: generate a plurality of activity maps based on video content from a plurality of cameras, each of the plurality of activity maps being indicative of relative activity of the objects of interest over time within a field of view of a camera among the plurality of cameras, and each of the plurality of cameras having a different corresponding field of view in the area; and standardize the plurality of activity maps with regard to a single common point of view. The unified spatial activity map generation circuit is configured to combine the plurality of standardized activity maps into a unified activity map.

Claims (62)

1. An apparatus for monitoring movement of objects of interest in an area, the apparatus comprising:

an activity map generation circuit configured to,

generate a plurality of activity maps based on video content from a plurality of cameras, each of the plurality of activity maps being indicative of relative activity of the objects of interest over time within a field of view of a camera among the plurality of cameras, and each of the plurality of cameras having a different corresponding field of view in the area, and

standardize the plurality of activity maps with regard to a single common point of view;

a unified spatial activity map generation circuit configured to combine the plurality of standardized activity maps into a unified activity map; and

wherein the activity map generation circuit is further configured to standardize the plurality of activity maps with regard to the single common point of view by at least one of

modifying a direction feature with respect to tilt of at least one camera among the plurality of cameras,

transforming a spatial perspective of at least one of the plurality of activity maps from image coordinates to coordinates corresponding to the single common point of view,

normalizing an orientation of at least one of the plurality of activity maps,

normalizing probabilities with respect to at least one of the plurality of cameras, and

transforming a perspective spread of at least one of the plurality of activity maps.

2. The apparatus of claim 1 , further comprising:

a display configured to display the unified activity map to a user.

3. The apparatus of claim 2 , wherein the display is configured to display the unified activity map to the user along with a trajectory graph corresponding to the unified activity map.

4. The apparatus of claim 1 , further comprising:

a memory configured to store the unified activity map.

5. The apparatus of claim 1 , wherein the activity map generation circuit is further configured to,

generate a set of motion blur images for each of the plurality of cameras based on the video content, and

generate each of the plurality of activity maps based on a corresponding set of motion blur images.

6. The apparatus of claim 5 , wherein:

the video content from each of the plurality of cameras includes a sequence of image frames; and

the activity map generation circuit is configured to,

generate each motion blur image in the set of motion blur images based on a motion blur image corresponding to a current image frame in the sequence of image frames and motion blur images corresponding to previous image frames in the sequence of image frames.

7. The apparatus of claim 1 , wherein the relative activity of the objects of interest over time is one of density, dwell, direction, bi-direction and velocity of the objects of interest over time.

8. The apparatus of claim 1 , wherein each of the plurality of activity maps includes spatial activity feature values for one of density, dwell, direction, bi-direction and velocity.

9. An apparatus for monitoring movement of objects of interest in an area, the apparatus comprising:

an activity map generation circuit configured to

generate, using a single motion blur method, a plurality of activity maps based on video content from a plurality of cameras, each of the plurality of activity maps being indicative of relative activity of the objects of interest over time within a field of view of a camera among the plurality of cameras, and each of the plurality of cameras having a different corresponding field of view in the area, and

standardize the plurality of activity maps with regard to a single common point of view;

a unified spatial activity map generation circuit configured to combine the plurality of standardized activity maps into a unified activity map; and

wherein the activity map generation circuit is further configured to standardize the plurality of activity maps with regard to the single common point of view by at least one of,

modifying a direction feature with respect to tilt of at least one camera among the plurality of cameras,

transforming a spatial perspective of at least one of the plurality of activity maps from image coordinates to coordinates corresponding to the single common point of view,

normalizing an orientation of at least one of the plurality of activity maps,

normalizing probabilities with respect to at least one of the plurality of cameras, and

transforming a perspective spread of at least one of the plurality of activity maps.

10. The apparatus of claim 9 , wherein the unified activity map includes spatial and temporal activity feature values for the objects of interest.

11. The apparatus of claim 9 , further comprising:

a display configured to display the unified activity map to a user.

12. The apparatus of claim 11 , wherein the display is configured to display the unified activity map to the user along with a trajectory graph corresponding to the unified activity map.

13. The apparatus of claim 9 , further comprising:

a memory configured to store the unified activity map.

14. The apparatus of claim 9 , wherein the activity map generation circuit is further configured to,

generate a set of motion blur images for each of the plurality of cameras based on the video content, and

generate each of the plurality of activity maps based on a corresponding set of motion blur images.

15. The apparatus of claim 14 , wherein:

the video content from each of the plurality of cameras includes a sequence of image frames; and

the activity map generation circuit is configured to,

generate each motion blur image in the set of motion blur images based on a motion blur image corresponding to a current image frame in the sequence of image frames and motion blur images corresponding to previous image frames in the sequence of image frames.

16. The apparatus of claim 9 , wherein the relative activity of the objects of interest over time is one of density, dwell, direction, bi-direction and velocity of the objects of interest over time.

17. A method for monitoring movement of objects of interest in an area, the method comprising:

generating a plurality of activity maps based on video content from a plurality of cameras, each of the plurality of activity maps being indicative of relative activity of the objects of interest over time within a field of view of a camera among the plurality of cameras, and each of the plurality of cameras having a different corresponding field of view in the area;

standardizing the plurality of activity maps with regard to a single common point of view;

combining the plurality of standardized activity maps into a unified activity map;

at least one of storing and displaying the unified activity map; and

wherein the standardizing the plurality of activity maps with regard to a single common point of view includes at least one of

modifying a direction feature with respect to tilt of at least one camera among the plurality of cameras,

transforming a spatial perspective of at least one of the plurality of activity maps from image coordinates to coordinates corresponding to the single common point of view,

normalizing an orientation of at least one of the plurality of activity maps,

normalizing probabilities with respect to at least one of the plurality of cameras, and

transforming a perspective spread of at least one of the plurality of activity maps.

18. A non-transitory computer-readable medium storing computer-executable instructions that, when executed on a computer device, cause the computer device to execute the method of claim 17 .

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded Sep 3, 2014
From: CREDIT SUISSE AG
To: ALCATEL-LUCENT USA INC.
Reel/Frame 033684/0046 →
RELEASE OF SECURITY INTEREST Recorded Aug 24, 2014
From: CREDIT SUISSE AG
To: ALCATEL-LUCENT USA, INC.
Reel/Frame 033596/0898 →
SECURITY INTEREST Recorded Aug 7, 2014
From: ALCATEL LUCENT USA, INC.
To: CREDIT SUISSE AG
Reel/Frame 033500/0156 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2014
From: O'GORMAN, LAWRENCE; LIVESCU, DOREL
To: ALCATEL-LUCENT USA INC.
Reel/Frame 032627/0720 →