IP Library Granted Patent US 9,449,233
Granted Patent B2
US 9,449,233 · App. 13/309,543 · Granted Sep 20, 2016

Distributed target tracking using self localizing smart camera networks

Inventor: Camillo Jose Taylor (Philadelphia, PA)
Assignee: The Trustees Of The University Of Pennsylvania
G06K9/00771G06T7/0081G06T7/2093G06T2207/30241H04N7/181
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,449,233
App. No.
13/309,543
Granted
Sep 20, 2016
Kind
B2
Abstract

A plurality of camera devices are configured to localize one another based on visibility of each neighboring camera in an image plane. Each camera device captures images and identifies sightings of candidate targets. The camera device share information about sightings and triangulate positions of targets. Targets are matched to known tracks based on prior images, allowing targets to be tracked in a 3D environment.

Claims (40)

1. A method of tracking one or more targets moving through an environment, comprising:

a first camera device capturing a first image of one or more targets as it moves through an image plane of the first camera device;

a second camera device receiving a second image of the one or more targets as it moves through an image plane of the second camera device;

extracting a first set of one or more target sightings in the first image and a second set of one or more target sightings in the second image, each target sighting of the first and second sets of one or more target sightings comprising:

a target bearing to a respective target;

a state vector for the respective target, the state vector comprising an indication of a position and a velocity of the respective target along a target track;

an indication of a time associated with the respective target; and

an indication of a unique identifier that identifies the respective target;

triangulating, based at least in part on target bearings of the first and second sets of one or more target sightings, to create a third set of target sightings;

matching at least a subset of the third set of target sightings to one or more target tracks maintained by the first camera device;

updating matched target tracks with at least said subset of the third set of target sightings and forming new target tracks for unmatched target tracks; and

communicating, by the first camera device to the second camera device, at least one updated track that was matched by the matching step and updated in the updating step.

2. The method of claim 1 , wherein the second image is received over a peer- to-peer wireless network.

3. The method of claim 1 , further comprising storing, based on the matching, information associated with at least one track in a database of the first camera device.

4. The method of claim 3 , further comprising the step of displaying the track information.

5. The method of claim 1 , further comprising deleting a first subset of one or more known tracks maintained by the first camera device if the first subset of known tracks fails to match any of third set of target sightings after a predetermined amount of time.

6. The method of claim 1 , wherein the matching further comprises choosing an oldest known track when more than one known track matches at least one target sighting.

7. The method of claim 1 , further comprising transmitting information about target tracks, by the first camera device, wherein an intended recipient of the transmitted information about target tracks comprises a neighboring camera device.

8. A device for tracking one or more targets through an environment comprising:

first and second camera devices;

a processor; and

memory coupled to the processor, the memory comprising executable instructions that when executed by the processor cause the processor to effectuate operations comprising:

capturing a first image of one or more targets as it moves through an image plane of the first camera device;

extracting a first set of one or more target sightings in the first image;

receiving a second image of the one or more targets as it moves through an image plane of the second camera device; and

extracting a second set of the one or more target sightings in the second image, wherein each target sighting of the first and second of target sightings comprises a target bearing to a respective target, a state vector for the respective target, the state vector comprising an indication of a position and a velocity of the respective target along a target track, an indication of a time associated with the respective target, and an indication of a unique identifier that identifies the respective target;

triangulating, based at least in part on target bearings of the first and second target sightings, to create a third set of target sightings;

matching at least a subset of the third set of target sightings to one or more target tracks maintained by the first camera device;

updating matched target tracks with at least said subset of the third set of target sightings and forming new target tracks for unmatched target tracks; and

communicating from the first camera device to the second camera device at least one updated track that was matched by the matching and updated by the updating.

9. The device of claim 8 , the operations further comprising:

exchanging information with the second camera device over a peer-to-peer wireless network.

10. The device of claim 8 , further comprising memory configured to store at least one updated track in a database of the first camera device based on the matching step.

11. The device of claim 8 , the operations further comprising:

deleting a first subset of one or more known tracks if the first subset of known tracks fails to match any of the third set of target sightings after a predetermined amount of time.

12. The device of claim 8 , the operations further comprising:

choosing an oldest known track when more than one known track matches at least one target sighting.

13. The device of claim 8 , the operations further comprising:

transmitting information about target tracks from the first camera device to a neighboring camera device.

14. The device of claim 13 , further comprising a display that displays the track information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2013
From: TAYLOR, CAMILLO JOSE
To: THE TRUSTEES OF THE UNIVERSITY OF PENNSYLVANIA
Reel/Frame 029888/0023 →
Continuity (4)
Provisional Application 61418789 · Dec 1, 2010
Provisional Application 61418799 · Dec 1, 2010
Provisional Application 61418805 · Dec 1, 2010
Related Publication 20120249802A1 · Oct 4, 2012