IP Library Granted Patent US 8,295,543
Granted Patent B2
US 8,295,543 · App. 12/078,300 · Granted Oct 23, 2012

Device and method for detecting targets in images based on user-defined classifiers

Assignee: Lockheed Martin Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,295,543
App. No.
12/078,300
Granted
Oct 23, 2012
Kind
B2
Abstract

A device and method for detecting targets of interest in an image, such as people or objects of a certain type. Targets are detected based on an optimized strong classifier descriptor that can be based on a combination of weak classifier descriptors. The weak classifier descriptors can include a user-defined weak classifier descriptor that is defined by a user to represent a shape or appearance attribute that is characteristic of parts of the target of interest. The strong classifier descriptor can be optimized by selecting a subset of weak classifier descriptors that exhibit improved performance in detecting targets in training images.

Claims (27)

1. A target detection device for detecting predetermined targets that are captured within an image, the device including:

a target region identification device that is configured to identify a region of interest in the captured image, the region of interest including a target having geometries consistent with the predetermined targets; and

a classification device that is configured to determine whether the region of interest includes the predetermined targets by analyzing the region of interest with a strong classifier descriptor that describes at least one of shape attributes and appearance attributes that are characteristic of the predetermined targets,

wherein the strong classifier descriptor is based on a linear weighted combination of a subset of weak classifier descriptors, and the subset of weak classifier descriptors is selected from a plurality of weak classifier descriptors that each describe at least one of shape attributes and appearance attributes that are characteristic of parts of the predetermined targets, and wherein the subset of weak classifier descriptors includes at least one user-defined weak classifier descriptor that is defined by a user based on database images including the predetermined targets.

2. The target detection device according to claim 1 , further including an image input device that is configured to input an image.

3. The target detection device according to claim 1 , wherein the predetermined targets are at least one of people and objects.

4. The target detection device according to claim 1 , wherein the subset of weak classifier descriptors is selected from the plurality of weak classifier descriptors by iteratively selecting the subset of weak classifier descriptors that exhibits improved performance in detecting the predetermined targets.

5. The target detection device according to claim 4 , wherein, the subset of weak classifier descriptors is selected from the plurality of weak classifier descriptors by determining the subset of weak classifier descriptors that exhibits the lowest error rate in detecting the predetermined targets.

6. The target detection device according to claim 4 , wherein the subset of weak classifier descriptors is selected from the plurality of weak classifier descriptors by iteratively selecting the subset of weak classifier descriptors using an Adaboost algorithm.

7. The target detection device according to claim 1 , wherein the strong classifier descriptor is adapted to a camera site by iteratively selecting the subset of weak classifier descriptors that exhibits improved performance in detecting the predetermined targets from training images taken from the camera site.

8. A target detection device for detecting predetermined targets that are captured within an image, the device including:

a target region identification device that is configured to identify a region of interest in the captured image, the region of interest including a target having geometries consistent with the predetermined targets; and

a classification device that is configured to determine whether the region of interest includes the predetermined targets by analyzing the region of interest with a strong classifier descriptor that describes at least one of shape attributes and appearance attributes that are characteristic of the predetermined targets,

wherein the strong classifier descriptor is based on a subset of weak classifier descriptors that is selected from a plurality of weak classifier descriptors that each describe at least one of shape attributes and appearance attributes that are characteristic of parts of the predetermined targets, and wherein the subset of weak classifier descriptors includes at least one user-defined weak classifier descriptor that is defined by a user based on database images including the predetermined targets, and

wherein the strong classifier descriptor is adapted to an environmental condition by iteratively selecting the subset of weak classifier descriptors that exhibits improved performance in detecting the predetermined targets from training images taken with the environmental condition.

9. The target detection device according to claim 1 , wherein the at least one user-defined weak classifier descriptor is defined from contours of parts of the predetermined targets in the database image.

10. The target detection device according to claim 9 , wherein the classification device is configured to determine whether the region of interest includes a vertical response and a horizontal response that are within a predetermined threshold of the contours from the user-defined weak classifier descriptor.

11. The target detection device according to claim 1 , wherein the at least one user-defined weak classifier descriptor is defined based on region differences of the predetermined targets in the database image.

12. The target detection device according to claim 11 , wherein the user-defined weak classifier is defined as a difference in image intensity values between regions of the predetermined targets, and wherein the classification device is configured to determine whether the region of interest includes a first region and a second region having a difference in intensity values that are within a predetermined threshold of the user-defined weak classifier descriptor.

13. A tracking system for tracking detected targets over a multi-camera network, including the target detection device according to claim 1 , and a plurality of cameras.

14. A method of detecting predetermined targets that are captured within an image, the method including:

identifying a target region of interest in the captured image, the target region of interest including a target with geometries consistent with the predetermined targets; and

determining whether the region of interest includes the predetermined targets by analyzing the region of interest with a strong classifier descriptor that describes at least one of shape attributes and appearance attributes that are characteristic of the predetermined targets;

wherein the strong classifier descriptor is based on a linear weighted combination of a subset of weak classifier descriptors, and the subset of weak classifier descriptors is selected from a plurality of weak classifier descriptors that each describe at least one of shape attributes and appearance attributes that are characteristic of parts of the predetermined targets, and wherein the subset of weak classifier descriptors includes at least one user-defined weak classifier descriptor that is defined by a user based on database images including the predetermined targets.

15. The method according to claim 14 , wherein the subset of weak classifier descriptors is selected from the plurality of weak classifier descriptors by iteratively selecting the subset of weak classifier descriptors that exhibits improved performance in detecting the predetermined targets.

16. The method according to claim 14 , wherein, the subset of weak classifier descriptors is selected from the plurality of weak classifier descriptors by determining the subset of weak classifier descriptors that exhibits the lowest error rate in detecting the predetermined targets.

17. The method according to claim 14 , wherein the subset of weak classifier descriptors is selected from the plurality of weak classifier descriptors by iteratively selecting the subset of weak classifier descriptors using an Adaboost algorithm.

Assignments (8)
RELEASE OF SECURITY INTEREST Recorded Jan 17, 2020
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: VAREC, INC.; REVEAL IMAGING TECHNOLOGY, INC.; QTC MANAGEMENT, INC.; SYSTEMS MADE SIMPLE, INC.; SYTEX, INC.; OAO CORPORATION; LEIDOS INNOVATIONS TECHNOLOGY, INC. (F/K/A ABACUS INNOVATIONS TECHNOLOGY, INC.)
Reel/Frame 051855/0222 →
RELEASE OF SECURITY INTEREST Recorded Jan 17, 2020
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: VAREC, INC.; REVEAL IMAGING TECHNOLOGY, INC.; QTC MANAGEMENT, INC.; SYSTEMS MADE SIMPLE, INC.; SYTEX, INC.; OAO CORPORATION; LEIDOS INNOVATIONS TECHNOLOGY, INC. (F/K/A ABACUS INNOVATIONS TECHNOLOGY, INC.)
Reel/Frame 052316/0390 →
SECURITY INTEREST Recorded Aug 25, 2016
From: VAREC, INC.; REVEAL IMAGING TECHNOLOGIES, INC.; ABACUS INNOVATIONS TECHNOLOGY, INC.; OAO CORPORATION; QTC MANAGEMENT, INC.; SYSTEMS MADE SIMPLE, INC.; LOCKHEED MARTIN INDUSTRIAL DEFENDER, INC.; SYTEX, INC.
To: CITIBANK, N.A.
Reel/Frame 039809/0603 →
SECURITY INTEREST Recorded Aug 25, 2016
From: VAREC, INC.; REVEAL IMAGING TECHNOLOGIES, INC.; ABACUS INNOVATIONS TECHNOLOGY, INC.; OAO CORPORATION; QTC MANAGEMENT, INC.; SYSTEMS MADE SIMPLE, INC.; LOCKHEED MARTIN INDUSTRIAL DEFENDER, INC.; SYTEX, INC.
To: CITIBANK, N.A.
Reel/Frame 039809/0634 →
CHANGE OF NAME Recorded Aug 24, 2016
From: ABACUS INNOVATIONS TECHNOLOGY, INC.
To: LEIDOS INNOVATIONS TECHNOLOGY, INC.
Reel/Frame 039808/0977 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2016
From: LOCKHEED MARTIN CORPORATION
To: ABACUS INNOVATIONS TECHNOLOGY, INC.
Reel/Frame 039765/0714 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2008
From: GENERAL ELECTRIC COMPANY
To: LOCKHEED MARTIN CORPORATION
Reel/Frame 020766/0108 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2008
From: TU, PETER H.; KRAHSTOEVER, NILS; RITTSCHER, JENS; DORETTO, GIANFRANCO
To: GENERAL ELECTRIC COMPANY
Reel/Frame 020766/0281 →
Continuity (2)
Provisional Application 60935821 · Aug 31, 2007
Related Publication 20110051999A1 · Mar 3, 2011