IP Library Granted Patent US 9,361,539
Granted Patent B2
US 9,361,539 · App. 14/810,066 · Granted Jun 7, 2016

Object detection system

Inventor: Bing Li (Vestal, NY)
Assignee: Lockheed Martin Corporation
G06K9/4609F41H11/136G06K9/0063G06K9/00201G06K9/4638G06K9/6202G06K9/6211G06K9/66G06T5/001G06T5/20G06T7/0075H04N13/0239G06K2209/09G06T2207/10032G06T2207/20024G06T2207/30212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,361,539
App. No.
14/810,066
Granted
Jun 7, 2016
Kind
B2
Abstract

An airborne mine countermeasure system includes a processor coupled to a memory having stored therein software instructions that, when executed by the processor, cause the processor to perform a series of image processing operations. The operations include obtaining input image data from an external image sensor, and extracting a sequence of 2-D slices from the input image data. The operations also include performing a 3-D connected region analysis on the sequence of 2-D slices, and extracting 3-D invariant features in the image data. The operations further include performing coarse filtering, performing fine recognition and outputting an image processing result having an indication of the presence of any mines within the input image data.

Claims (47)

1. An object detection system comprising:

an image sensor configured to obtain input image data of a body of water;

a processor for executing modules;

a memory containing the modules, the executed modules including:

an image slice extraction module configured to extract a sequence of 2-D slices from the input image data;

a 3-D analysis module configured to perform a 3-D connected region analysis on the sequence of 2-D slices;

an invariant feature computation module configured to compute image 3-D invariant features in the image data;

an image filter module configured to perform coarse filtering based on the image 3-D invariant features, the coarse filtering including: comparing image 3-D invariant features in the image data to a data store of trained 3-D invariant features associated with known objects, providing a list of found objects in the image data based on the data store, and for each of the found objects, providing an indication of how close features of the found object match features in the data store; and

an image recognition module configured to perform fine recognition to identify a known object from the data store within the input image data.

2. The system of claim 1 , further comprising:

an object training module configured to extract training 3-D invariant features of known objects in training data, and store the training 3-D invariant features as the trained 3-D invariant features and the known objects in the data store.

3. The system of claim 1 , wherein performing the fine recognition includes applying a metric including a Hausdorff metric.

4. The system of claim 1 , wherein the image slice extractor is further configured to apply diffusion equations to generate the sequence of 2-D slices.

5. The system of claim 1 , wherein the 3-D invariant features include moment invariants.

6. The system of claim 1 , wherein the image sensor is located on an aircraft.

7. The system of claim 6 , wherein the aircraft is a helicopter, fixed wing aircraft, or unmanned aerial vehicle.

8. A computerized method for detecting objects, comprising:

obtaining, at a processor, input image data of a body of water from an image sensor;

extracting, using the processor, a sequence of 2-D slices from the input image data;

performing a 3-D connected region analysis, using the processor, on the sequence of 2-D slices;

determining, using the processor, 3-D invariant features in the image data;

performing, using the processor, coarse filtering based on the image 3-D invariant features, the coarse filtering including: comparing image 3-D invariant features in the image data to a data store of trained 3-D invariant features associated with known objects, providing a list of found objects in the image data based on the data store, and for each of the found objects, providing an indication of how close features of the found object match features in the data store; and

performing fine recognition to identify a known object from the data store within the input image data.

9. The method of claim 8 , further comprising:

training the data store, the training comprising:

extracting training 3-D invariant features of known objects in training data; and

storing the training 3-D invariant features as the trained 3-D invariant features and the known objects in the data store.

10. The method of claim 8 , wherein performing the fine recognition includes applying a metric including a Hausdorff metric.

11. The method of claim 8 , wherein the extracting includes using diffusion equations to generate the sequence of 2-D slices.

12. The method of claim 8 , wherein the 3-D invariant features include moment invariants.

13. The method of claim 8 , wherein performing the connected region analysis includes analyzing, at the processor, volumetric pixel elements.

14. A nontransitory computer readable medium having stored thereon instructions that, when executed by a processor, cause the processor to perform a series of operations to detect objects, the detecting including:

obtaining, at a processor, input image data of a body of water from an image sensor;

extracting, using the processor, a sequence of 2-D slices from the input image data;

performing a 3-D connected region analysis, using the processor, on the sequence of 2-D slices;

determining, using the processor, 3-D invariant features of at least one object in the image data;

performing, using the processor, coarse filtering based on the image 3-D invariant features, the coarse filtering including: comparing image 3-D invariant features of the at least one object to a data store of trained 3-D invariant features associated with known objects and providing an indication of how close features of the at least one object match features of at least one known object in the data store; and

performing fine recognition to determine if the at least one object in the image data corresponds to a known object.

15. The computer readable medium of claim 14 , wherein the detecting further includes:

training the data store, the training comprising:

extracting training 3-D invariant features of known objects in training data; and

storing the training 3-D invariant features as the trained 3-D invariant features and the known objects in the data store.

16. The computer readable medium of claim 14 , wherein performing the fine recognition includes applying a metric including a Hausdorff metric.

17. The computer readable medium of claim 14 , wherein the extracting includes using diffusion equations to generate the sequence of 2-D slices.

18. The computer readable medium of claim 14 , wherein the 3-D invariant features include moment invariants.

19. The computer readable medium of claim 14 , wherein performing the connected region analysis includes analyzing, at the processor, volumetric pixel elements.

20. The nontransitory computer readable medium of claim 14 , wherein the extracting includes extracting different size objects through a series of filtering operations.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2015
From: LI, BING
To: LOCKHEED MARTIN CORPORATION
Reel/Frame 036218/0209 →
Continuity (2)
Continuation 13419931 · Mar 14, 2012
Related Publication 20150332083A1 · Nov 19, 2015