IP Library Granted Patent US 9,734,381
Granted Patent B2
US 9,734,381 · App. 14/573,599 · Granted Aug 15, 2017

System and method for extracting two-dimensional fingerprints from high resolution three-dimensional surface data obtained from contactless, stand-off sensors

Inventors: Jack G. Riddle (Columbia, MD); Timothy M. Brucks (Westminster, MD); Michael M. Becker (Mount Airy, MD)
Assignee: NORTHROP GRUMMAN SYSTEMS CORPORATION
G06K9/00033G06K9/0008G06K9/00375G06K9/036G06K9/00201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,734,381
App. No.
14/573,599
Granted
Aug 15, 2017
Kind
B2
Abstract

Disclosed herein are systems and methods for extracting two-dimensional fingerprints from high resolution three-dimensional surface data obtained from contactless, stand-off sensors. The system may include a three-dimensional sensor that generates three-dimensional surface data of a hand and one or more fingers of a subject and a processor, coupled to the three-dimensional sensor, and a memory associated with the processor, in which the processor executes instructions stored in the memory collect three-dimensional surface data of the subject hand and one or more subject fingers generated by the three-dimensional sensor, estimate a hand pose of the subject based on the collected three-dimensional surface data, unroll one or more two-dimensional fingerprints from the extracted fingerprint information, determine a fingerprint quality score for each of the one or more two-dimensional fingerprints and for each of the one or more two-dimensional fingerprints that have a sufficiently high determined fingerprint quality score, store the two-dimensional fingerprint.

Claims (84)

1. A system for extracting two-dimensional fingerprints from high resolution three-dimensional surface data obtained from contactless, stand-off sensors, comprising:

a three-dimensional sensor that generates three-dimensional surface data of a hand and one or more fingers of a subject;

a processor, coupled to the three-dimensional sensor, and a memory associated with the processor, wherein the processor executes instructions stored in the memory to extract two-dimensional fingerprints from high resolution three-dimensional surface data by:

collecting three-dimensional surface data of the subject hand and one or more subject fingers generated by the three-dimensional sensor;

estimating a hand pose of the subject based on the collected three-dimensional surface data;

based on the estimated hand pose, extracting fingerprint information from the collected three-dimensional surface data;

unrolling one or more two-dimensional fingerprints from the extracted fingerprint information;

determining a fingerprint quality score for each of the one or more two-dimensional fingerprints; and

for each of the one or more two-dimensional fingerprints that have at least a particular determined fingerprint quality score, storing the two-dimensional fingerprint.

2. The system of claim 1 wherein the three-dimensional sensor is a contactless, stand-off sensor in which the three-dimensional sensor generates the three-dimensional surface data without contacting the subject fingers.

3. The system of claim 1 wherein the three-dimensional sensor is a Photon-X sensor.

4. The system of claim 1 wherein the three-dimensional sensor generates three-dimensional surface data that includes a dense set of surface points, wherein each point samples a three-dimensional position as well as other attributes of the one or more subject fingers including surface normal information and color.

5. The system of claim 4 wherein the collecting three-dimensional surface data includes generating a triangulated, three-dimensional surface mesh from the dense surface point set.

6. The system of claim 5 wherein the triangulated, three-dimensional surface mesh includes a plurality of point vertices and triangular facets that provides a description of the surface geometry with a particular resolution to distinguish depth differences between ridges and valleys on a fingertip.

7. The system of claim 5 wherein the estimating a hand pose of the subject includes:

extracting a three-dimensional contour of the subject hand from the triangulated, three-dimensional surface mesh; and

performing a set of initial hand pose tests.

8. The system of claim 7 wherein the performing a set of initial hand pose tests includes:

locating the hand thumb in the three-dimensional contour;

verifying that the hand palm is facing towards the three-dimensional sensor;

confirming that the three-dimensional contour does not intersect an edge of an edge of a field-of-view of the three-dimensional sensor except at the hand wrist; and

determining that the three-dimensional contour is flat in the depth dimension.

9. The system of claim 5 wherein the unrolling one or more two-dimensional fingerprints includes:

re-sampling vertices from the triangulated, three-dimensional surface mesh;

mapping the re-sampled vertices to a uniform two-dimensional grid;

computing axes for a regional surface for each region of the two-dimensional grid;

rotating each region of the two-dimensional grid to the computed axis for the region;

determining a local height for each pixel of the two-dimensional grid;

setting a pixel intensity for each pixel of the two-dimensional grid based on the determined local height; and

outputting the two-dimensional grid as the unrolled two-dimensional fingerprint.

10. The system of claim 1 further comprising enhancing the two-dimensional fingerprint.

11. The system of claim 1 further comprising an ultrasound sensor that detects when a subject hand is above the three-dimensional sensor, thereby causing the three-dimensional sensor to generate the three-dimensional surface data of a hand and one or more fingers of a subject.

12. The system of claim 1 wherein the system is portable and further comprises a carrying case that encloses the three-dimensional sensor, the processor and the memory.

13. A method for extracting two-dimensional fingerprints from high resolution three-dimensional surface data obtained from contactless, stand-off sensors, comprising:

generating three-dimensional surface data of a hand and one or more fingers of a subject using a three-dimensional sensor;

collecting three-dimensional surface data of the subject hand and one or more subject fingers generated by the three-dimensional sensor;

estimating a hand pose of the subject based on the collected three-dimensional surface data;

based on the estimated hand pose, extracting fingerprint information from the collected three-dimensional surface data;

unrolling one or more two-dimensional fingerprints from the extracted fingerprint information;

determining a fingerprint quality score for each of the one or more two-dimensional fingerprints; and

for each of the one or more two-dimensional fingerprints that have at least a particular determined fingerprint quality score, storing the two-dimensional fingerprint.

14. The method of claim 13 wherein the generating three-dimensional surface data of the subject hand generates three-dimensional surface data that includes a dense set of surface points, wherein each point samples a three-dimensional position as well as other attributes of the one or more subject fingers including surface normal information and color.

15. The method of claim 14 wherein the collecting three-dimensional surface data includes generating a triangulated, three-dimensional surface mesh from the dense surface point set.

16. The method of claim 15 wherein the estimating a hand pose of the subject includes:

extracting a three-dimensional contour of the subject hand from the triangulated, three-dimensional surface mesh; and

performing a set of initial hand pose tests.

17. The method of claim 16 wherein the performing a set of initial hand pose tests includes:

locating the hand thumb in the three-dimensional contour;

verifying that the hand palm is facing towards the three-dimensional sensor;

confirming that the three-dimensional contour does not intersect an edge of an edge of a field-of-view of the three-dimensional sensor except at the hand wrist; and

determining that the three-dimensional contour is flat in the depth dimension.

18. The method of claim 15 wherein the unrolling one or more two-dimensional fingerprints includes:

re-sampling vertices from the triangulated, three-dimensional surface mesh;

mapping the re-sampled vertices to a uniform two-dimensional grid;

computing axes for a regional surface for each region of the two-dimensional grid;

rotating each region of the two-dimensional grid to the computed axis for the region;

determining a local height for each pixel of the two-dimensional grid;

setting a pixel intensity for each pixel of the two-dimensional grid based on the determined local height; and

outputting the two-dimensional grid as the unrolled two-dimensional fingerprint.

19. The method of claim 13 further comprising enhancing the two-dimensional fingerprint.

20. The method of claim 13 further comprising detecting when a subject hand is above the three-dimensional sensor, thereby causing the generating of the three-dimensional surface data of a hand and one or more fingers of a subject.

21. The system of claim 1 wherein the three-dimensional surface data of the subject hand includes an anterior side of the subject hand.

22. The method of claim 13 wherein the three-dimensional surface data of the subject hand includes an anterior side of the subject hand.

23. A system for extracting two-dimensional fingerprints from high resolution three-dimensional surface data obtained from contactless, stand-off sensors, comprising:

a three-dimensional sensor that generates three-dimensional surface data of a hand and one or more fingers of a subject;

a processor, coupled to the three-dimensional sensor, and a memory associated with the processor, wherein the processor executes instructions stored in the memory to extract two-dimensional fingerprints from high resolution three-dimensional surface data by:

collecting three-dimensional surface data of the subject hand and one or more subject fingers generated by the three-dimensional sensor;

estimating a hand pose of the subject based on the collected three-dimensional surface data;

extracting a three-dimensional contour of the subject hand based on the three-dimensional surface data;

confirming that the three-dimensional contour does not intersect an edge of a field-of-view of the three-dimensional sensor except at a hand wrist;

based on the estimated hand pose, extracting fingerprint information from the collected three-dimensional surface data;

unrolling one or more two-dimensional fingerprints from the extracted fingerprint information;

determining a fingerprint quality score for each of the one or more two-dimensional fingerprints; and

for each of the one or more two-dimensional fingerprints that have at least a particular determined fingerprint quality score, storing the two-dimensional fingerprint.

24. A method for extracting two-dimensional fingerprints from high resolution three-dimensional surface data obtained from contactless, stand-off sensors, comprising:

generating three-dimensional surface data of a hand and one or more fingers of a subject using a three-dimensional sensor;

collecting three-dimensional surface data of the subject hand and one or more subject fingers generated by the three-dimensional sensor;

estimating a hand pose of the subject based on the collected three-dimensional surface data;

extracting a three-dimensional contour of the subject hand based on the three-dimensional surface data;

confirming that the three-dimensional contour does not intersect an edge of a field-of-view of the three-dimensional sensor except at a hand wrist;

based on the estimated hand pose, extracting fingerprint information from the collected three-dimensional surface data;

unrolling one or more two-dimensional fingerprints from the extracted fingerprint information;

determining a fingerprint quality score for each of the one or more two-dimensional fingerprints; and

for each of the one or more two-dimensional fingerprints that have at least a particular determined fingerprint quality score, storing the two-dimensional fingerprint.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2024
From: NORTHROP GRUMMAN CORPORATION
To: PERATON INC.
Reel/Frame 067296/0241 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2014
From: RIDDLE, JACK G.; BRUCKS, TIMOTHY M.; BECKER, MICHAEL M.
To: NORTHROP GRUMMAN SYSTEMS CORPORATION
Reel/Frame 034560/0498 →
Continuity (1)
Related Publication 20160180142A1 · Jun 23, 2016