IP Library Granted Patent US 10,192,137
Granted Patent B2
US 10,192,137 · App. 14/942,417 · Granted Jan 29, 2019

Automatic ruler detection

Inventors: Darrell Hougen (Littleton, CO); Peter Zhen-Ping Lo (Mission Viejo, CA)
Assignee: MorphoTrak, LLC
G06K9/52G06K9/00067G06T7/0042G06T7/0085G06T7/60G06K9/4604G06K2209/03G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,192,137
App. No.
14/942,417
Granted
Jan 29, 2019
Kind
B2
Abstract

In some implementations, a method includes: receiving, from the camera, a sample image that includes a fingerprint and a mensuration reference device, where the sample image is associated with a resolution; identifying (i) a plurality of edge candidate groups within the sample image, and (ii) a set of regularity characteristics associated with each of the plurality of edge candidate groups; determining that the associated set of regularity characteristics indicates the mensuration reference device; identifying a ruler candidate group, from each of the plurality of edge candidate groups, based at least on determining that the associated set of regularity characteristics indicates the mensuration reference device; computing a scale associated with the sample image based at least on extracting a set of ruler marks from the identified ruler candidate group; and generating, based at least on the scale associated with the sample image, a scaled image.

Claims (95)

1. A system comprising:

a camera; and

one or more computing devices comprising a processor and a memory coupled to said processor, wherein said memory comprises computer-executable instructions that, when executed by said processor, cause the one or more computing device to perform operations comprising:

receiving, from the camera, a sample image that includes a fingerprint and a mensuration reference device, wherein the sample image is associated with a resolution;

processing the sample image to generate a gradient image of the sample image, wherein:

the gradient image comprises a plurality of pixels, and

each pixel within the plurality of pixels is associated with a gradient value representing a respective change in pixel intensity of a corresponding pixel in the sample image with respect to neighboring pixels along an x-direction and neighboring pixels along a y-direction;

identifying a set of edge pixels in the gradient image, the set of edge pixels including pixels in the gradient image that each have a gradient value that satisfies a predetermined threshold;

generating an orientation map for the sample image based on identifying the set of edge pixels in the gradient image, the orientation map specifying a respective orientation for each edge pixel included in the orientation map;

identifying, within a spatial domain of the orientation map, a plurality of edge candidate groups, wherein each of the plurality of edge candidate groups (i) include two or more edge pixels that have respective orientations satisfying a threshold similarity and (ii) identify regions of the sample image that are predicted to be occupied by a mensuration reference device;

determining a set of regularity characteristics for each of the plurality of edge candidate groups;

determining that the set of regularity characteristics for a particular edge candidate group, from among the plurality of edge candidate groups, matches a set of reference regularity characteristics that indicates a mensuration reference device;

extracting a set of predicted ruler marks from the particular edge candidate group based on determining that the set of regularity characteristics for the particular edge candidate group matches the set of reference regularity characteristics that indicates a mensuration reference device;

computing a scale associated with the sample image based at least on extracting the set of predicted ruler marks from the particular edge candidate group; and

generating, based at least on the scale associated with the sample image, a scaled image; and

providing the scaled image for output.

2. The system of claim 1 , wherein the operations comprise:

identifying a quality metric that defines a minimum level of gradient quality for the gradient image;

determining a gradient quality value associated with the gradient image; and

determining that the gradient value satisfies the quality metric.

3. The system of claim 1 , wherein the operations comprise:

computing an orientation histogram based at least on the orientation map;

identifying a plurality of matching orientations within an interval centered at a peak of the orientation histogram; and

generating one or more of the plurality of edge candidate groups using the edge pixels corresponding to the identified plurality of matching orientations.

4. The system of claim 3 , wherein the operations comprise:

defining the interval based at least on the number of orientations represented within the orientation map.

5. The system of claim 1 , wherein the operations comprise:

retrieving a plurality of ruler descriptions; and

determining that the particular edge candidate group includes a valid ruler based at least on the received plurality of ruler descriptions.

6. The system of claim 1 , wherein the operations comprise:

extracting the set of ruler marks based at least on estimating a ruler orientation described in the particular edge candidate group;

performing a plurality of regularity tests on the extracted set of ruler marks; and

removing a plurality of false marks from the set of ruler marks based at least on the plurality of regularity tests.

7. A computer-implemented method for automatic ruler detection comprising:

receiving, from the camera, a sample image that includes a fingerprint and a mensuration reference device, wherein the sample image is associated with a resolution;

processing the sample image to generate a gradient image of the sample image, wherein:

the gradient image comprises a plurality of pixels, and

each pixel within the plurality of pixels is associated with a gradient value representing a respective change in pixel intensity of a corresponding pixel in the sample image with respect to neighboring pixels along an x-direction and neighboring pixels along a y-direction;

identifying a set of edge pixels in the gradient image, the set of edge pixels including pixels in the gradient image that each have a gradient value that satisfies a predetermined threshold;

generating an orientation map for the sample image based on identifying the set of edge pixels in the gradient image, the orientation map specifying a respective orientation for each edge pixel included in the orientation map;

identifying, within a spatial domain of the orientation map, a plurality of edge candidate groups, wherein each of the plurality of edge candidate groups (i) include two or more edge pixels that have respective orientations satisfying a threshold similarity and (ii) identify regions of the sample image that are predicted to be occupied by a mensuration device;

determining a set of regularity characteristics for each of the plurality of edge candidate groups;

determining that the set of regularity characteristics for a particular edge candidate group, from among the plurality of edge candidate groups, matches a set of reference regularity characteristics that indicates a mensuration reference device;

extracting a set of predicted ruler marks from the particular edge candidate group based on determining that the set of regularity characteristics for the particular edge candidate group matches the set of reference regularity characteristics that indicates a mensuration reference device;

computing a scale associated with the sample image based at least on extracting the set of predicted ruler marks from the particular edge candidate group; and

generating, based at least on the scale associated with the sample image, a scaled image; and

providing the scaled image for output.

8. The computer-implemented method of claim 7 , comprising:

identifying a quality metric that defines a minimum level of gradient quality for the gradient image;

determining a gradient quality value associated with the gradient image; and

determining that the gradient value satisfies the quality metric.

9. The computer-implemented method of claim 7 , comprising:

computing an orientation histogram based at least on the orientation map;

identifying a plurality of matching orientations within an interval centered at a peak of the orientation histogram; and

generating one or more of the plurality of edge candidate groups using the edge pixels corresponding to the identified plurality of matching orientations.

10. The computer-implemented method of claim 9 , comprising:

defining the interval based at least on the number of orientations represented within the orientation map.

11. The computer-implemented method of claim 7 , comprising:

retrieving a plurality of ruler descriptions; and

determining that the particular edge candidate group includes a valid ruler based at least on the received plurality of ruler descriptions.

12. The computer-implemented method of claim 7 , comprising:

extracting the set of ruler marks based at least on estimating a ruler orientation described in the particular edge candidate group;

performing a plurality of regularity tests on the extracted set of ruler marks; and

removing a plurality of false marks from the set of ruler marks based at least on the plurality of regularity tests.

13. A computer-readable storage medium encoded with a computer program, the program comprising instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations comprising:

receiving, from the camera, a sample image that includes a fingerprint and a mensuration reference device, wherein the sample image is associated with a resolution;

processing the sample image to generate a gradient image of the sample image, wherein:

the gradient image comprises a plurality of pixels, and

each pixel within the plurality of pixels is associated with a gradient value representing a respective change in pixel intensity of a corresponding pixel in the sample image with respect to neighboring pixels along an x-direction and neighboring pixels along a y-direction;

identifying a set of edge pixels in the gradient image, the set of edge pixels including pixels in the gradient image that each have a gradient value that satisfies a predetermined threshold;

generating an orientation map for the sample image based on identifying the set of edge pixels in the gradient image, the orientation map specifying a respective orientation for each edge pixel included in the orientation map;

identifying, within a spatial domain of the orientation map, a plurality of edge candidate groups, wherein each of the plurality of edge candidate groups (i) include two or more edge pixels that have respective orientations satisfying a threshold similarity and (ii) identify regions of the sample image that are predicted to be occupied by a mensuration device;

determining a set of regularity characteristics for each of the plurality of edge candidate groups;

determining that the set of regularity characteristics for a particular edge candidate group, from among the plurality of edge candidate groups, matches a set of reference regularity characteristics that indicates a mensuration reference device;

extracting a set of predicted ruler marks from the particular edge candidate group based on determining that the set of regularity characteristics for the particular edge candidate group matches the set of reference regularity characteristics that indicates a mensuration reference device;

computing a scale associated with the sample image based at least on extracting the set of predicted ruler marks from the particular edge candidate group; and

generating, based at least on the scale associated with the sample image, a scaled image; and

providing the scaled image for output.

14. The computer-readable storage medium of claim 13 , wherein the operations comprise:

identifying a quality metric that defines a minimum level of gradient quality for the gradient image;

determining a gradient quality value associated with the gradient image; and

determining that the gradient value satisfies the quality metric.

15. The computer-readable storage medium of claim 13 , wherein the operations comprise:

computing an orientation histogram based at least on the orientation map;

identifying a plurality of matching orientations within an interval centered at a peak of the orientation histogram; and

generating one or more of the plurality of edge candidate groups using the edge pixels corresponding to the identified plurality of matching orientations.

16. The computer-readable storage medium of claim 15 , wherein the operations comprise:

defining the interval based at least on the number of orientations represented within the orientation map.

17. The computer-readable storage medium of claim 13 , wherein the operations comprise:

retrieving a plurality of ruler descriptions; and

determining that the ruler candidate group includes a valid ruler based at least on the received plurality of ruler descriptions.

18. The computer-readable storage medium of claim 13 , wherein the operations comprise:

extracting the set of ruler marks based at least on estimating a ruler orientation described in the identified ruler candidate group;

performing a plurality of regularity tests on the extracted set of ruler marks; and

removing a plurality of false marks from the set of ruler marks based at least on the plurality of regularity tests.

Assignments (2)
MERGER Recorded Oct 12, 2023
From: MORPHOTRAK, LLC
To: IDEMIA IDENTITY & SECURITY USA LLC
Reel/Frame 065190/0104 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 17, 2015
From: HOUGEN, DARRELL; LO, PETER ZHEN-PING
To: MORPHOTRAK, LLC
Reel/Frame 037063/0749 →
Continuity (1)
Related Publication 20170140199A1 · May 18, 2017