IP Library Granted Patent US 10,083,522
Granted Patent B2
US 10,083,522 · App. 14/745,325 · Granted Sep 25, 2018

Image based measurement system

Inventors: Dejan Jovanovic (Austin, TX); Keith Beardmore (Santa Fe, NM); Kari Myllykoski (Austin, TX); Mark O Freeman (Snohomish, WA)
Assignee: SMART PICTURE TECHNOLOGIES, INC.
G06T7/60G06K9/42G06T5/006G06T7/13G06T7/74G06T7/90G06T2207/20021G06T2207/20081G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,083,522
App. No.
14/745,325
Granted
Sep 25, 2018
Kind
B2
Abstract

A Quantified Image Measurement System that creates accurate physical measurement data from digital pictures is disclosed. The system can use any image format and enhances the image file with measurement data and data transformation information that enables the creation of any type of geometrical or dimensional measurement from the stored photograph. This file containing the original digital image along with the supplemental data is referred to as a Quantified Image File or QIF. The QIF can be shared with other systems via email, cloud syncing or other types of sharing technology. Once shared, existing systems such as CAD applications or web/cloud servers can use the QIF and the associated QIF processing software routines to extract physical measurement data and use the data for subsequent processing or building geometrically accurate models of the objects or scene in the image. Additionally smart phones and other portable devices can use the QIF to make measurements on the spot or share between portable devices. In addition, the quantified image measurement system of this invention eliminates the need for capturing the image from any particular viewpoint by using multiple reference points and software algorithms to correct for any off-angle distortions.

Claims (34)

1. A system and apparatus for making accurate dimensional or geometrical measurements of features in a two-dimensional (2D) scene from a digital image of the 2D scene taken from a non-orthogonal perspective comprising:

a. a digital scanner configured to capture the digital image of the 2D scene from the non-orthogonal perspective;

b. a reference object comprising at least four co-planar reference fiducials located proximate to a surface of the 2D scene, wherein the surface of the 2D scene comprises the features to be measured, wherein the at least four co-planar reference fiducials further comprise a circle with an outer circumference, a center point, an area, and a plurality of lines that intersect the center point of the circle and divide the circle into pie piece wedges, at least one of the pie piece wedges comprising a gradient having a density which increases in an inward direction from the outer circumference of the circle toward the center point of the circle;

c. a unique identifier (UID) located proximate to the surface of the 2D scene, wherein the UID is configured to provide the system and apparatus with information regarding a size or a type of the reference object;

d. a data processing system configured to:

i. receive the information regarding the size or the type of the reference object from the UID;

ii. store information regarding a geometry of the reference object;

iii. determine locations of the at least four co-planar reference fiducials within the digital image using the information regarding the geometry of the reference object by:

1. recognizing and locating the reference object as a whole within the digital image of the 2D scene with a pattern recognition procedure;

2. finding the circle of each of the at least four reference fiducials using Hough Circle detection;

3. avoiding false recognition of a plurality of corners by locating a corner within the circle of each of the at least four reference fiducials using corner detection; and

4. refining location of the center of the fiducial with sub-pixel precision using the gradient;

iv. determine non-orthogonal distortions of the reference object;

v. determine corrections for the non-orthogonal distortions of the reference object, wherein the corrections comprise correction data; and

vi. apply the correction data to compute the accurate dimensional or geometrical measurements of the features in the 2D scene, wherein the dimensional or geometrical measurements of the features in the 2D scene comprise measurement data; and

e. a user interface configured to display the accurate dimensional or geometrical measurements of the features in the 2D scene.

2. The system and apparatus of claim 1 , wherein the dimensional or geometrical measurements of the features are automatically selected by the system and apparatus.

3. The system and apparatus of claim 1 , wherein the user interface is further configured to allow the user to manually select features within the 2D scene to be measured.

4. The system and apparatus of claim 3 , wherein the data processing system is further configured to create a digital image file comprising the digital image of the 2D scene and the correction data of the digital image.

5. The system and apparatus of claim 4 , wherein the digital image file further comprises automatically generated measurement data or measurement data of parameters which were manually identified by the user.

6. The system and apparatus of claim 1 , wherein the reference object comprises a printed pattern.

7. The system and apparatus of claim 6 , wherein the printed pattern is on a sticker which can be affixed to the surface of the 2D scene to be measured.

8. The system and apparatus of claim 6 , wherein the printed pattern comprises color.

9. The system and apparatus of claim 1 , wherein the reference object comprises a pattern of electromagnetic emitting elements.

10. The system and apparatus of claim 9 , wherein the electromagnetic emitting elements are configured to emit wavelengths that enable expedited determination of the locations of the at least four reference fiducials by the data processing system.

11. The system and apparatus of claim 1 , wherein the digital scanner is comprises a camera.

12. The system and apparatus of claim 1 , wherein the data processing system is further configured to create a digital image file comprising the digital image of the 2D scene and the correction data of the digital image.

13. The system and apparatus of claim 1 , wherein the data processing system is local.

14. The system and apparatus of claim 1 , wherein the data processing system is remote and data is transmitted via Cloud processing.

15. The system and apparatus of claim 1 , wherein the UID comprises a barcode.

16. The system and apparatus of claim 1 , wherein the UID is further configured to:

a. provide the user with information about the digital scanner, wherein the information relates to pantone colors, a weight, a manufacturer, or a model number;

b. provide the user with information about where the image measurement system can be downloaded to an electronic device;

c. provide the user with marketing information comprising special promotions related to the features in the 2D scene; or d. serve as one of the at least four reference fiducials of the reference object; or any combination thereof.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2017
From: JOVANOVIC, DEJAN; BEARDMORE, KEITH; MYLLYKOSKI, KARI; FREEMAN, MARK O.; GROTELUESCHEN, JAMES H.
To: SMART PICTURE TECHNOLOGIES INC.
Reel/Frame 043095/0172 →
Continuity (1)
Related Publication 20160371855A1 · Dec 22, 2016
Cited By (11)
US 12,190,581 US 12,260,156 US 12,333,655 US 12,347,033 US 12,444,139 US 12,462,435 US 12,462,483 US 12,495,390 US 12,548,218 US 12,633,119 US 12,666,163