IP Library Granted Patent US 7,978,892
Granted Patent B2
US 7,978,892 · App. 11/923,297 · Granted Jul 12, 2011

3D photogrammetry using projected patterns

Assignee: D4D Technologies, LLC
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,978,892
App. No.
11/923,297
Granted
Jul 12, 2011
Kind
B2
Abstract

A structured light pattern digitizing method is combined with photogrammetry to determine a 3D model of an object. The structured light digitizing operation generates a 3D model of the object being scanned, and this model is then used to compute a higher accuracy model using photogrammetry.

Claims (42)

1. A method for obtaining a 3D model of an object, comprising:

projecting a pattern onto the object from at least first and second positions;

observing the pattern from the first and second positions by capturing an image P of the pattern incident on the object;

capturing an illumination image I of the object from each of the first and second positions, wherein the image I is captured using an imaging system comprising a projection portion and one or more imaging portions;

forming a 3D model of the object for each of the first and second positions by analyzing observed distortions to the pattern P caused by a 3D surface of the object;

using the 3D model in conjunction with each illumination image Ito find a pixel in the illumination image I of the object from the first position that corresponds to a pixel in the illumination image I of the object from the second position, wherein the corresponding pixels are a matched pixel; and

using photogrammetry to determine 3D coordinates for each matched pixel.

2. The method as described in claim 1 wherein the object is a dental item.

3. The method as described in claim 1 wherein the illumination image I is a full illumination image.

4. A non-transitory computer-readable medium having computer-executable instructions for performing the method steps of claim 1 .

5. Apparatus comprising:

an imaging system comprising a projection portion and one or more imaging portions, a processor in communication with the imaging system, and

a computer-readable medium, the computer-readable medium having processor-executable instructions for performing the method steps of claim 1 .

6. A method for obtaining a 3D model of an object, comprising:

projecting a pattern onto the object from at least two positions;

observing the pattern from those positions by capturing at least two images P 1 and P 2 from slightly different offset locations of the pattern incident on the object;

capturing illumination images I 1 and I 2 of the object for each of the at least two positions, wherein the images I 1 and I 2 are captured using an imaging system comprising a projection portion and one or more imaging portions;

forming a 3D model of the object for each position by analyzing observed distortions to the pattern P caused by the 3D surface of the object;

using the 3D model in conjunction with each image I 1 and I 2 to find corresponding pixels between image I 1 and I 2 ; and

using photogrammetry to determine 3D coordinates for each matched pixel.

7. The method as described in claim 6 wherein the object is a dental item.

8. The method as described in claim 5 wherein the illumination image is a full illumination image.

9. A method for obtaining a 3D model of an object, comprising:

projecting a dense laser pattern onto the object;

observing the dense laser pattern and any associated speckle from the position by capturing at least two images P 1 and P 2 from different offset locations of the laser pattern incident on the object, wherein the at least two images P 1 and P 7 are captured using an imaging system comprising a projection portion and one or more imaging portions;

matching equivalent pairs of speckle features between the two images; and

using photogrammetry to determine 3D coordinates for each matched pixel.

10. A non-transitory computer-readable medium having computer-executable instructions for performing the method steps of claim 9 .

11. Apparatus comprising:

an imaging system comprising a projection portion and one or more imaging portions,

a processor in communication with the imaging system, and

a computer-readable medium, the computer-readable medium having processor-executable instructions for performing the method steps of claim 9 .

12. An imaging system, comprising:

an intra-oral digitizer, comprising:

a light source having collimating optics configured to generate a collimated beam of light;

a scanner optically coupled to the light source and configured to scan the collimated beam along at least two axes;

a first optics relay coupled to the scanner and configured to relay the scanned collimated beam of light towards a dental object to be imaged, wherein over a given scanning period the scanned collimated beam of light generates a pattern comprising a set of segments;

a first image sensor;

a second image sensor;

a second optics relay, co-linear to the first optics relay, configured to relay a reflection of the scanned collimated beam toward the first image sensor, wherein over the given scanning period the reflection of the scanned collimated beam on the first image sensor comprises a first modified pattern; and

a third optics relay, co-linear to the first optics relay, configured to relay a reflection of the scanned collimated beam toward the second image sensor, wherein over the given scanning period the reflection of the scanned collimated beam on the first image sensor comprises a second modified pattern; and

a computer coupled to the intra-oral digitizer that (a) uses at least the first and second modified patterns to generate a 3D model of a surface of the dental object, (b) uses the 3D model in conjunction with at least first and second images of the dental object to find matching pixels between the first and second images, and (c) uses photogrammetry to determine 3D coordinates for each matched pixel.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Feb 13, 2026
From: HENRY SCHEIN, INC.
To: D4D TECHNOLOGIES, LLC
Reel/Frame 073778/0388 →
PATENT SECURITY AGREEMENT Recorded Oct 15, 2013
From: D4D TECHNOLOGIES, LLC
To: HENRY SCHEIN, INC.
Reel/Frame 031410/0221 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 24, 2007
From: QUADLING, MARK S.; QUADLING, HENLEY S.; LI, YE; TCHOUPRAKOV, ANDREI
To: D4D TECHNOLOGIES, LLC
Reel/Frame 020008/0116 →
Continuity (3)
Provisional Application 60854336 · Oct 25, 2006
Provisional Application 60888878 · Feb 8, 2007
Related Publication 20080101688A1 · May 1, 2008