IP Library › Granted Patent US 10,750,151
Granted Patent B2
US 10,750,151 · App. 16/791,994 · Granted Aug 18, 2020

Method and apparatus for colour imaging a three-dimensional structure

Inventor: Noam Babayoff (Rishon le Zion, IL)
Assignee: ALIGN TECHNOLOGY, INC.
H04N13/15A61B1/00009A61B1/00096A61B1/0615A61B1/0638A61B1/0646A61B1/0676A61B1/0684A61B1/24A61B1/247A61B5/0068A61B5/0088A61B5/1077A61B5/1079A61C9/0053A61C9/0066A61C19/04G01B11/24G01B11/25G01J3/02G01J3/0205G01J3/0208G01J3/0216G01J3/0218G01J3/0224G01J3/0243G01J3/0256G01J3/10G01J3/50G01J3/501G01J3/508G01N21/255G06T7/0012G06T7/12G06T7/90H01L27/14868H04N13/207H04N13/257H04N13/271H04N13/296G01J3/462G01J3/51G06T2207/10024G06T2207/10028G06T2207/30036
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,750,151
App. No.
16/791,994
Granted
Aug 18, 2020
Kind
B2
Abstract

A device for determining the surface topology and associated color of a structure, such as a teeth segment, includes a scanner for providing depth data for points along a two-dimensional array substantially orthogonal to the depth direction, and an image acquisition means for providing color data for each of the points of the array, while the spatial disposition of the device with respect to the structure is maintained substantially unchanged. A processor combines the color data and depth data for each point in the array, thereby providing a three-dimensional color virtual model of the surface of the structure. A corresponding method for determining the surface topology and associate color of a structure is also provided.

Claims (57)

1. A method for determining surface topology and associated color of an intraoral structure, the method comprising:

illuminating the intraoral structure using white light passing through focusing optics;

capturing depth image data and color image data of the intraoral structure from the white light illuminating the intraoral structure using an image sensor of an imaging device, wherein the capturing includes scanning a focal plane of the imaging device over a range of depths and wherein returned lights beams returning from the intraoral structure pass through the focusing optics;

generating, using the imaging device and the depth image data, depth data of the intraoral structure;

generating, using the imaging device and the color image data, color data of the intraoral structure; and

providing, using one or more processors, a color three-dimensional numerical entity based on the depth data and the color data.

2. The method of claim 1 , further comprising determining, using one or more processors, a spatial transformation between the depth data and the color data, wherein determining the spatial transformation comprises performing an alignment procedure.

3. The method of claim 2 , wherein performing the alignment procedure comprises:

determining a first shape profile based on the depth data;

determining a second shape profile based on the color data; and

aligning the first shape profile to the second shape profile.

4. The method of claim 1 , wherein the image sensor is a color image sensor.

5. The method of claim 1 , wherein illuminating the intraoral structure using the white light passing through the focusing optics further comprises passing the white light through a plurality of color filters.

6. The method of claim 5 , wherein the plurality of color filters are a tri-color filter.

7. The method of claim 5 , wherein a filter wheel includes the plurality of color filters.

8. The method of claim 6 , further comprising rotating the filter wheel to sequentially present each color of the filter wheel to the white light.

9. The method of claim 5 , wherein the image sensor is a monochrome image sensor.

10. A method for determining surface topology and associated color of an intraoral structure, the method comprising:

illuminating the intraoral structure with white light;

capturing depth image data and color image data of the intraoral structure from the white light illuminating the intraoral structure using an image sensor of an imaging device, wherein the capturing includes scanning, using focusing optics, a focal plane of the imaging device over a range of depths and wherein the capturing of the depth image data and the color image data occurs at the same first angle and orientation with respect to the intraoral structure, and wherein the capturing includes capturing returning light passing though the focusing optics from the intraoral structure;

generating, using the imaging device and the depth image data, depth data at the first angle and orientation with respect to the intraoral structure;

generating, using the imaging device and the color image data, color data at the first angle and orientation with respect to the intraoral structure; and

providing, using one or more processors, a color three-dimensional numerical entity based on the depth data and the color data.

11. The method of claim 10 , wherein providing the color three-dimensional numerical entity based on the depth data and the color data comprises generating a plurality of data points of the color three-dimensional numerical entity, each of the plurality of data points comprising three-dimensional surface coordinate data and color data associated therewith.

12. The method of claim 10 , wherein the providing comprises performing an alignment procedure comprising:

determining a first shape profile based on the depth data;

determining a second shape profile based on the color data; and

aligning the first shape profile to the second shape profile.

13. The method of claim 10 , wherein the image sensor is a color image sensor.

14. The method of claim 10 , wherein illuminating the intraoral structure with the white light passing through the focusing optics further comprises passing the white light through a plurality of color filters.

15. The method of claim 14 , wherein a filter wheel includes the plurality of color filters.

16. The method of claim 15 , further comprising rotating the filter wheel to sequentially present each color of the filter wheel to the white light.

17. The method of claim 14 , wherein the image sensor is a monochrome image sensor.

18. A system for determining surface topology and associated color of an intraoral structure, the system comprising:

a handheld imaging device comprising a probe, focusing optics configured to scan a focal plane of the handheld imaging device over a range of depths, a white light illuminator, and an image sensor configured to capture depth image data over the range of depths and color image data of the intraoral structure, wherein incident light beams from the white light illuminator and returned lights beams returning from the intraoral structure pass through the focusing optics; and

one or more processors operably coupled to the handheld imaging device, the one or more processors configured to cause the system to:

generate depth data of the intraoral structure using the depth image data from the handheld imaging device,

generate color data of the intraoral structure using the color image data from the handheld imaging device, and

provide a color three-dimensional numerical entity based on the depth data and the color data.

19. The system of claim 18 , wherein the image sensor is a color image sensor.

20. The system of claim 18 , further comprising a plurality of color filters positioned between the white light source and the intraoral structure.

21. The system of claim 20 , wherein the plurality of color filters are a tri-color filter.

22. The system of claim 20 , wherein a filter wheel includes the plurality of color filters.

23. The system of claim 21 , wherein the handheld imaging device is configured to rotate the filter wheel to sequentially present each color of the filter wheel to the light.

24. The system of claim 20 , wherein the image sensor is a monochrome image sensor.

25. A system for determining surface topology and associated color of an intraoral structure, the system comprising:

a handheld imaging device comprising a probe, focusing optics configured to scan a focal plane of the handheld imaging device over a range of depths, a white light illuminator, and an image sensor configured to capture depth image data over the range of depths and color image data of the intraoral structure by being configured to capture returning light passing through the focusing optics from the intraoral structure; and

one or more processors operably coupled to the handheld imaging device, the one or more processors configured to cause the system to:

capture the depth image data and the color image data of the intraoral structure over the range of depths and wherein the capturing of the depth image data and the color image data occurs at the same first angle and orientation with respect to the intraoral structure;

generate, using the imaging device and the depth image data, depth data at the first angle and orientation with respect to the intraoral structure;

generate, using the imaging device and the color image data, color data at the first angle and orientation with respect to the intraoral structure; and

provide, using one or more processors, a color three-dimensional numerical entity based on the depth data and the color data.

26. The system of claim 25 , further comprising a plurality of color filters between the white light illuminator and the intraoral structure.

27. The system of claim 26 , wherein a filter wheel includes the plurality of color filters.

28. The system of claim 27 , wherein the handheld imaging device is configured to rotate the filter wheel to sequentially present each color of the filter wheel to the white light illuminator.

29. The system of claim 26 , wherein the image sensor is a monochrome image sensor.

30. The system of claim 25 , wherein the image sensor is a color image sensor.

Continuity (14)
Continuation 15175267 · Jun 7, 2016
Continuation 14755171 · Jun 30, 2015
Continuation 14511091 · Oct 9, 2014
Continuation 14150505 · Jan 8, 2014
Continuation 13868926 · Apr 23, 2013
Continuation 13620159 · Sep 14, 2012
Continuation 13333351 · Dec 21, 2011
Continuation 12770379 · Apr 29, 2010
Continuation 12379343 · Feb 19, 2009
Continuation 11889112 · Aug 9, 2007
Continuation 11154520 · Jun 17, 2005
Provisional Application 60580109 · Jun 17, 2004
Provisional Application 60580108 · Jun 17, 2004
Related Publication 20200186777A1 · Jun 11, 2020
Cited By (1)
US 12,236,624