IP Library › Granted Patent US 12,521,214
Granted Patent B2
US 12,521,214 · App. 18/359,989 · Granted Jan 13, 2026

Focus scanning apparatus recording color

Inventors: Bo Esbech (Gentofte, DK); Christian Romer Rosberg (Bronshoj, DK); Mike Van Der Poel (Rødovre, DK); Rasmus Kjær (Copenhagen K, DK); Michael Vinther (Copenhagen S, DK); Karl-Josef Hollenbeck (Copenhagen Ø, DK)
Assignee: 3SHAPE A/S
A61C9/0073A61C9/006A61C9/0066G01B11/24G01B11/2509G01B11/2513G01B11/2518G01J3/0208G01J3/0224G01J3/0237G01J3/0278G01J3/508G01J3/51G01J3/513
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,521,214
App. No.
18/359,989
Granted
Jan 13, 2026
Kind
B2
Abstract

Disclosed are a scanner system and a method for recording surface geometry and surface color of an object where both surface geometry information and surface color information for a block of the image sensor pixels at least partly from one 2D image recorded by the color image sensor. A particular application is within dentistry, particularly for intraoral scanning.

Claims (32)

1 . A scanner system for recording surface geometry and surface color of an object, wherein the scanner system comprises:

an intraoral scanner having an elongated tip, wherein the scanner comprises:

a multichromatic light source configured for providing a probe light for illumination of the object,

a mirror for redirecting the probe light onto the object,

a color image sensor comprising an array of image sensor pixels for capturing one or more 2D images of light received from said object,

a data processing system configured for:

deriving surface geometry information from the set of captured 2D images and for deriving surface color information from at least one of the 2D images from which the surface geometry information is derived, wherein the derived surface geometry information and surface color information are combined to generate a sub-scan of the object, and

generating a digital 3D representation expressing both surface color and surface geometry of the object by combining several sub-scans generated for a number of different views of the object.

2 . The scanner system according to claim 1 , wherein the multichromatic light source is a multi-die LED comprising a blue LED die and a green LED die.

3 . The scanner system according to claim 1 , wherein the scanner system comprises a pattern generating element configured for incorporating a spatial pattern in said probe light.

4 . The scanner system according to claim 3 , wherein the pattern generating element is a pattern mask.

5 . The scanner system according to claim 2 , wherein the spatial pattern consists of dark sections and sections with light having a wavelength distribution according to a wavelength distribution of the multichromatic light source.

6 . The scanner system according to claim 2 , wherein the spatial pattern is static.

7 . The scanner system according to claim 1 , wherein the image sensor comprises a color filter array.

8 . The scanner system according to claim 7 , wherein the color filter array is arranged according to a Bayer color filter pattern.

9 . The scanner system according to claim 7 , wherein the color filter array comprises at least three types of color filters each allowing light in a known wavelength range, W1, W2, and W3, respectively, to propagate through the color filter to the image sensor pixels, thereby providing at least three color components.

10 . The scanner system according to claim 9 , wherein the surface geometry information is derived from light in a selected wavelength range of a spectrum of probe light provided by the multichromatic light source.

11 . The scanner system according to claim 10 , where the color filter array is such that the fraction of the color filters in the array that match the selected wavelength range of the spectrum is larger than 50%.

12 . The scanner system according to claim 1 , wherein surface color information for a given surface point is at least partially derived from the same images from which surface geometry information is derived.

13 . The scanner system according to claim 1 , wherein the set of 2D images from which surface color information is derived from is identical to the set of 2D images from which surface geometry information is derived from.

14 . The scanner system according to claim 1 , wherein deriving the surface geometry information and the surface color information comprises calculating for several 2D images a correlation measure between a portion of the 2D image(s) captured by the image sensor pixels and a weight function.

15 . The scanner system according to claim 1 , wherein the step of combining the sub-scans of the object comprises computing the color in each surface point of the digital 3D representation as a weighted average of corresponding points in overlapping sub-scans at that surface point.

16 . The scanner system according to claim 1 , wherein the data processing system is configured for detecting saturated pixels in the captured 2D images.

17 . The scanner system according to claim 16 , wherein the data processing system is further configured for mitigating or removing error(s) in the derived surface color information or the sub-scan color caused by the pixel saturation by assigning a low weight to the surface color information of the saturated pixel in the computing of the averaged sub-scan color and/or by assigning a low weight to the sub-scan color computed based on the saturated pixel.

18 . The scanner system according to claim 1 , wherein the scanner system is triangulation-based.

19 . A method of recording surface geometry and surface color of an object, the method comprising:

illuminating a surface of the object with probe light from a multichromatic light source using a scanner system;

capturing sets of 2D images of said object, wherein each set of 2D images comprises a plurality of 2D images;

deriving surface geometry information from the sets of captured 2D images and deriving surface color information from at least one of the 2D images from which the surface geometry information is derived;

generating sub-scans of the object based on the surface geometry information, wherein each sub-scan comprises data expressing the surface geometry and surface color of the object; and

combining a number of sub-scans to generate a digital 3D representation, wherein the sub-scans are obtained from different relative positions, wherein the digital 3D representation expresses both the recorded surface geometry and surface color of the object, wherein the surface color and surface geometry are obtained concurrently.

20 . The method according to claim 19 , wherein the surface color of the object is determined by computing a weighted average of sub-scan color values derived for corresponding points in overlapping subscans at that point of the object surface.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2023
From: ESBECH, BO; ROSBERG, CHRISTIAN ROMER; VAN DER POEL, MIKE; KJÆR, RASMUS; VINTHER, MICHAEL; HOLLENBECK, KARL-JOSEF
To: 3SHAPE A/S
Reel/Frame 064399/0329 →
Priority Claims (1)
DK PA 2013-70077 · Feb 13, 2013 · national
Continuity (7)
Continuation 18183358 · Mar 14, 2023
Continuation 16921414 · Jul 6, 2020
Continuation 16217636 · Dec 12, 2018
Continuation 15888416 · Feb 5, 2018
Continuation 14764087
Provisional Application 61764178 · Feb 13, 2013
Related Publication 20230363866A1 · Nov 16, 2023
References Cited (133)
US 4575805A · Moermann et al. · 1986 [cited by applicant]
US 6097854A · Szeliski et al. · 2000 [cited by applicant]
US 6750873B1 · Bernardini et al. · 2004 [cited by applicant]
US 6903738B2 · Pfister et al. · 2005 [cited by applicant]
US 7106348B2 · Matsumoto et al. · 2006 [cited by applicant]
US 7274393B2 · Acharya · 2007 [cited by applicant]
US 7698068B2 · Babayoff · 2010 [cited by applicant]
US 8102538B2 · Babayoff · 2012 [cited by applicant]
US 8488113B2 · Thiel et al. · 2013 [cited by applicant]
US 8570530B2 · Liang · 2013 [cited by applicant]
US 9212898B2 · Banyay et al. · 2015 [cited by applicant]
US 9456754B2 · Kocherscheidt et al. · 2016 [cited by applicant]
US 9962244B2 · Esbech et al. · 2018 [cited by applicant]
US 10349042B1 · Fisker et al. · 2019 [cited by applicant]
US 10383711B2 · Esbech et al. · 2019 [cited by applicant]
US 20020122192A1 · Ott · 2002 [cited by applicant]
US 20050285027A1 · Favalora et al. · 2005 [cited by applicant]
US 20070035641A1 · Yamada et al. · 2007 [cited by applicant]
US 20100067789A1 · Cai et al. · 2010 [cited by applicant]
US 20100102366A1 · Lee et al. · 2010 [cited by applicant]
US 20100145898A1 · Malfliet et al. · 2010 [cited by applicant]
US 20100207938A1 · Yau et al. · 2010 [cited by applicant]
US 20110080576A1 · Thiel et al. · 2011 [cited by applicant]
US 20110085063A1 · Min et al. · 2011 [cited by applicant]
US 20110134225A1 · Saint-Pierre et al. · 2011 [cited by applicant]
US 20110221880A1 · Liang et al. · 2011 [cited by applicant]
US 20120062716A1 · Dillon et al. · 2012 [cited by applicant]
US 20120075425A1 · Thiel · 2012 [cited by applicant]
US 20120092461A1 · Fisker et al. · 2012 [cited by applicant]
US 20120140243A1 · Colonna De Lega · 2012 [cited by applicant]
US 20120229621A1 · Turner et al. · 2012 [cited by applicant]
US 20130070128A1 · Suzuki et al. · 2013 [cited by applicant]
US 20130101176A1 · Park et al. · 2013 [cited by applicant]
US 20130236850A1 · Wu et al. · 2013 [cited by applicant]
US 20140022356A1 · Fisker et al. · 2014 [cited by applicant]
US 20140146142A1 · Duret et al. · 2014 [cited by applicant]
US 20150015701A1 · Yu · 2015 [cited by applicant]
US 20150029367A1 · Tanaka · 2015 [cited by applicant]
US 20180221117A1 · Esbech et al. · 2018 [cited by applicant]
US 20180270474A1 · Liu · 2018 [cited by applicant]
US 20190125501A1 · Esbech et al. · 2019 [cited by applicant]
US 20200330197A1 · Esbech et al. · 2020 [cited by applicant]
US 20230285125A1 · Esbech · 2023 [cited by examiner]
CN 1363827A · 2002 [cited by applicant]
CN 101667303A · 2010 [cited by applicant]
CN 102008282A · 2011 [cited by applicant]
CN 102112845A · 2011 [cited by applicant]
CN 102402799A · 2012 [cited by applicant]
CN 102802520A · 2012 [cited by applicant]
EP 2241248A2 · 2010 [cited by applicant]
JP 2004029373A · 2004 [cited by applicant]
JP 2007117152A · 2007 [cited by applicant]
JP 2009109263A · 2009 [cited by applicant]
JP 2012530267A · 2012 [cited by applicant]
WO 2005010825A2 · 2005 [cited by applicant]
WO 2010145669A1 · 2010 [cited by applicant]
WO 2012007003A1 · 2012 [cited by applicant]
WO 2012083967A1 · 2012 [cited by applicant]
WO 2013008097A1 · 2013 [cited by applicant]
WO 2013105922A2 · 2013 [cited by applicant]
WO 2015015289A2 · 2015 [cited by applicant]
Office Action issued on Mar. 14, 2024, by the U.S. Patent and Trademark Office in U.S. Appl. No. 18/183,358. (28 pages). [cited by applicant]
Imburgia et al., “Accuracy of four intraoral scanners in oral implantology: a comparative in vitro study,” BMC Oral Health, vol. 17, No. 1, 2017, p. 17-92. [cited by applicant]
International Search Report (PCT/ISA/210) dated Jul. 7, 2014, by the European Patent Office as the International Searching Authority for International Application No. PCT/EP2014/052842. [cited by applicant]
Ireland et al., “3D surface imaging in dentistry—what we are looking at,” British Dental Journal, vol. 205, No. 7, Oct. 11, 2008, pp. 387-392. [cited by applicant]
Karatas et al., “Three-dimensional imaging techniques: A literature review,” European Journal of Dentistry, vol. 8, Issue 1, 2014, pp. 132-140. [cited by applicant]
Logozzo et al., “Recent advances in dental optics—Part I: 3D intraoral scanners for restorative dentistry,” Optics and Lasers in Engineering, vol. 54, 2014, pp. 203-221. [cited by applicant]
Montes et al., “An Overview of BRDF Models,” University of Granada. (26 pages). [cited by applicant]
Notice of Reasons for Rejection dated Jan. 7, 2020, by the Japanese Patent Office in corresponding Japanese Patent Application No. 2019-001921 and an English translation of the Office Action. (8 pages). [cited by applicant]
Notice of Reasons for Rejection issued on Jan. 7, 2020, by the Japanese Patent Office in corresponding Japanese Patent Application No. 2019-001921 and an English translation of the Office Action. (8 pages). [cited by applicant]
Office Action (Communication pursuant to Article 94(3) EPC) dated Jul. 13, 2018, by the European Patent Office in corresponding European Application No. 14 704 165.1-1022. (10 pages). [cited by applicant]
Office Action (Communication pursuant to Article 94(3) EPC) issued on Apr. 30, 2021, by the European Patent Office n corresponding European Application No. 14 704 165.1-1010, (15 pages). [cited by applicant]
Office Action (Communication pursuant to Article 94(3) EPC) issued on Jul. 13, 2018, by the European Patent Office in corresponding European Application No. 14 704 165.1-1022. (10 pages). [cited by applicant]
Office Action (Communication) issued on Nov. 3, 2022, by the European Patent Office in corresponding European Patent Application No. 22182342.0. (9 pages). [cited by applicant]
Office Action (First Office Action) dated Apr. 30, 2019, by the State Intellectual Property Office (SIPO) of the People's Republic of China in corresponding Chinese Patent Application No. 201710806147.3 and an English T… [cited by applicant]
Office Action (Notice of Reasons for Rejection) dated Jan. 9, 2018, by the Japanese Patent Office in Japanese Patent Application No. 2015-557430, and an English Translation of the Office Action. (8 pages). [cited by applicant]
Office Action (Notice of Reasons for Rejection) issued on Jan. 9, 2018, by the Japanese Patent Office in Japanese Patent Application No. 2015-557430, and an English Translation of the Office Action. (8 pages). [cited by applicant]
Office Action (Notice of Reasons for Rejection) issued on Oct. 27, 2020, by the Japanese Patent Office in corresponding Japanese Patent Application No. 2019-001921, and an English Translation of the Office Action. (5 pa… [cited by applicant]
Park et al., “Changes in views on digital intraoral scanners among dental hygienists after training in digital impression taking,” BMC Oral Health, vol. 15, No. 1, 2015, p. 151 (“Park Article”). [cited by applicant]
Petition for Inter Partes Review of U.S. Pat. No. 10,383,711, Case No. IPR2021-01309, U.S. Pat. No. 10,383,711, 71 pages. [cited by applicant]
Petition for Inter Partes Review of U.S. Pat. No. 10,383,711, Case No. IPR2021-01310, U.S. Pat. No. 10,383,711, 74 pages. [cited by applicant]
PR Institution Decision—IPR2021-01309 U.S. Pat. No. 10,383,711 B2, Entered: Feb. 9, 2022, 43 pages. [cited by applicant]
PR Institution Decision—IPR2021-01310 U.S. Pat. No. 10,383,711 B2, Entered: Feb. 9, 2022, 39 pages. [cited by applicant]
Remondino et al., “Image-Based 3D Modelling: A Review,” The Photogrammetric Record, vol. 21, No. 115, Sep. 2006, pp. 269-291. [cited by applicant]
Report and Recommendation Re Claim Construction, Civil Action No. 1-18-cv-00697 (DDE), posted in Civil Action No. 1-18-00886 (DDE), [cited by applicant]
Salvi et al., “Pattern codification strategies in structured light systems,” Pattern Recognition, (2004), vol. 37, pp. 827-849. [cited by applicant]
Sato, Yoichi, “Object Shape and Reflectance Modeling from Color Image Sequence,” The Robotics Institute: Carnegie Mellon University, (Jan. 1997). (158 pages). [cited by applicant]
The First Chinese Search dated Jul. 25, 2016, by the State Intellectual Property Office of People's Republic of China in corresponding Chinese Patent Application No. 201480020976.3. (2 pages). [cited by applicant]
The First Chinese Search issued on Jul. 25, 2016, by the State Intellectual Property Office of People's Republic of China in corresponding Chinese Patent Application No. 201480020976.3. (2 pages). [cited by applicant]
The First Office Action dated Aug. 2, 2016, by the State Intellectual Property Office of People's Republic of China in corresponding Chinese Patent Application No. 201480020976.3, and an English Translation of the Offic… [cited by applicant]
The First Office Action issued on Aug. 2, 2016, by the State Intellectual Property Office of People's Republic of China in corresponding Chinese Patent Application No. 201480020976.3, and an English Translation of the O… [cited by applicant]
Ting-Shu et al., “Intraoral Digital Impression Technique: A Review,” J. Prosthodontics, vol. 24, No. 4, pp. 313-321. [cited by applicant]
U.S. Appl. No. 61/764,178 to Esbech et al., filed Feb. 13, 2013 (“The Provisional Application”). [cited by applicant]
Vivid 910: Non-Contact 3-D Digitizer, www.minolta.com. (3 pages). [cited by applicant]
Yamany et al., “Free-Form Surface Registration Using Surface Signatures,” The Proceedings of the Seventh IEEE International Conference on Computer Vision, Sep. 20-27, 1999, 7 pages. [cited by applicant]
Zimmerman et al., “Intraoral scanning systems—A current overview,” Int. J. Comput. Dent., vol. 18, No. 2, 2015, pp. 101-129. [cited by applicant]
Agini, Andreas, et al. Digital Dental Revolution: The Learning Curve. Quintessence Publishing, First edition, 2015. [cited by applicant]
[cited by applicant]
[cited by applicant]
[cited by applicant]
[cited by applicant]
[cited by applicant]
[cited by applicant]
[cited by applicant]
[cited by applicant]
Align Technology, Inc. Petitioner, Corrected Petition for Post-Grant Review of U.S. Pat. No. 9,962,244, Case No. PGR2018-00103 U.S. Pat. No. 9,962,244, 3SHAPE A/S Patent Owner, filed Oct. 30, 2018, 119 pages. [cited by applicant]
Align Technology, Inc. Petitioner, Declaration of Dr. Chandrajit L. Bajaj, Ph.D. In Support of Inter Partes Review of U.S. Pat. No. 9,962,244, Case Nos. IPR2019-00117 U.S. Pat. No. 9,962,244, 3SHAPE A/S Patent Owner, fi… [cited by applicant]
Align Technology, Inc. Petitioner, Declaration of Dr. Chandrajit L. Bajaj, Ph.D. In Support of Inter Partes Review of U.S. Pat. No. 9,962,244, Case Nos. IPR2019-00118 U.S. Pat. No. 9,962,244, 3SHAPE A/S. Patent Owner, f… [cited by applicant]
Align Technology, Inc. Petitioner, Declaration of Dr. Chandrajit L. Bajaj, Ph.D. In Support of Post-Grant Review of U.S. Pat. No. 9,962,244, Case Nos. PGR2018-00104 U.S. Pat. No. 9,962,244, 3SHAPE A/S. Patent Owner, fil… [cited by applicant]
Align Technology, Inc. Petitioner, Declaration of Dr. Chandrajit L. Bajaj, Ph.D. in Support of Post-Grant Review of U.S. Pat. No. 9,962,244, Case Nos. PGR2018-00103 U.S. Pat. No. 9,962,244, 3SHAPE A/S Patent Owner, file… [cited by applicant]
Align Technology, Inc. Petitioner, Second Corrected Declaration of Dr. Chandrajit L. Bajaj, Ph.D. in Support of Post-Grant Review of U.S. Pat. No. 9,962,244, Case No. PGR2018-00103 U.S. Pat. No. 9,962,244, 3SHAPE A/S Pa… [cited by applicant]
Align Technology, Inc. Petitioner, Second Corrected Petition for Post-Grant Review of U.S. Pat. No. 9,962,244, Case No. PGR2018-00103 U.S. Pat. No. 9,962,244, 3SHAPE A/S Patent Owner, filed Oct. 30, 2018, 119 pages. [cited by applicant]
Bayer filter Wikipedia, Jul. 4, 2018, XP-055490506, 4 pages. [cited by applicant]
Broadbent, B.H., “A New X-Ray Technique and Its Application to Orthodontia,” The Angle Orthodontist, vol. 1, No. 2, 1931, pp. 45-66. [cited by applicant]
Callieri et al., “Reconstructing textured meshes from multiple range+rgb maps,” Vision, Modeling, and Visualization, (Nov. 2002). (8 pages). [cited by applicant]
Chandrajit L. Bajaj, CV_Case_ History, Align Ex. 1004 U.S. Pat. No. 9,962,244, filed Oct. 30, 2018, 39 pages. [cited by applicant]
Corrected Declaration of Dr. Chandrajit L. Bajaj, Ph.D. In Support of Post-Grant Review of U.S. Pat. No. 9,962,244, Align Technology, Inc. Petitioner, Case Nos. PGR2018-00103 U.S. Pat. No. 9,962,244, 3SHAPE A/S Patent O… [cited by applicant]
Exhibit—1004—U.S. Pat. No. 10,383,711, File History, 575 pages. [cited by applicant]
Exhibit—1005—U.S. Pat. No. 9,962,244, File History, 1099 pages. [cited by applicant]
Exhibit—1017—Align Technology Inc.'S Opening Claim Construction Brief, 31 Pages. [cited by applicant]
Exhibit—1018—3SHAPE Trios A/Sand 3SHAPE A/S's Responsive Claim Construction Brief, 122 Pages. [cited by applicant]
Exhibit—1020—Jahne—Handbook of Computer Vision and Applications, vol. 1, Sensors and Imaging, 121 pages. [cited by applicant]
Exhibit—1021—Align Technology Inc.'S Reply Claim Construction Brief, 20 pages. [cited by applicant]
Exhibit—1022—Transcript of Alexander V. Sergienko, Ph.D., Case No. IPR2020-01087, U.S. Pat. No. 10,349,042, Conducted on Jul. 16, 2021, 210 pages. [cited by applicant]
Exhibit—1023—Order Resetting Markman Hearing, Align Technology, Inc., 1 page. [cited by applicant]
Exhibit—1024—Defendants and Counterclaim—Plaintiffs 3SHAPE Trios A/Sand 3SHAPE A/S's Initial Infringement Contentions and Priority Date Contentions, 7 pages. [cited by applicant]
Exhibit 1002—Declaration of Rongguang Liang, Ph.D., U.S. Pat. No. 10,383,711, Align Technology, Inc., Petitioner, 149 pages. [cited by applicant]
Exhibit 1002 in PGR2018-00103—Prosecution File History for the '244 patent (“'244 patent file history”), filed Oct. 30, 2018, 1039 pages. [cited by applicant]
Exhibit 1003—Rongguang Liang, Align, 13 pages. [cited by applicant]
Exhibit 1004 in PGR2018-00103—Curriculum vitae of Dr. Chandra Bajaj, Ph.D., filed Oct. 30, 2018, 316 pages. [cited by applicant]
Guehring, “Dense 3D surface acquisition by structured light using off-the-shelf components,” Proceedings of SPIE—The International Society for Optical Engineering, (Dec. 22, 2000), vol. 4309. (13 pages). [cited by applicant]
Hajeer et al., Current Products and Practices Applications of 3D imaging in orthodontics: Part II, Journal of Orthodontics, vol. 31, (2004), pp. 154-162. [cited by applicant]
Horn et al., “Calculating the Reflectance Map,” Applied Optics, (Jun. 1979), vol. 18, No. 11, pp. 1770-1779. [cited by applicant]