IP Library › Granted Patent US 12,236,601
Granted Patent B2
US 12,236,601 · App. 18/531,925 · Granted Feb 25, 2025

Method, device and system for correlating at least one additional 2D-image to a 3D-representation of at least a part of tooth

Inventors: Anders Robert Jellinggaard (Copenhagen K, DK); Christoph Vannahme (Holte, DK); Mike Van Der Poel (Rødovre, DK); Karl-Josef Hollenbeck (Copenhagen Ø, DK); Anders Gaarde (Søborg, DK); Mads Brøkner Christiansen (Farum, DK)
Assignee: 3SHAPE A/S
G06T7/0014A61B5/0088A61B34/74G06F3/048A61B2560/0487G06T2207/10048G06T2207/20024G06T2207/30036
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,236,601
App. No.
18/531,925
Granted
Feb 25, 2025
Kind
B2
Abstract

The present disclosure provides a computer-implemented method for correlating at least one infrared 2D-image to a 3D-representation of at least a part of a tooth displayed in a graphical user-interface, of a hand-held scanning device, on a screen, including the steps of: obtaining a first set of 2D-images of the at least part of the tooth; forming a 3D-representation of the at least a part of the tooth from the first set of 2D-images; displaying, in the graphical user-interface, the 3D-representation; obtaining a second set of 2D-images, wherein the second set of 2D images are infrared 2D-images acquired within the at least part of the tooth; displaying, in the user-interface, at least one of the 2D-images from the second set of 2D-images; displaying, in the user-interface, a manipulator configured to change between 2D-images in the second set of 2D-images.

Claims (21)

1. A computer-implemented method for correlating at least one infrared 2D-image to a 3D-representation of at least a part of a tooth displayed in a graphical user-interface, of a hand-held scanning device, on a screen, comprising the steps of:

obtaining a first set of 2D-images of the at least part of the tooth;

forming a 3D-representation of the at least a part of the tooth from the first set of 2D-images;

displaying, in the graphical user-interface, the 3D-representation;

obtaining a second set of 2D-images based with light on illuminating the tooth with light in the infrared (IR) domain;

displaying, in the user-interface, a manipulator configured to change between 2D-images in the second set of 2D-images;

based on input as associated to the manipulator, changing between the 2D-images in the second set of 2D-images until a desired 2D-image is displayed; and

correlating the desired 2D-image to the 3D-representation.

2. The method according to claim 1 , wherein the step of correlating the desired 2D-image to the 3D-representation is based on comparing information in the first set of images with information in the second set of images.

3. The method according to claim 2 , wherein the information is related to the acquisition-time of the images.

4. The method according to claim 1 , wherein the step of correlating the desired 2D-image to the 3D-representation is represented in the user-interface such that only the desired 2D-image is shown in relation to the 3D-representation of the at least a part of the tooth.

5. The method according to claim 1 , wherein the step of correlating the desired 2D-image to the 3D representation is represented in the user-interface as a combined 2D/3D-representation.

6. The method according to claim 5 , wherein the combined 2D/3D-representation comprises two separate datasets linked together by the correlation such that the combined 2D/3D-representation further comprises two separate representations.

7. The method according to claim 5 , wherein the combined 2D/3D representation comprises a single dataset obtained by correlating two separate datasets.

8. The method according to claim 1 , wherein the step of forming the 3D-representation is such that each tooth or the at least part of the tooth in the 3D-representation uniquely identifies a second set of images belonging to the respective tooth or the at least part of the tooth.

9. The method according to claim 1 , wherein the second set of 2D-images is a focus-stack of 2D-images recorded along a perpendicular axis with respect to a single 2D-physical-surface.

10. The method according to claim 1 , wherein the second set of 2D-images is a focus-stack of 2D-images recorded along a single 2D-physical surface.

11. The method according to claim 1 , wherein the manipulator displayed in the graphical user-interface is a scrollbar and/or a location-indicator to show images from selected positions and/or orientations.

12. The method according to claim 1 , wherein the manipulator displayed in the graphical user-interface is based on clicking on the 2D-image and wherein the desired image is obtained by moving a cursor, by touch input on the screen, or by using the hand-held scanning device.

13. The method according to claim 1 , wherein the step of obtaining a second set of 2D-images is based on filtering the second set of 2D images.

14. The method according to claim 1 , wherein the second set of 2D-images are obtained by, in the user-interface, selecting that the handheld scanning device is operating with one or more wavelengths in the range between 700 nm to 2500 nm.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2023
From: JELLINGGAARD, ANDERS ROBERT; VANNAHME, CHRISTOPH; VAN DER POEL, MIKE; HOLLENBECK, KARL-JOSEF; GAARDE, ANDERS; CHRISTIANSEN, MADS BRØKNER
To: 3SHAPE A/S
Reel/Frame 065795/0594 →
Priority Claims (1)
EP 18179027 · Jun 21, 2018 · regional
Continuity (2)
Continuation 17253710
Related Publication 20240185421A1 · Jun 6, 2024
References Cited (35)
US 8306608B2 · Mandelis · 2012 [cited by examiner]
US 9506808B2 · Jeon · 2016 [cited by examiner]
US 10168407B2 · Benner et al. · 2019 [cited by applicant]
US 20030169913A1 · Kopelman et al. · 2003 [cited by applicant]
US 20040029068A1 · Sachdeva et al. · 2004 [cited by applicant]
US 20100121658A1 · Kaminski et al. · 2010 [cited by applicant]
US 20100281370A1 · Rohaly et al. · 2010 [cited by applicant]
US 20100283781A1 · Kriveshko et al. · 2010 [cited by applicant]
US 20130218531A1 · Deichmann et al. · 2013 [cited by applicant]
US 20130257718A1 · Öjelund et al. · 2013 [cited by applicant]
US 20140313299A1 · Gebhardt · 2014 [cited by applicant]
US 20160225151A1 · Cocco et al. · 2016 [cited by applicant]
US 20160295191A1 · Babayoff · 2016 [cited by applicant]
US 20170007360A1 · Kopelman et al. · 2017 [cited by applicant]
US 20170049330A1 · Kopelman et al. · 2017 [cited by applicant]
US 20180028063A1 · Elbaz et al. · 2018 [cited by applicant]
US 20180101947A9 · Choi · 2018 [cited by applicant]
US 20210264600A1 · Jellinggaard et al. · 2021 [cited by applicant]
CN 103079494A · 2013 [cited by applicant]
CN 106537225A · 2017 [cited by applicant]
CN 107661159A · 2018 [cited by applicant]
JP 2017221329A · 2017 [cited by applicant]
KR 1020160038798A · 2016 [cited by applicant]
WO 2012000511A1 · 2012 [cited by applicant]
WO 2017093563A1 · 2017 [cited by applicant]
WO 2017153416A1 · 2017 [cited by applicant]
WO 2018002960A1 · 2018 [cited by applicant]
WO 2018073824A1 · 2018 [cited by applicant]
International Search Report (PCT/ISA/210) issued on Sep. 10, 2019, by the European Patent Office as the International Searching Authority for International Application No. PCT/EP2019/065747. [cited by applicant]
Office Action (Decision of Rejection) issued on Nov. 1, 2022, by the Chinese Patent Office in corresponding Chinese Patent Application No. 201980054848.3, 11 pages including 7 pages of English Translation. [cited by applicant]
Written Opinion (PCT/ISA/237) issued on Sep. 10, 2019, by the European Patent Office as the International Searching Authority for International Application No. PCT/EP2019/065747. [cited by applicant]
First Office Action issued on Aug. 31, 2021, in the corresponding Chinese Patent Application No. 201980054848.3, 16 pages including 8 pages of English Translation. [cited by applicant]
Second Office Action issued on Jun. 2, 2022, in the corresponding Chinese Patent Application No. 201980054848.3, 16 pages including 9 pages of English Translation. [cited by applicant]
Search Report issued in European Patent Application No. 24200731, dated Dec. 6, 2024. [cited by applicant]
Notice of Allowance issued in Korean Patent Application No. 10-2021-7001816, dated Dec. 26, 2024, with English Translation (4 pages). [cited by applicant]