IP Library Granted Patent US 10,758,322
Granted Patent B2
US 10,758,322 · App. 15/926,854 · Granted Sep 1, 2020

Virtually representing an orthodontic treatment outcome using automated detection of facial and dental reference objects

Inventors: Pavel Pokotilov (Moscow, RU); Dmitry Yurievich Chekh (Moscow, RU); Dmitriy Konstantinovich Ten (Novosibirsk, RU); Samuel Blanco (Saratoga, CA); David Patrick Lopes (El Dorado Hills, CA); Jason Ramos (Heredia, CR); Rene M. Sterental (Palo Alto, CA); Evgenii Vladimirovich Karnygin (Moscow, RU)
Assignee: ALIGN TECHNOLOGY, INC.
A61C7/002A61C7/08A61C9/0053G06T17/20B33Y50/00B33Y80/00G06T2207/30036G16H50/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,758,322
App. No.
15/926,854
Granted
Sep 1, 2020
Kind
B2
Abstract

A computer-implemented method for virtually representing an orthodontic treatment outcome using automated detection of facial and dental reference objects is disclosed herein. The computer-implemented method may involve modeling initial positions of an orthodontic patient's teeth in a three-dimensional (3D) virtual model and determining the effect of application of various force systems applied through an orthodontic treatment plan on the patient's teeth. Images of the patient's face may be used to identify facial reference objects. Dental reference objects of the patient's dentition may be identified from the 3D virtual model. A relationship between the facial reference objects and the dental reference objects may form the basis of modifications to the orthodontic treatment plan and/or modeling final orthodontic positions of the orthodontic treatment plan.

Claims (98)

1. A computer-implemented method of virtually representing an orthodontic treatment outcome using automated detection of facial and dental reference objects, the computer-implemented method comprising:

identifying, using a first three-dimensional (3D) representation of a patient's teeth, an initial position of the patient's teeth;

determining, using a virtual representation of one or more force systems applied to the patient's teeth, an estimated interim final orthodontic position of the patient's teeth;

gathering one or more images of the patient's face;

identifying one or more facial reference objects on at least one of the one or more images of the patient's face, the one or more facial reference objects corresponding to a physical or anatomical feature providing a first reference position to the patient's face and includes a facial midline;

identifying one or more dental reference objects on the first 3D representation of the patient's teeth, the one or more dental reference objects corresponding to the physical or anatomical feature providing a second reference position to the patient's dentition and includes a dental midline;

identifying a relationship between the one or more facial reference objects and the one or more dental reference objects;

modifying the estimated interim final orthodontic position of the patient's teeth in the first 3D representation based on the relationship between the one or more facial reference objects and the one or more dental reference objects, the modifying including changing the position of the patient's teeth in the estimated interim final orthodontic position such that a distance between the facial midline and the dental midlines meets or does not exceed a threshold value; and

providing instructions to integrate a modified estimated interim final orthodontic position based on the relationship between the one or more facial reference objects and the one or more dental reference objects.

2. The computer-implemented method of claim 1 , further comprising providing instructions to design or manufacture an orthodontic appliance using the modified estimated interim final orthodontic position.

3. A computer-implemented method comprising:

identifying, using a first three-dimensional (3D) representation of a patient's teeth, an initial position of the patient's teeth;

determining, using a virtual representation of one or more force systems applied to the patient's teeth, an estimated interim final orthodontic position of the patient's teeth;

gathering one or more images of the patient's face;

identifying one or more facial reference objects on at least one of the one or more images of the patient's face, the one or more facial reference objects corresponding to a physical or anatomical feature providing a first reference position to the patient's face;

identifying one or more dental reference objects on the first 3D representation of the patient's teeth, the one or more dental reference objects corresponding to the physical or anatomical feature providing a second reference position to the patient's dentition;

identifying a relationship between the one or more facial reference objects and the one or more dental reference objects;

modifying the estimated interim final orthodontic position of the patient's teeth in the first 3D representation based on the relationship between the one or more facial reference objects and the one or more dental reference objects; and

providing instructions to integrate a modified estimated interim final orthodontic position based on the relationship between the one or more facial reference objects and the one or more dental reference objects,

wherein the one or more facial reference objects include a location of the inferior boarder of the upper lip at a facial midline and the one or more dental reference objects include an incisal edge position.

4. The computer-implemented method of claim 3 , wherein modifying the estimated interim final orthodontic position of the patient's teeth includes changing the position of the patient's teeth in the estimated interim final orthodontic position such that a distance between the location of the inferior boarder of the upper lip at the facial midline and the incisal edge position meets or does not exceed a threshold value.

5. A computer-implemented method comprising:

identifying, using a first three-dimensional (3D) representation of a patient's teeth, an initial position of the patient's teeth;

determining, using a virtual representation of one or more force systems applied to the patient's teeth, an estimated interim final orthodontic position of the patient's teeth;

gathering one or more images of the patient's face;

identifying one or more facial reference objects on at least one of the one or more images of the patient's face, the one or more facial reference objects corresponding to a physical or anatomical feature providing a first reference position to the patient's face;

identifying one or more dental reference objects on the first 3D representation of the patient's teeth, the one or more dental reference objects corresponding to the physical or anatomical feature providing a second reference position to the patient's dentition;

identifying a relationship between the one or more facial reference objects and the one or more dental reference objects;

modifying the estimated interim final orthodontic position of the patient's teeth in the first 3D representation based on the relationship between the one or more facial reference objects and the one or more dental reference objects; and

providing instructions to integrate a modified estimated interim final orthodontic position based on the relationship between the one or more facial reference objects and the one or more dental reference objects,

wherein the one or more facial reference objects include a location of the superior boarder of the lower lip at a facial midline and the one or more dental reference objects include an incisal edge position.

6. The computer-implemented method of claim 5 , wherein modifying the estimated interim final orthodontic position of the patient's teeth includes changing the position of the patient's teeth in the estimated interim final orthodontic position such that a distance between the location of the superior boarder of the lower lip at the facial midline and the incisal edge position meets or does not exceed a threshold value.

7. A computer-implemented method comprising:

identifying, using a first three-dimensional (3D) representation of a patient's teeth, an initial position of the patient's teeth;

determining, using a virtual representation of one or more force systems applied to the patient's teeth, an estimated interim final orthodontic position of the patient's teeth;

gathering one or more images of the patient's face;

identifying one or more facial reference objects on at least one of the one or more images of the patient's face, the one or more facial reference objects corresponding to a physical or anatomical feature providing a first reference position to the patient's face;

identifying one or more dental reference objects on the first 3D representation of the patient's teeth, the one or more dental reference objects corresponding to the physical or anatomical feature providing a second reference position to the patient's dentition;

identifying a relationship between the one or more facial reference objects and the one or more dental reference objects;

modifying the estimated interim final orthodontic position of the patient's teeth in the first 3D representation based on the relationship between the one or more facial reference objects and the one or more dental reference objects; and

providing instructions to integrate a modified estimated interim final orthodontic position based on the relationship between the one or more facial reference objects and the one or more dental reference objects,

wherein the one or more facial reference objects include a location of the inferior boarder of the upper lip at a facial midline and the one or more dental reference objects include a gingival zenith of a central incisor.

8. The computer-implemented method of claim 7 , wherein modifying the estimated interim final orthodontic position of the patient's teeth includes changing the position of the patient's teeth in the estimated interim final orthodontic position such that a distance between the location of the inferior boarder of the upper lip at the facial midline and the gingival zenith of the central incisor meets or does not exceed a threshold value.

9. A computer-implemented method comprising:

identifying, using a first three-dimensional (3D) representation of a patient's teeth, an initial position of the patient's teeth;

determining, using a virtual representation of one or more force systems applied to the patient's teeth, an estimated interim final orthodontic position of the patient's teeth;

gathering one or more images of the patient's face;

identifying one or more facial reference objects on at least one of the one or more images of the patient's face, the one or more facial reference objects corresponding to a physical or anatomical feature providing a first reference position to the patient's face;

identifying one or more dental reference objects on the first 3D representation of the patient's teeth, the one or more dental reference objects corresponding to the physical or anatomical feature providing a second reference position to the patient's dentition;

identifying a relationship between the one or more facial reference objects and the one or more dental reference objects;

modifying the estimated interim final orthodontic position of the patient's teeth in the first 3D representation based on the relationship between the one or more facial reference objects and the one or more dental reference objects; and

providing instructions to integrate a modified estimated interim final orthodontic position based on the relationship between the one or more facial reference objects and the one or more dental reference objects,

wherein widths of central incisors, lateral incisors, and canines in the estimated interim final orthodontic position are modified based on facial type.

10. The computer-implemented method of claim 9 , wherein the modification includes application of restorative objects.

11. The computer-implemented method of claim 9 , wherein facial type is determined based on a distance between the patient's glabella and chin and a distance between the patient's right and left cheekbone prominences.

12. A computer-implemented method comprising:

identifying, using a first three-dimensional (3D) representation of a patient's teeth, an initial position of the patient's teeth;

determining, using a virtual representation of one or more force systems applied to the patient's teeth, an estimated interim final orthodontic position of the patient's teeth;

gathering one or more images of the patient's face;

identifying one or more facial reference objects on at least one of the one or more images of the patient's face, the one or more facial reference objects corresponding to a physical or anatomical feature providing a first reference position to the patient's face;

identifying one or more dental reference objects on the first 3D representation of the patient's teeth, the one or more dental reference objects corresponding to the physical or anatomical feature providing a second reference position to the patient's dentition;

identifying a relationship between the one or more facial reference objects and the one or more dental reference objects;

modifying the estimated interim final orthodontic position of the patient's teeth in the first 3D representation based on the relationship between the one or more facial reference objects and the one or more dental reference objects; and

providing instructions to integrate a modified estimated interim final orthodontic position based on the relationship between the one or more facial reference objects and the one or more dental reference objects,

wherein widths of central incisors, lateral incisors, and canines in the estimated interim final orthodontic position are modified based on an inter-canine width and facial type.

13. A system comprising:

memory storing computer-program instructions; and

one or more physical processors coupled to the memory, the one or more physical processors configured to implement a computer-implemented method using the computer-program instructions, the computer-implemented method of virtually representing an orthodontic treatment outcome using automated detection of facial and dental reference objects, the computer-implemented method comprising:

identifying, using a first three-dimensional (3D) representation of a patient's teeth, an initial position of the patient's teeth;

determining, using a virtual representation of one or more force systems applied to the patient's teeth, an estimated interim final orthodontic position of the patient's teeth;

gathering one or more images of the patient's face;

identifying one or more facial reference objects on at least one of the one or more images of the patient's face, the one or more facial reference objects corresponding to a physical or anatomical feature providing a first reference position to the patient's face, the one or more facial reference objects including one or more of a location of the inferior boarder of the upper lip at a facial midline, a location of the superior boarder of the lower lip at the facial midline, or a location of the inferior boarder of the upper lip at the facial midline;

identifying one or more dental reference objects on the first 3D representation of the patient's teeth, the one or more dental reference objects corresponding to the physical or anatomical feature providing a second reference position to the patient's dentition, wherein the one or more dental reference objects include an incisal edge position or a gingival zenith of a central incisor;

identifying a relationship between the one or more facial reference objects and the one or more dental reference objects;

modifying the estimated interim final orthodontic position of the patient's teeth in the first 3D representation based on the relationship between the one or more facial reference objects and the one or more dental reference objects; and

providing instructions to integrate a modified estimated interim final orthodontic position based on the relationship between the one or more facial reference objects and the one or more dental reference objects.

14. A system comprising:

memory storing computer-program instructions; and

one or more physical processors coupled to the memory, the one or more physical processors configured to implement a computer-implemented method using the computer-program instructions, the computer-implemented method of virtually representing an orthodontic treatment outcome using automated detection of facial and dental reference objects, the computer-implemented method comprising:

identifying, using a first three-dimensional (3D) representation of a patient's teeth, an initial position of the patient's teeth;

determining, using a virtual representation of one or more force systems applied to the patient's teeth, an estimated interim final orthodontic position of the patient's teeth;

gathering one or more images of the patient's face;

identifying one or more facial reference objects on at least one of the one or more images of the patient's face, the one or more facial reference objects corresponding to a physical or anatomical feature providing a first reference position to the patient's face;

identifying one or more dental reference objects on the first 3D representation of the patient's teeth, the one or more dental reference objects corresponding to the physical or anatomical feature providing a second reference position to the patient's dentition;

identifying a relationship between the one or more facial reference objects and the one or more dental reference objects;

modifying the estimated interim final orthodontic position of the patient's teeth in the first 3D representation based on the relationship between the one or more facial reference objects and the one or more dental reference objects, wherein widths of central incisors, lateral incisors, and canines in the estimated interim final orthodontic position are modified based on facial type; and

providing instructions to integrate a modified estimated interim final orthodontic position based on the relationship between the one or more facial reference objects and the one or more dental reference objects.

15. A system comprising:

memory storing computer-program instructions; and

one or more physical processors coupled to the memory, the one or more physical processors configured to implement a computer-implemented method using the computer-program instructions, the computer-implemented method of virtually representing an orthodontic treatment outcome using automated detection of facial and dental reference objects, the computer-implemented method comprising:

identifying, using a first three-dimensional (3D) representation of a patient's teeth, an initial position of the patient's teeth;

determining, using a virtual representation of one or more force systems applied to the patient's teeth, an estimated interim final orthodontic position of the patient's teeth;

gathering one or more images of the patient's face;

identifying one or more facial reference objects on at least one of the one or more images of the patient's face, the one of more facial reference objects corresponding to a physical or anatomical feature providing a first reference position to the patient's face;

identifying one or more dental reference objects on the first 3D representation of the patient's teeth, the one or more dental reference objects corresponding to the physical or anatomical feature providing a second reference position to the patient's dentition;

identifying a relationship between the one or more facial reference objects and the one or more dental reference objects;

modifying the estimated interim final orthodontic position of the patient's teeth in the first 3D representation based on the relationship between the one or more facial reference objects and the one or more dental reference objects, wherein widths of central incisors, lateral incisors, and canines in the estimated interim final orthodontic position are modified based on an inter-canine width and facial type; and

providing instructions to integrate a modified estimated interim final orthodontic position based on the relationship between the one or more facial reference objects and the one or more dental reference objects.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2018
From: POKOTILOV, PAVEL; CHEKH, DMITRY YURIEVICH; TEN, DMITRIY KONSTANTINOVICH; BLANCO, SAMUEL; LOPES, DAVID PATRICK; RAMOS, JASON; STERENTAL, RENE M.; KARNYGIN, EVGENII VLADIMIROVICH
To: ALIGN TECHNOLOGY, INC.
Reel/Frame 046466/0769 →
Continuity (2)
Provisional Application 62474026 · Mar 20, 2017
Related Publication 20180263732A1 · Sep 20, 2018
Cited By (31)
US 1,063,077 US 1,121,824 US 12,193,905 US 12,213,855 US 12,213,856 US 12,213,858 US 12,220,288 US 12,232,924 US 12,268,569 US 12,370,016 US 12,376,944 US 12,412,648 US 12,483,777 US 12,491,048 US 12,508,102 US 12,511,446 US 12,527,648 US 12,579,656 US 12,588,972 US 12,594,143 US 12,608,854 US 12,635,867 US 12,636,124 US 12,636,125 US 12,651,671 US 12,657,707 US 12,706,202 US 12,708,489 US 12,708,490 US 12,711,702 US 12,714,540