IP Library Granted Patent US 11,051,914
Granted Patent B2
US 11,051,914 · App. 16/851,035 · Granted Jul 6, 2021

Augmented reality enhancements for dental practitioners

Inventors: Avi Kopelman (Palo Alto, CA); Adi Levin (Nes Tziona, IL); Eric Paul Meyer (Calabasas, CA); Elad Zeiri (Petach Tikva, IL); Amir Ashkenazi (Kiriat Ono, IL); Ron Ganot (Yad Rambam, IL); Sergei Ozerov (Moscow, RU); Inna Karapetyan (Modiin, IL)
Assignee: Align Technology, Inc.
A61C9/0053A61B5/0088A61B34/10A61B34/20A61B34/25A61B90/36A61C1/0015A61C1/082A61C5/44A61C7/002A61C9/004A61C9/0046A61C19/04A61C19/05G06F3/011G06K9/00281G06K9/6212G06T17/00G06T19/006G09B23/283G16H20/40G16H30/20G16H30/40G16H40/60G16H50/20G16H50/50A61B1/00009A61B1/00045A61B1/00172A61B1/24A61B5/1032A61B5/4542A61B5/4547A61B5/4552A61B5/7455A61B6/14A61B6/466A61B6/5217A61B6/5247A61B34/76A61B2017/00216A61B2034/102A61B2034/105A61B2034/107A61B2034/2048A61B2034/2065A61B2034/252A61B2034/254A61B2034/256A61B2034/258A61B2090/062A61B2090/309A61B2090/365A61B2090/3612A61B2090/371A61B2090/372A61B2090/373A61B2090/502G02B27/0093G02B27/017G02B2027/0178G06F3/013G06N3/08G06N20/10G06T2207/30036G06T2210/41Y02A90/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,051,914
App. No.
16/851,035
Granted
Jul 6, 2021
Kind
B2
Abstract

A method of using AR for dentistry and orthodontics is provided. An image of a dental arch is received, the image having been generated by an image capture device associated with an augmented reality (AR) display. A processing device registers the image to previous image data associated with the dental arch, compares one or more areas of the dental arch from the image to one or more corresponding areas of the dental arch from the previous image data, determines a position of an area of interest on the dental arch based on the comparing, generates a visual overlay comprising an indication of the area of interest, and outputs the visual overlay to the AR display, wherein the visual overlay is superimposed over a view of the dental arch on the AR display at the position of the area of interest.

Claims (85)

1. A method comprising:

receiving an image of a dental arch, the image having been generated by an image capture device associated with an augmented reality (AR) display;

registering, by a processing device, the image of the dental arch to previous image data associated with the dental arch;

comparing, by the processing device, one or more areas of the dental arch from the image to one or more corresponding areas of the dental arch from the previous image data;

determining, by the processing device, a position of an area of interest on the dental arch based on the comparing;

generating, by the processing device, a visual overlay comprising an indication of the area of interest; and

outputting the visual overlay to the AR display, wherein the visual overlay is superimposed over a view of the dental arch on the AR display at the position of the area of interest.

2. The method of claim 1 , wherein the previous image data associated with the dental arch comprises a three-dimensional model of the dental arch, and wherein registering the image of the dental arch to the three-dimensional model of the dental arch comprises:

generating a plurality of perspective view images of the three-dimensional model of the dental arch; and

comparing the image of the dental arch to the plurality of perspective view images to identify a perspective view image for which the three-dimensional model in the perspective view image most closely matches the dental arch in the image.

3. The method of claim 1 , wherein the previous image data comprises at least one of an optical image of at least a portion of the dental arch, an x-ray image of at least the portion of the dental arch, or a three-dimensional model of the dental arch, and wherein determining the position of the area of interest comprises:

determining a difference between an area of the dental arch in the image and a corresponding area of the dental arch in the previous image data, wherein the position of the area of interest corresponds to a position at which the difference occurred.

4. The method of claim 3 , wherein the difference indicates at least one of wear on a tooth, movement of a tooth, gum swelling, gum recess, a cavity, oral cancer, a plaque deposit, or a tooth crack.

5. The method of claim 3 , further comprising:

determining a previous date associated with the previous image data;

determining a current date;

computing an amount of time between the previous date and the current date;

determining a magnitude of change of a condition for a tooth or gum between the previous image data and the image; and

computing, based on the amount of time and the magnitude of change, a rate of change of the condition for the tooth or gum.

6. The method of claim 5 , further comprising:

determining a target rate of change of the condition for the tooth or gum;

determining that a difference between the target rate of change and the rate of change exceeds a rate of change threshold; and

adding to the visual overlay an indication that the difference between the target rate of change and the rate of change exceeds the rate of change threshold.

7. The method of claim 3 , wherein the visual overlay comprises a contour of the difference.

8. The method of claim 1 , wherein the previous image data associated with the dental arch is from an orthodontic treatment plan for the dental arch that comprises a plurality of treatment stages, each treatment stage of the plurality of treatment stages comprising target positions and orientations for teeth of the dental arch, the method further comprising:

determining a current treatment stage of the orthodontic treatment plan;

determining whether a tooth at the area of interest deviates from the orthodontic treatment plan for the current treatment stage; and

adding, to the visual overlay, an indication of whether the tooth at the area of interest deviates from the orthodontic treatment plan.

9. The method of claim 8 , further comprising:

determining whether the deviation exceeds a deviation threshold;

determining one or more treatment plan alterations in response to determining whether the deviation exceeds the deviation threshold; and

outputting a suggestion of the one or more treatment plan alterations.

10. The method of claim 8 , further comprising:

determining whether one or more additional teeth have target positions and orientations indicated for the current treatment stage of the orthodontic treatment plan; and

adding to the visual overlay indications of whether the one or more additional teeth have the target positions and orientations.

11. The method of claim 8 , further comprising:

determining a clinical history for a patient that identifies an additional area of interest;

determining a position of the additional area of interest in the image of the dental arch; and

adding information about the additional area of interest to the visual overlay.

12. The method of claim 1 , further comprising:

identifying one or more malocclusions on the dental arch based on a result of the comparing, wherein the one or more malocclusions are indicated in the visual overlay.

13. The method of claim 1 , further comprising:

determining a difference between the image and the previous image data at the position of the dental arch; and

assessing the position of the dental arch for one or more malocclusions.

14. A system comprising:

a memory device; and

a processing device operatively coupled to the memory device, the processing device to:

receive an image of a dental arch, the image having been generated by an image capture device associated with an augmented reality (AR) display;

register the image of the dental arch to previous image data associated with the dental arch;

make a comparison between one or more areas of the dental arch from the image and one or more corresponding areas of the dental arch from the previous image data;

determine a position of an area of interest on the dental arch based on the comparison;

generate a visual overlay comprising an indication of the area of interest; and

output the visual overlay to the AR display, wherein the visual overlay is superimposed over a view of the dental arch on the AR display at the position of the area of interest.

15. The system of claim 14 , wherein the previous image data associated with the dental arch comprises a three-dimensional model of the dental arch, and wherein to register the image of the dental arch to the three-dimensional model of the dental arch the processing device is further to:

generate a plurality of perspective view images of the three-dimensional model of the dental arch; and

compare the image of the dental arch to the plurality of perspective view images to identify a perspective view image for which the three-dimensional model in the perspective view image most closely matches the dental arch in the image.

16. The system of claim 14 , wherein the previous image data comprises at least one of an optical image of at least a portion of the dental arch, an x-ray image of at least the portion of the dental arch, or a three-dimensional model of the dental arch, and wherein to determine the position of the area of interest the processing device is further to:

determine a difference between an area of the dental arch in the image and a corresponding area of the dental arch in the previous image data, wherein the position of the area of interest corresponds to a position at which the difference occurred.

17. The system of claim 16 , wherein the difference indicates at least one of wear on a tooth, movement of a tooth, gum swelling, gum recess, a cavity, oral cancer, a plaque deposit, or a tooth crack.

18. The system of claim 16 , wherein the processing device is further to:

determine a previous date associated with the previous image data;

determine a current date;

compute an amount of time between the previous date and the current date;

determine a magnitude of change of a condition for a tooth or gum between the previous image data and the image; and

compute, based on the amount of time and the magnitude of change, a rate of change of the condition for the tooth or gum.

19. The system of claim 18 , wherein the processing device is further to:

determine a target rate of change of the condition for the tooth or gum;

determine that a difference between the target rate of change and the rate of change exceeds a rate of change threshold; and

add to the visual overlay an indication that the difference between the target rate of change and the rate of change exceeds the rate of change threshold.

20. The system of claim 16 , wherein the visual overlay comprises a contour of the difference.

21. The system of claim 14 , wherein the previous image data associated with the dental arch is from an orthodontic treatment plan for the dental arch that comprises a plurality of treatment stages, each treatment stage of the plurality of treatment stages comprising target positions and orientations for teeth of the dental arch, and wherein the processing device is further to:

determine a current treatment stage of the orthodontic treatment plan;

determine that a tooth at the area of interest deviates from the orthodontic treatment plan for the current treatment stage; and

add, to the visual overlay, an indication of the deviation from the orthodontic treatment plan.

22. The system of claim 21 , wherein the processing device is further to:

determine that the deviation exceeds a deviation threshold;

determine one or more treatment plan alterations based on the deviation; and

output a suggestion of the one or more treatment plan alterations.

23. The system of claim 21 , wherein the processing device is further to:

determine that one or more additional teeth have target positions and orientations indicated for the current treatment stage of the orthodontic treatment plan; and

add to the visual overlay indications that the one or more additional teeth have the target positions and orientations.

24. The system of claim 14 , wherein the processing device is further to:

determine a clinical history for a patient that identifies an additional area of interest;

determine a position of the additional area of interest in the image of the dental arch; and

add information about the additional area of interest to the visual overlay.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2020
From: KOPELMAN, AVI; LEVIN, ADI; MEYER, ERIC PAUL; ASHKENAZI, AMIR; GANOT, RON; OZEROV, SERGEI; KARAPETYAN, INNA
To: ALIGN TECHNOLOGY, INC.
Reel/Frame 052423/0338 →
EMPLOYMENT AGREEMENT Recorded Apr 16, 2020
From: ZEIRI, ELAD
To: ALIGN TECHNOLOGY, INC.
Reel/Frame 052430/0568 →
Continuity (3)
Continuation 15841196 · Dec 13, 2017
Provisional Application 62435565 · Dec 16, 2016
Related Publication 20200237486A1 · Jul 30, 2020
Cited By (6)
US 12,210,802 US 12,213,751 US 12,220,185 US 12,236,594 US 12,295,806 US 12,465,440