IP Library › Granted Patent US 11,801,121
Granted Patent B2
US 11,801,121 · App. 18/061,866 · Granted Oct 31, 2023

Methods for generating composite images of a patient

Inventors: Dmitry Mednikov (Moscow, RU); Svetlana Makarenkova (Moscow, RU); Pavel Pokotilov (Sunnyvale, CA); Aleksandr Zhulin (Moscow, RU); Boris Likhtman (Moscow, RU)
Assignee: Align Technology, Inc.
A61C7/002A61C7/08A61C9/004G06T15/10G06T19/20G16H50/50A61C9/0006G06F30/20G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,801,121
App. No.
18/061,866
Granted
Oct 31, 2023
Kind
B2
Abstract

Methods and systems for generating composite images of a patient and models of the patient's dentition are provided. In some embodiments, a method includes generating a plurality of 3D models, each comprising a virtual representation of the patient's dentition at different treatment stages of a treatment plan and obtaining an image of the patient's face and dentition. The method can include projecting the obtained image into a 3D space to create a projected 3D model of the patient's face and dentition. The method can also include generating a plurality of modified images, each representing the patient in a treatment stage of the treatment plan and formed by combining the patient's dentition of one of the 3D models with the patient's face of the projected 3D model. A modified image corresponding to a selected treatment stage and a corresponding 3D model can be provided for display.

Claims (49)

1. A computer-implemented method comprising:

generating a plurality of 3D models, each of the plurality of 3D models comprising a virtual representation of a patient's dentition at a different treatment stage of an orthodontic treatment plan;

obtaining an image of the patient's face and at least a portion of the patient's dentition;

projecting the obtained image into a 3D space to create a projected 3D model of the patient's face and the at least the portion of the patient's dentition;

generating a plurality of modified images of the patient, each of the plurality of modified images representing the patient in a respective treatment stage of the orthodontic treatment plan, wherein each of the plurality of modified images is formed by combining the patient's dentition of one of the plurality of 3D models with the patient's face of the projected 3D model;

receiving, from a user, a selection of a first treatment stage of the orthodontic treatment plan; and

sending instructions to display, on a display, a first modified image corresponding to the selected first treatment stage and a first 3D model corresponding to the selected first treatment stage.

2. The computer-implemented method of claim 1 , further comprising:

receiving first identifiers of a first set of reference points modeled on the first 3D model, the first set of reference points corresponding to a set of anatomical points on the patient's dentition of the first 3D model; and

receiving second identifiers of a second set of reference points represented on the at least the portion of the patient's dentition included in the obtained image.

3. The computer-implemented method of claim 2 , further comprising:

aligning at least a portion of the first set of reference points on the first 3D model with at least a portion of the second set of reference points on the projected 3D model of the obtained image.

4. The computer-implemented method of claim 3 , wherein at least one of the plurality of modified images of the patient is generated based on the alignment.

5. The computer-implemented method of claim 1 , further comprising sending instructions to display the first modified image in a first window or frame of the display, and to display the first 3D model in a second window or frame of the display.

6. The computer-implemented method of claim 1 , further comprising:

receiving, from the user, a selection of a second treatment stage of the orthodontic treatment plan; and

sending instructions to update the display to display a second modified image of the patient corresponding to the selected second treatment stage and a second 3D model corresponding to the selected second treatment stage.

7. The computer-implemented method of claim 1 , wherein the selected first treatment stage is a final treatment stage of the orthodontic treatment plan.

8. The computer-implemented method of claim 1 , further comprising:

generating a video file that includes representations of the plurality of modified images arranged in chronological order to show the patient's face and the at least the portion of the patient's dentition during the orthodontic treatment plan.

9. The computer-implemented method of claim 1 , further comprising sending instructions to display at least one label depicting an amount of adjustment to be made to one or more portions of the dentition of the patient.

10. The computer-implemented method of claim 9 , wherein the at least one label identifies one or more of a type of the adjustment or a malocclusion corresponding to the adjustment.

11. A computer-implemented method comprising:

generating a first plurality of 3D models, each of the first plurality of 3D models comprising a virtual representation of a patient's dentition at a different treatment stage of a first orthodontic treatment plan;

obtaining an image of the patient's face and at least a portion of the patient's dentition;

projecting the obtained image into a 3D space to create a projected 3D model of the patient's face and the at least the portion of the patient's dentition;

generating a first plurality of modified images of the patient, each of the first plurality of modified images representing the patient in a respective treatment stage of the first orthodontic treatment plan, wherein each of the first plurality of modified images is formed by combining the patient's dentition of one of the first plurality of 3D models with the patient's face of the projected 3D model; and

sending instructions to display at least one of the first plurality of modified images in a first window or frame of a display.

12. The computer-implemented method of claim 11 , further comprising:

sending instructions to display the obtained image in a second window or frame of the display.

13. The computer-implemented method of claim 11 , further comprising:

sending instructions to display at least a second one of the first plurality of modified images in a second window or frame of the display.

14. The computer-implemented method of claim 11 , further comprising:

sending instructions to display a second modified image corresponding to a final treatment stage of the first orthodontic treatment plan in a second window or frame of the display.

15. The computer-implemented method of claim 11 , further comprising:

generating a second plurality of 3D models, each of the second plurality of 3D models comprising a virtual representation of the patient's dentition at a different treatment stage of a second orthodontic treatment plan; and

generating a second plurality of modified images of the patient, each of the second plurality of modified images representing the patient in a respective treatment stage of the second orthodontic treatment plan.

16. The computer-implemented method of claim 15 , wherein each of the second plurality of modified images is formed by combining the patient's dentition of one of the second plurality of 3D models with the patient's face of the projected 3D model.

17. The computer-implemented method of claim 15 , further comprising:

sending instructions to display at least one of the second plurality of modified images in a second window or frame of the display.

18. The computer-implemented method of claim 17 , further comprising:

receiving, from a user, a selection of a first treatment stage of the first orthodontic treatment plan and a selection of a second treatment stage of the second orthodontic treatment plan; and

sending instructions to display, in the first window or frame of the display, a modified image, of the first plurality of modified images, corresponding to the selected first treatment stage and to display, in the second window or frame of the display, a modified image, of the second plurality of modified images, corresponding to the selected second treatment stage.

19. The computer-implemented method of claim 15 , further comprising:

generating a video file that includes representations of the first plurality of modified images arranged in chronological order to show the patient's face and the at least the portion of the patient's dentition during the first orthodontic treatment plan and representations of the second plurality of modified images arranged in chronological order to show the patient's face and the at least the portion of the patient's dentition during the second orthodontic treatment plan.

20. The computer-implemented method of claim 11 , further comprising:

receiving first identifiers of a first set of reference points modeled on a first 3D model of the first plurality of 3D models, the first set of reference points corresponding to a set of anatomical points on the patient's dentition of the first 3D model;

receiving second identifiers of a second set of reference points represented in the at least the portion of the patient's dentition included in the obtained image; and

aligning at least a portion of the first set of reference points with at least a portion of the second set of reference points.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2023
From: MEDNIKOV, DMITRY; MAKARENKOVA, SVETLANA; POKOTILOV, PAVEL; ZHULIN, ALEKSANDR; LIKHTMAN, BORIS
To: ALIGN TECHNOLOGY, INC.
Reel/Frame 063044/0690 →
Continuity (3)
Continuation 16455441 · Jun 27, 2019
Provisional Application 62692548 · Jun 29, 2018
Related Publication 20230098845A1 · Mar 30, 2023
Cited By (1)
US 12,232,926