Unified workstation for virtual craniofacial diagnosis, treatment planning and therapeutics
An integrated system is described in which digital image data of a patient, obtained from a variety of image sources, including CT scanner, X-Ray, 2D or 3D scanners and color photographs, are combined into a common coordinate system to create a virtual three-dimensional patient model. Software tools are provided for manipulating the virtual patient model to simulation changes in position or orientation of craniofacial structures (e.g., jaw or teeth) and simulate their affect on the appearance of the patient. The simulation (which may be pure simulations or may be so-called “morphing” type simulations) enables a comprehensive approach to planning treatment for the patient. In one embodiment, the treatment may encompass orthodontic treatment. Similarly, surgical treatment plans can be created. Data is extracted from the virtual patient model or simulations thereof for purposes of manufacture of customized therapeutic devices for any component of the craniofacial structures, e.g., orthodontic appliances.
1. A method for diagnosis and planning treatment of a human patient using a computer, comprising the steps of:
obtaining a first set of digital data representing patient craniofacial image information from a first imaging device;
obtaining a second set of digital data representing patient craniofacial image information from a second image device different from said first image device;
wherein said first and second sets of data representing at least in part common craniofacial anatomical structures of said patient, at least one of said first and second sets of digital data including data representing the external visual appearance or surface configuration of the face of the patient;
wherein said first and second digital data sets are each obtained at different points in time and are not captured in a correlated fashion;
automatically, and/or with the aid of operator interaction, superimposing said first set of digital data and said second set of digital data so as to provide a composite, combined digital representation of said craniofacial anatomical structures created from said first and second digital data sets each obtained at different points in time and not captured in a correlated fashion in a common coordinate method;
creating a virtual 3D face at least from a portion of said craniofacial anatomical structures using an active model matching strategy; wherein said craniofacial anatomical structures include upper and lower jaws and teeth of said patient; wherein said teeth are positioned relative to each other in malocclusion position of said patient;
displaying said composite, combined digital representation of said craniofacial anatomical structures, including said virtual 3D face, said upper and lower jaws and said teeth of said patient on a screen display of said computer using a user interface of said computer;
making measurements of said craniofacial anatomical structures using measurement tools; and
performing interactive treatment planning steps using said computer for planning orthodontic treatment of said patient.
2. The method of claim 1 , wherein said composite, combined digital representation comprises a three-dimensional representation.
3. The method of claim 1 , wherein said craniofacial anatomical structures include soft tissue of said patient.
4. The method of claim 2 , wherein said craniofacial structures comprise soft tissue, bone and dentition.
5. The method of claim 2 , wherein said first set of digital data comprises a set of individual tooth models representing facial components of the patient.
6. The method of claim 1 , further comprising the steps of (a) visually studying on said user interface the interaction of said craniofacial anatomical structures and their relationship to the external, visual appearance of said patient; and (b) simulating changes in the anatomical position or shape of said craniofacial anatomical structures.
7. The method of claim 6 , wherein said step (b) of simulating changes in the anatomical position or shape of craniofacial anatomical structures includes simulations of the effect of such changes on the external, visual appearance of said patient.
8. The method of claim 6 , further comprising the steps of displaying the smile of said patient; and viewing said smile after simulation of changing the position of said craniofacial anatomical structures.
9. The method of claim 1 , further comprising the steps of (a) moving said craniofacial structures; and (b) displaying the movement in a dynamic format on a user interface.
10. The method of claim 1 , wherein said first set of digital data is obtained from an in-vivo scan of facial components and associated anatomical structures.
11. The method of claim 10 , wherein said facial components comprise teeth.
12. The method of claim 1 , wherein said first set of digital data is obtained from a scan of a model of the patients' dentition, or a scan of a facial moulage.
13. The method of claim 1 , wherein said first set of data and said second set of data are obtained from imaging devices selected from the group of imaging devices consisting of digital cameras, X-ray devices, hand-held 3-D scanners, laser scanners, computed tomography (CT) scanners, MRI scanners, coordinate measuring machines, destructive scanners, and ultrasound scanners.
14. The method of claim 1 , further comprising the step of storing a three-dimensional representation of said patient's craniofacial structures in a format suitable for use by a manufacturer of orthodontic appliances.
15. The method of claim 1 , further comprising the step of transmitting said composite, combined digital three-dimensional representation of said craniofacial anatomical structures over a computer network.
16. The method of claim 1 , wherein the orthodontic treatment comprises a hybrid treatment in which different types of appliances (fixed or removable) are selected and designed to treat the patient.
17. The method of claim 1 , further comprising the step of simulating the changes in at least one of the following: the age of the patient, the facial expression of the patient, and the coloring of the skin or teeth of the patient.
18. The method of claim 1 , further comprising the step of simulating the modification of the shape of any craniofacial structure.
19. The method of claim 1 , further comprising the steps of merging data representing a three-dimensional scan of the surface of the face of the patient and data representing a two-dimensional color picture of the face of the patient, thereby creating a three-dimensional colored virtual model of the face of the patient.
20. The method of claim 1 , wherein said first and second sets of data are obtained from imaging devices selected from the group of imaging devices consisting of two dimensional cameras, X-ray devices, hand-held 3-D scanners, laser scanners, computed tomography (CT) scanners, MRI scanners, coordinate measuring machines, destructive scanners, and ultrasound scanners; and further comprising the steps of storing a third or more sets of data representing images, including one or more X-rays of said craniofacial structures, and superimposing, either automatically or with user involvement, the three-dimensional model of said craniofacial structures from the combination of said first and second data sets with said one or more images of said craniofacial structures.
21. The method of claim 1 , further comprising the step of integrating a patient management program having a scheduling feature for scheduling appointments for said patient.
22. The method of claim 21 , wherein said patient management program provides a flexible scheduling of patient appointments based on progress of treatment of said craniofacial anatomical structures.
23. The method of claim 22 , wherein said progress of treatment is obtained from periodically obtaining updated three-dimensional information regarding the progress of treatment of the craniofacial features of the patient.
24. The method of claim 23 , wherein said three-dimensional information is obtained from scanning of the craniofacial anatomical structures with an optical, hand-held scanner.
25. The method of claim 23 , wherein said craniofacial anatomical structures include the teeth of the patient.
26. The method of claim 1 , further comprising the step of superimposing said first set of digital data and said second set of digital data with the use of an operator interaction, and wherein said operator interaction comprises:
displaying said first and second sets of digital data on said user interface, said operator selecting points on said user interface in said first set of data which are common to said second set of data.
27. The method of claim 1 , further comprising the step of simulating changes in the position of the teeth of the patient.
28. The method of claim 1 , further comprising the step of simulating changes in soft tissue of the patient.
29. The method of claim 1 , wherein said composite, combined digital representation comprises a two-dimensional representation.
30. The method of claim 1 , wherein said composite, combined digital representation comprises a superposition of a two-dimensional representation and a three dimensional representation.
31. The method of claim 1 , further comprising the step of modeling growth in craniofacial structure of functional movement of craniofacial structures.