Alignment of three-dimensional data collected in dental sessions, and applications thereof
Disclosed embodiments integrate a camera into an intraoral mirror. Integrating a camera into an intraoral mirror provides an efficient way to record and display what is visible to the healthcare provider in the mirror.
1. A computer-implemented method for aligning three-dimensional dental data from a plurality of dental sessions, comprising:
(a) receiving a plurality of point clouds, each point cloud (i) representing three-dimensional locations in a dental room of a dental mirror including an interior of a patient's mouth, and (ii) collected during a different dental session when the patient's mouth is in a different position in the dental room, the dental mirror configured to enable a healthcare provider to view a reflection of the interior of the patient's mouth when observing the reflective surface;
(b) aligning the plurality of point clouds to represent a common volume element within the patient's mouth; and
(c) generating, based on the aligned plurality of point clouds, a three-dimensional model of the interior of a patient's mouth.
2. The method of claim 1 , further comprising:
(d) evaluating whether respective locations in the plurality of point clouds are in the interior of the patient's mouth; and
(e) rejecting locations not within the interior of the patient's mouth.
3. The method of claim 2 , wherein the evaluating (d) comprises, for respective point clouds in the plurality of point clouds:
(i) determining a set of vectors such that each vector comprises a line segment between two or more locations in the respective point cloud, wherein the two or more locations were sensed consecutively and chronologically;
(ii) determining spatial distances between vectors in the set of vectors; and
(iii) based on the determined spatial distances, determining whether the associated locations in the respective point cloud are within the patient's mouth.
4. The method of claim 3 , wherein the determining (iii) comprises, for respective spatial distances:
(i) determining whether the respective spatial distance is within a range; and
(ii) determining whether the locations associated with the respective spatial distance are within the patient's mouth based at least in part on whether the respective spatial distance is within the range.
5. The method of claim 2 ,
wherein the three-dimensional locations are where an image sensor affixed to the dental mirror has captured a photographic image,
wherein the evaluating (d) comprises, for respective three-dimensional locations, conducting image analysis on the photographic image captured at the three-dimensional location to determine whether the photographic image resembles the interior of the patient's mouth.
6. The method of claim 5 , wherein conducting image analysis comprises conducting histogram analysis.
7. The method of claim 2 , wherein the evaluating (d) comprises, for respective three-dimensional locations, determining whether the three-dimensional location is in proximity to a location rejected in (e).
8. The method of claim 1 , wherein the three-dimensional locations are where an image sensor affixed to the dental mirror has captured a photographic image.
9. The method of claim 7 , further comprising:
(f) blending the photographic imagery data to account for variations in hue and brightness.
10. The method of claim 1 , further comprising:
(d) determining that utilization of a computing device is below a threshold, and
wherein steps (a)-(c) are executed on the computing device when the utilization is determined to be below the threshold.
11. A non-transitory program storage device having instructions stored thereon that, when executed by at least one computing device, causes the at least one computing device to perform a method for aligning three-dimensional dental data from a plurality of dental sessions, comprising:
(a) receiving a plurality of point clouds, each point cloud (i) representing three-dimensional locations in a dental room of a dental mirror including an interior of a patient's mouth, and (ii) collected during a different dental session when the patient's mouth is in a different position in the dental room, the dental mirror configured to enable a healthcare provider to view a reflection of the interior of the patient's mouth when observing the reflective surface;
(b) aligning the plurality of point clouds to represent a common volume element within the patient's mouth; and
(c) generating, based on the aligned plurality of point clouds, a three-dimensional model of the interior of a patient's mouth.
12. The program storage device of claim 11 , wherein the method further comprises:
(d) evaluating whether respective locations in the plurality of point clouds are in the interior of the patient's mouth; and
(e) rejecting locations not within the interior of the patient's mouth.
13. The program storage device of claim 12 , wherein the evaluating (d) comprises, for respective point clouds in the in the plurality of point clouds:
(i) determining a set of vectors such that each vector comprises a line segment between two or more locations in the respective point cloud, wherein the two or more locations were sensed consecutively and chronologically;
(ii) determining spatial distances between vectors in the set of vectors; and
(iii) based on the determined spatial distances, determining whether the associated locations in the respective point cloud are within the patient's mouth.
14. The program storage device of claim 13 , wherein the determining (iii) comprises, for respective spatial distances:
(i) determining whether the respective spatial distance is within a range; and
(ii) determining whether the locations associated with the respective spatial distance are within the patient's mouth based at least in part on whether the respective spatial distance is within the range.
15. The program storage device of claim 12 ,
wherein the three-dimensional locations are where an image sensor affixed to the dental mirror has captured a photographic image,
wherein the evaluating (d) comprises, for respective three-dimensional locations, conducting image analysis on the photographic image captured at the three-dimensional location to determine whether the photographic image resembles the interior of the patient's mouth.
16. The program storage device of claim 11 , wherein the plurality of point clouds is generated from photographic imagery data and associated location information indicating a location where an image sensor captured the associated photographic imagery data.
17. The program storage device of claim 16 , wherein the image sensor is affixed to a dental mirror device.
18. The program storage device of claim 17 , wherein the associated location information is generated using a gyroscope calibrated when the dental mirror device is docked to a base station.
19. The program storage device of claim 16 , the method further comprising:
(d) blending the photographic imagery data to account for variations in hue and brightness.
20. The program storage device of claim 11 , the method further comprising:
(d) determining that utilization of a computing device is below a threshold, and
wherein steps (a)-(c) are executed on the computing device when the utilization is determined to be below the threshold.