Using an intraoral mirror with an integrated camera to record immersive dental status, and applications thereof
Disclosed embodiments integrate a camera into an intraoral mirror. Integrating a camera into an intraoral mirror provides an efficient way to record and display what is visible to the healthcare provider in the mirror.
1. A method for capturing an immersive photograph representing a patient's dental status, comprising:
(a) receiving (i) a plurality of photographs of an interior of a patient's mouth, and (ii) associated position information representing respective positions of an image sensor with respect to a reference point when the image sensor captured the respective photographs, wherein the image sensor is affixed to a dental mirror, and wherein each one of the plurality of photographs overlap at least in part with another one of the plurality of photographs, and wherein the plurality of photographs are captured about the same location inside the patient's mouth and at various angles;
(b) in the overlapping portions, determining features that match between multiple photographs;
(c) based on the associated position information for the respective photographs and the matching features, mapping the plurality of photographs onto a sphere representing the various angles at which the photographs were captured; and
(d) stitching the plurality of photographs of the interior of the patient's mouth into an immersive photograph modeled as a sphere and representing a state of at least a portion of the patient's mouth.
2. The method of claim 1 , wherein the plurality of photographs of the interior of the patient's mouth received in (a) are taken before a dental treatment of the patient's mouth, and further comprising:
(e) receiving (i) another plurality of photographs of the interior of the patient's mouth after the dental treatment, and (ii) associated position information for the respective other photographs, wherein the other plurality of photographs are collected from the image sensor affixed to the dental mirror, and wherein each one of the other plurality of photographs overlap at least in part with another one of the other plurality of photographs, and wherein the other plurality of photographs are captured about the same location inside the patient's mouth and at various angles;
(f) in the overlapping portions of the other plurality of photographs, determining features that match between multiple photographs received in (e);
(g) based on the associated position information for the respective other plurality of photographs and the matching features determined in (f), mapping the other plurality of photographs onto a sphere representing the various angles at which the photographs were captured; and
(h) stitching the other plurality of photographs of the interior of the patient's mouth into another photograph modeled as a sphere and representing a state of at least a portion of the patient's mouth to compare the patient's mouth before and after the dental treatment.
3. The method of claim 1 , further comprising mapping a set of immersive photographs modeled as spheres, each representing a state of at least a portion of the patient's mouth around a center point, to a set of points representing locations of the center points inside the patient's mouth.
4. The method of claim 1 , further comprising:
(e) adjusting the plurality of photographs of the interior of the patient's mouth to account for variations in brightness between the plurality of photographs such that the stitched immersive photographs have a substantially uniform brightness.
5. The method of claim 1 , further comprising:
(e) adjusting the plurality of photographs of the interior of the patient's mouth to account for variations in scale between the plurality of photographs such that the stitched immersive photographs proportionally represents the patient's mouth.
6. The method of claim 1 , wherein steps (a)-(d) occur on a server remote from the dental mirror and wherein the receiving (a) comprises receiving the plurality of photographs and associated position information via a computer network.
7. The method of claim 1 , wherein the plurality of photographs of the interior of the patient's mouth are collected during a plurality of different dental visits.
8. The method of claim 1 , further comprising:
(e) associating a point on the immersive photograph to an image representing a location that the point represents in the patient's mouth.
9. The method of claim 1 , wherein the reference point is a location determined by a base station.
10. A non-transitory program storage device tangibly embodying a program of instructions executable by at least one machine to perform a method for capturing an immersive photograph representing a patient's dental status, the method comprising:
(a) receiving (i) a plurality of photographs of an interior of a patient's mouth, and (ii) associated position information representing respective positions of an image sensor with respect to a reference point when the image sensor captured the respective photographs, wherein the image sensor is affixed to a dental mirror, and wherein each one of the plurality of photographs overlap at least in part with another one of the plurality of photographs, and wherein the plurality of photographs are captured about the same location inside the patient's mouth and at various angles;
(b) in the overlapping portions, determining features that match between multiple photographs;
(c) based on the associated position information for the respective photographs and the matching features, mapping the plurality of photographs onto a sphere representing the various angles at which the photographs were captured; and
(d) stitching the plurality of photographs of the interior of the patient's mouth into an immersive photograph modeled as a sphere and representing a state of at least a portion of the patient's mouth.
11. The program storage device of claim 10 , wherein the plurality of photographs of the interior of the patient's mouth received in (a) are taken before a dental treatment of the patient's mouth, and the method further comprising:
(e) receiving (i) another plurality of photographs of the interior of the patient's mouth after the dental treatment, and (ii) associated position information for the respective other photographs, wherein the other plurality of photographs are collected from the image sensor affixed to the dental mirror, and wherein each one of the other plurality of photographs overlap at least in part with another one of the other plurality of photographs, and wherein the other plurality of photographs are captured about the same location inside the patient's mouth and at various angles;
(f) in the overlapping portions of the other plurality of photographs, determining features that match between multiple photographs received in (e);
(g) based on the associated position information for the respective other plurality of photographs and the matching features determined in (f), mapping the other plurality of photographs onto a sphere representing the various angles at which the photographs were captured; and
(h) stitching the other plurality of photographs of the interior of the patient's mouth into another photograph modeled as a sphere and representing a state of at least a portion of the patient's mouth to compare the patient's mouth before and after the dental treatment.
12. The program storage device of claim 10 , the method further comprising mapping a set of immersive photographs modeled as spheres, each representing a state of at least a portion of the patient's mouth around a center point, to a set of points representing locations of the center points inside the patient's mouth.
13. The program storage device of claim 10 , the method further comprising:
(e) adjusting the plurality of photographs of the interior of the patient's mouth to account for variations in brightness between the plurality of photographs such that the stitched immersive photographs have a substantially uniform brightness.
14. The program storage device of claim 10 , the method further comprising:
(e) adjusting the plurality of photographs of the interior of the patient's mouth to account for variations in scale between the plurality of photographs such that the stitched immersive photographs proportionally represents the patient's mouth.
15. The program storage device of claim 10 , wherein the receiving (a) comprises receiving the plurality of photographs and associated position information at a server remote from the dental mirror via a computer network.
16. The program storage device of claim 10 , wherein the plurality of photographs of the interior of the patient's mouth are collected during a plurality of different dental visits.
17. The program storage device of claim 10 , the method further comprising:
(e) associating a point on the immersive photograph to an image representing a location that the point represents in the patient's mouth.
18. The program storage device of claim 10 , the method further comprising:
(e) associating a point on the immersive photograph to an image representing a location that he point represents in the patient's mouth.
19. A system for capturing an image representing a patient's dental status, comprising:
a processor;
a patient status database that stores historical patient status information including historical panoramic images of a patient's mouth; and
a server, executed on the processor, that receives (i) a plurality of photographs of an interior of the patient's mouth, and (ii) associated position information representing respective positions of an image sensor with respect to a reference point when the image sensor captured the respective photographs, wherein the image sensor is affixed to a dental mirror, and wherein each one of the plurality of photographs overlap at least in part with another one of the plurality of photographs, the server comprising:
an immersive panorama stitcher module that (i) determines features in the overlapping portions that match between multiple photographs, (ii) based on associated position information for the respective photographs and the matching features, aligns the plurality of photographs to represent a series of adjacent teeth, and (iii) stitches the plurality of photographs of the interior of the patient's mouth into a panoramic image modeled as a sphere and representing a state of at least a portion of the patient's mouth.
20. The system of claim 19 , wherein the immersive panorama stitcher module adjusts the plurality of photographs of the interior of the patient's mouth to account for variations in scale between the plurality of photographs such that the panoramic image proportionally represents the patient's mouth.
21. The system of claim 19 , wherein the immersive panorama stitcher module adjusts the plurality of photographs of the interior of the patient's mouth to account for variations in brightness between the plurality of photographs such that the panoramic image has a substantially uniform brightness.