Methods and apparatuses for dental images
Described herein are methods and apparatuses to obtain an image, or a set of images, of a patient's teeth from one or more predetermined viewing angles. These methods and apparatuses may include the use an overlay comprising an outline of teeth for each predetermined viewing angle. The overlay may be used for automatically capturing, focusing and/or illuminating the teeth. Also described herein are methods and apparatuses for using a series of images of the patient's teeth including a set of predetermined views to determine if a patient is a candidate for an orthopedic procedure.
1. A non-transitory, computer-readable storage media having executable instructions that are executed by a processor of a mobile telecommunications device to cause the mobile telecommunications device having a camera to perform a method for capturing dental images for analysis, the method comprising:
guiding a patient to capture, with the camera of the mobile telecommunications device, a first predetermined set of images of teeth of the patient at specified viewing angles relative to the teeth using a first indicator that is output from the mobile telecommunications device, wherein the first indicator indicates to the patient that the patient should move the mobile telecommunications device relative to a mouth of the patient to the right/left with the jaws closed, in order to capture the first predetermined set of images of teeth at the specified viewing angles;
guiding the patient to capture, with the camera of the mobile telecommunications device, a second predetermined set of images of teeth of the patient at specified viewing angles relative to the teeth using a second indicator output from the mobile telecommunications device, wherein the second indicator indicates to the patient that the patient should move the mobile telecommunications device relative to the mouth of the patient to the right/left with the jaws open, in order to capture the second predetermined set of images of teeth at the specified viewing angles; and
capturing the first and second predetermined sets of images of the teeth of the patient as the patient moves the camera of the mobile telecommunications device relative to the mouth of the patient;
displaying, during the capture of the first and second predetermined sets of images of the teeth of the patient, video from the camera of the mobile telecommunications device to a screen of the mobile telecommunications device;
uploading the captured first and second predetermined sets of images of the teeth for treatment progress evaluation to provide a treatment progress evaluation of the patient.
2. The non-transitory, computer-readable storage media of claim 1 , wherein the captured first and second predetermined sets of images of the teeth are uploaded to a remote server.
3. The non-transitory, computer-readable storage media of claim 1 , wherein the patient is guided to capture the first and second predetermined sets of images in a predetermined sequence.
4. The non-transitory, computer-readable storage media of claim 1 , wherein the method further comprises recognizing and categorizing the teeth imaged by the camera of the mobile telecommunications device based on training.
5. The non-transitory, computer-readable storage media of claim 1 , wherein the method further comprises automatic detection of teeth imaged by the camera of the mobile telecommunications device by machine learning.
6. The non-transitory, computer-readable storage media of claim 1 , wherein the method further comprises detecting, using edge detection image processing, the teeth imaged by the camera of the mobile telecommunications device.
7. The non-transitory, computer-readable storage media of claim 1 , wherein capturing the first and second predetermined sets of images of the teeth of the patient as the patient moves the camera of the mobile telecommunications device relative to the mouth of the patient comprises detecting the teeth of the patient and automatically focusing the camera of the mobile telecommunications device on the detected teeth.
8. The non-transitory, computer-readable storage media of claim 1 , wherein capturing the first and second predetermined sets of images of the teeth of the patient as the patient moves the camera of the mobile telecommunications device relative to the mouth of the patient comprises automatically adjusting an illumination provided by a light source of the mobile telecommunications device.
9. The non-transitory, computer-readable storage media of claim 8 , wherein the illumination provided by the light source of the mobile telecommunications device is adjusted to be a continuously on light.
10. The non-transitory, computer-readable storage media of claim 1 , wherein the specified viewing angles comprise an upper and lower jaw anterior viewing angle with a closed bite, a right buccal viewing angle with the closed bite, a left buccal viewing angle with the closed bite, an anterior viewing angle with an open bite, a right buccal viewing angle with the open bite, and a left buccal viewing angle with the open bite, and wherein first indicator and the second indicator comprise a first overlay and second overlay, respectively, displayed to the screen of the mobile telecommunications device, the first overlay associated with the upper and lower anterior viewing angle with the closed bite, and the second overlay associated with the anterior viewing angle with the open bite.
11. The non-transitory, computer-readable storage media of claim 10 , wherein the first and second overlays are displayed on the screen as solid.
12. The non-transitory, computer-readable storage media of claim 10 , wherein the first and second overlays are displayed on the screen as transparent.
13. The non-transitory, computer-readable storage media of claim 10 , wherein the first and second overlays are displayed on the screen as an outline of teeth.
14. The non-transitory computer-readable storage media of claim 1 , wherein capturing the first and second predetermined sets of images of the teeth of the patient as the patient moves the camera of the mobile telecommunications device relative to the mouth of the patient comprises detecting one or more teeth imaged by the camera of the mobile telecommunications device and automatically taking an image when the detected one or more teeth are in a desired orientation, size, and/or location on the screen.
15. The non-transitory computer-readable storage media of claim 14 , wherein capturing the first and second predetermined sets of images of the teeth of the patient as the patient moves the camera of the mobile telecommunications device relative to the mouth of the patient comprises using an overlay.
16. The non-transitory computer-readable storage media of claim 14 , wherein capturing the predetermined set of images of the teeth of the patient as the patient moves the camera of the mobile telecommunications device relative to the mouth of the patient is performed without an overlay.
17. The non-transitory, computer-readable storage media of claim 1 , wherein, after capturing the first and second predetermined sets of images of the teeth, an image quality of the captured first and second predetermined sets of images is reviewed and an indication is displayed on the screen if image quality of one or more of the captured first and second predetermined sets of images is below a threshold.
18. The non-transitory, computer-readable storage media of claim 17 , wherein the image quality comprises a focus.
19. The non-transitory, computer-readable storage media of claim 17 , wherein the image quality comprises a lighting.
20. The non-transitory, computer-readable storage media of claim 17 , wherein the image quality comprises a visibility of all the teeth and wherein image recognition algorithms are used to review of the first and second predetermined sets of images to assess the visibility of all the teeth.
21. The non-transitory, computer-readable storage media of claim 17 , wherein the method further comprises showing a message on the screen of the mobile telecommunications device to the patient to retake an alternative image if the image quality of one or more of the captured first and second predetermined sets of images is below the threshold.
22. The non-transitory, computer-readable storage media of claim 1 , wherein, after capturing the first and second predetermined sets of images of the teeth, the first and second predetermined sets of images of the teeth are automatically labeled with a corresponding view that is detected.
23. The non-transitory, computer-readable storage media of claim 1 , wherein capturing the first and second predetermined sets of images of the teeth of the patient as the patient moves the camera of the mobile telecommunications device relative to the mouth of the patient comprises using the camera in a continuous burst mode.
24. The non-transitory, computer-readable storage media of claim 23 , wherein capturing the first and second predetermined sets of images of the teeth of the patient as the patient moves the camera of the mobile telecommunications device relative to the mouth of the patient using the camera in the continuous burst mode comprises automatically reviewing captured images.
25. The non-transitory, computer-readable storage media of claim 24 , wherein capturing the first and second predetermined sets of images of the teeth of the patient as the patient moves the camera of the mobile telecommunications device relative to the mouth of the patient using the camera in the continuous burst mode comprises automatically matching views to the specified viewing angles.
26. The non-transitory, computer-readable storage media of claim 24 , wherein automatically reviewing captured images comprises selecting only those images having a sufficiently high quality for the first and second predetermined sets of images of the teeth.
27. The non-transitory, computer-readable storage media of claim 1 , wherein guiding the patient to capture the first and second predetermined sets of images of teeth of the patient at specified viewing angles relative to the teeth comprises displaying one or more arrows on the screen of the mobile telecommunications device, the one or more arrows indicating that a user should move the mobile telecommunications device in a particular direction.
28. The non-transitory, computer-readable storage media of claim 1 , wherein the method further comprises displaying a message guiding the patient to take the first and second predetermined sets of images of the teeth of the patient with a retractor on the screen of the mobile telecommunications device.
29. A non-transitory, computer-readable storage media having executable instructions that are executed by a processor of a mobile telecommunications device to cause the mobile telecommunications device having a camera to perform a method for capturing dental images for analysis, the method comprising:
guiding a patient to capture, with the camera of the mobile telecommunications device following retraction of the patient's cheeks, a first predetermined set of images of teeth of the patient at specified viewing angles relative to the teeth using a first indicator that is output from the mobile telecommunications device, the specified viewing angles comprising an upper and lower jaw anterior viewing angle with a closed bite, a right buccal viewing angle with the closed bite, and a left buccal viewing angle with the closed bite, and wherein the first indicator indicates to the patient that the patient should move the mobile telecommunications device relative to a mouth of the patient to capture the first predetermined set of images of teeth at the specified viewing angles in a continuous mode;
guiding the patient to capture a second predetermined set of images of teeth of the patient at specified viewing angles relative to the teeth using a second indicator that is output from the mobile telecommunications device, the specified viewing angles comprising an anterior viewing angle with an open bite, a right buccal viewing angle with the open bite, and a left buccal viewing angle with the open bite, and wherein the second indicator indicates to the patient that the patient should move the mobile telecommunications device relative to a mouth of the patient to capture the second predetermined set of images of teeth at the specified viewing angles in the continuous mode;
capturing the first and second predetermined sets of images of the teeth of the patient as the patient moves the mobile telecommunications device relative to the mouth of the patient;
displaying, during the capture of the first and second predetermined sets of images of the teeth of the patient, video from the camera of the mobile telecommunications device to a screen of the mobile telecommunications device;
uploading the captured first and second predetermined sets of images of the teeth for treatment progress evaluation.
30. A non-transitory, computer-readable storage media having executable instructions that are executed by a processor of a mobile telecommunications device to cause the mobile telecommunications device having a camera to perform a method for capturing dental images for analysis, the method comprising:
guiding a patient to capture, with the camera of the mobile telecommunications device, a first predetermined set of images of teeth of the patient at specified viewing angles relative to the teeth using an indicator that is output from the mobile telecommunications device, wherein the user-detectable output indicates to the patient that the patient should move the mobile telecommunications device relative to a mouth of the patient anteriorly to buccally with the teeth closed, in order to capture the first predetermined set of images of teeth at the specified viewing angles;
guiding the patient to capture, with the camera of the mobile telecommunications device, a second predetermined set of images of teeth of the patient at specified viewing angles relative to the teeth using an indicator that is output from the mobile telecommunications device, wherein the user-detectable output indicates to the patient that the patient should move the mobile telecommunications device relative to a mouth of the patient anteriorly to buccally with the teeth open, in order to capture the second predetermined set of images of teeth at the specified viewing angles;
capturing the first and second predetermined sets of images of the teeth of the patient as the patient moves the mobile telecommunications device relative to the mouth of the patient;
displaying, during the capture of the first and second predetermined sets of images of the teeth of the patient, video from the camera of the mobile telecommunications device to a screen of the mobile telecommunications device, wherein the screen is not facing the patient during capture of the first and second predetermined sets of images;
after capturing the first and second predetermined sets of images of the teeth, reviewing an image quality of the captured first and second predetermined sets of images, wherein the image quality comprises a visibility of all or a sub-set of the teeth and wherein image recognition algorithms are used to review of the predetermined set of images to assess the visibility of all or a sub-set of the teeth; and
displaying on the screen of the mobile telecommunications device a result of the image quality review; and
uploading the captured first and second predetermined sets of images of the teeth for treatment progress evaluation
wherein the teeth are automatically recognized and categorized based on machine learning.