Mobile intraoral camera powered with artificial intelligence
View Patent ↗Systems, devices and methods for imaging hard-to-view and hard-to-reach places in the oral cavity, such as at the base of the tongue and tonsillar regions, are described. An example mobile intraoral imaging system includes a white light source and a blue or ultraviolet light source for illuminating a region in the oral cavity. The system includes a mobile device configured to receive information associated with reflected and autofluorescent light from the region in the oral cavity, as well as a semi-flexible probe that includes a bendable tip; the probe is changeable in shape to allow insertion in the oral cavity and includes a camera that is positioned at a section of its tip to capture the reflected and autofluorescent light. The system enables quick acquisition of high-quality images, and allows remote imaging and diagnosis of suspicious lesions in the oral cavity.
1 . A mobile intraoral imaging system, comprising:
a first plurality of light sources configured to provide white light for illuminating a region in an oral cavity;
a second plurality of light sources configured to provide light in a blue or ultraviolet range of wavelengths for illuminating the region in the oral cavity;
a mobile device comprising a processor and a memory including instructions stored thereon, the instructions upon execution by the processor cause the processor to receive information associated with reflected and autofluorescent light that is received from the region in the oral cavity;
a semi-flexible probe including a tip that is bendable in one or more directions to an angle within a maximum bending range of angles, the semi-flexible probe changeable in shape to allow insertion in the oral cavity, the semi-flexible probe comprising a camera positioned at a section of the tip, the camera configured to capture the reflected and autofluorescent light from the region in the oral cavity, wherein mobile intraoral imaging system is configured to operate in multiple modes of operation that include:
(1) in a dual mode of operation utilizing polarized white light imaging (pWLI) and autofluorescence imaging (AFI);
(2) in whole mouth imaging configuration utilizing a flat backside of the mobile device and an integrated camera that is part of the mobile device, wherein at least one of the first plurality of light sources and at least one of the second plurality of light sources are positioned at the flat backside of the mobile device, and are configured to provide illumination for substantially all of the oral cavity, the flat backside of the mobile device further including a backside longpass filter and a backside analyzer positioned in front of the integrated camera of the mobile device; and
(3) an intraoral imaging configuration that uses the semi-flexible probe to receive the reflected and autofluorescent light that is received from the region in the oral cavity.
2 . The mobile intraoral imaging system of claim 1 , wherein one or more of the first plurality of light sources and the second plurality of light sources are positioned in the tip of the semi-flexible probe.
3 . The mobile intraoral imaging system of claim 1 , wherein the instructions upon execution by the processor cause the processor to display, in real-time, one or more images obtained using the integrated camera of the mobile device, the images corresponding to the whole mouth.
4 . The mobile intraoral imaging system of claim 1 , wherein the camera of the semi-flexible probe includes a fisheye lens with a field of view of 120 degrees.
5 . The mobile intraoral imaging system of claim 1 , wherein the camera of the semi-flexible probe includes an imaging lens and a pixelated sensor, the imaging lens having a diameter that is less than 5 mm.
6 . The mobile intraoral imaging system of claim 1 , comprising a polarizer positioned in front of one or more of the first plurality of light sources to improve a quality of images by reducing or removing specular reflections.
7 . The mobile intraoral imaging system of claim 1 , comprising a shortpass filter in front of one or more of the second plurality of light sources to improve a quality of images obtained from the autofluorescence light.
8 . The mobile intraoral imaging system of claim 1 , wherein the maximum bending range of angles is 90 degrees.
9 . The mobile intraoral imaging system of claim 1 , comprising an analyzer and a longpass filter in front of the camera of the semi-flexible probe to improve a quality of images obtained from the captured reflected and autofluorescence light.
10 . The mobile intraoral imaging system of claim 1 , wherein the semi-flexible probe includes an aluminum stiffener component positioned within a core section of the semi-flexible probe, the aluminum stiffener enabling a bended tip angle to be maintained upon bending the tip to a particular angle.
11 . The mobile intraoral imaging system of claim 1 , wherein a maximum diameter of the semi-rigid probe is 1 cm.
12 . The mobile intraoral imaging system of claim 1 , wherein the semi-flexible probe is coupled to the mobile device through one or more of a wired or a wireless connection to enable reception or transmission of control and data from or to the mobile device.
13 . The mobile intraoral imaging system of claim 1 , wherein the semi-flexible probe includes a probe processor and associated memory to enable image and data processing or transmission of information associated with images captured by the camera of the semi-flexible probe.
14 . The mobile intraoral imaging system of claim 1 , wherein the instructions upon execution by the processor cause the processor to activate a mobile application software, the mobile application software configured to:
process the information associated with reflected and autofluorescent light that is received from the region in the oral cavity to produce one or more associated images.
15 . The mobile intraoral imaging system of claim 1 , further comprising a cloud-based system, wherein the instructions upon execution by the processor cause the processor to activate a mobile application software, the mobile application software configured to communicate at least a portion of the information associated with reflected and autofluorescent light that is received from the region in the oral cavity to the cloud-based system, and to receive diagnosis information or guidance from a remote specialist at the mobile device.
16 . The mobile intraoral imaging system of claim 1 , further including a neural network engine that is configured to receive imaging information associated with the reflected and autofluorescent light, the imaging information including a green channel a red channel and a ratio of red to green channel information, the neural network configured to produce classification and/or identification information associated with the imaging information.
17 . The mobile intraoral imaging system of claim 16 , wherein the neural network is a VGG-CNN-M neural network.
18 . The mobile intraoral imaging system of claim 16 , wherein the neural network is implemented as one or more of the following:
as part of instructions stored on the memory of the mobile device and executable by the mobile device; or
as part of a cloud-based software platform that is configured to receive the imaging information.
19 . The mobile intraoral imaging system of claim 1 , wherein the changeable shape of the semi-rigid probe allows examination of posterior regions of the oral cavity, including a base of tongue, a peritonsillar area or a tonsillar region of oropharynx.
20 . The mobile intraoral imaging system of claim 1 , wherein the mobile device is a mobile phone.
21 . The mobile intraoral imaging system of claim 1 , comprising a circular protrusion at the flat backside of the mobile device and at least partially surrounding the at least one of the first plurality of light sources and the at least one of the second plurality of light sources that are positioned at the flat backside of the mobile device to enable positioning of the flat backside of the mobile device at a patient's open mouth for obtaining whole mouth images.