IP Library › Granted Patent US 10,188,278
Granted Patent B2
US 10,188,278 · App. 15/905,152 · Granted Jan 29, 2019

Using an intraoral mirror with an integrated camera to record dental status, and applications thereof

Inventors: Gidon Oded Elazar (Cohav Yair, IL); Dan Zidkiahu Harkabi (Moshav Lachish, IL); Joshua Israel Wachspress (Modi'in, IL); Yael Miriam Harkabi (Moshav Lachish, IL)
Assignee: DENTAL SMARTMIRROR, INC.
A61B1/247A61B1/00006A61B1/00009A61B1/00016A61B1/00032A61B1/00034A61B1/00041A61B1/00045A61B1/00087A61B1/00105A61B1/00195A61B1/045A61B1/05A61B1/06A61B1/063A61B1/0607A61B1/0676A61B1/24A61B5/0086A61B5/0088A61B5/061A61B5/065A61B5/067A61C3/00A61C9/0073A61C13/0004A61C13/34A61C19/004F21V33/0068G02B27/144G06F3/023G06F3/0334G06F19/00G06K9/00255G06T3/40G06T3/4038G06T3/60G06T5/009G06T7/0012G06T7/0016G06T7/11G06T17/20H04N5/2252H04N5/2253H04N5/2254H04N5/2256H04N5/2257H04N5/2354H04N5/23238H04N5/23241H04N7/183H05B33/0803H05B33/0842H05B33/0869H05B37/0227A61B1/0684A61B5/0022A61B2560/0456A61B2576/02F21W2131/202G06F19/30G06T7/337G06T2200/32G06T2207/10048G06T2207/10116G06T2207/20208G06T2207/20212G06T2207/30036G06T2210/22G06T2210/41G10L15/265H04N2005/2255
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,188,278
App. No.
15/905,152
Granted
Jan 29, 2019
Kind
B2
Abstract

Disclosed embodiments integrate a camera into an intraoral mirror. Integrating a camera into an intraoral mirror provides an efficient way to record and display what is visible to the healthcare provider in the mirror.

Claims (44)

1. A method for capturing an image representing a patient's dental status, comprising:

(a) receiving (i) a plurality of photographs of an interior of a patient's mouth, and (ii) associated position information for the respective photographs, wherein the plurality of photographs are collected from an image sensor affixed to a dental mirror, wherein the position information is collected relative to a base station capable of docking to the dental mirror, wherein the position information is determined using an accelerometer or gyroscope or both affixed to the dental mirror, wherein the accelerometer or gyroscope or both is calibrated with the dental mirror while docked to the base station, and wherein each one of the plurality of photographs overlap at least in part with another one of the plurality of photographs;

(b) in the overlapping portions, determining features that match between multiple photographs;

(c) based on the associated position information for the respective photographs and the matching features, aligning the plurality of photographs to represent a series of adjacent teeth; and

(d) stitching the plurality of photographs of the interior of the patient's mouth into a panoramic image representing a state of at least a portion of the patient's mouth.

2. The method of claim 1 , wherein the plurality of photographs of the interior of the patient's mouth received in (a) are taken before a dental treatment of the patient's mouth, and further comprising:

(e) receiving (i) another plurality of photographs of the interior of the patient's mouth after the dental treatment, and (ii) associated position information for the respective other photographs, wherein the other plurality of photographs are collected from the image sensor affixed to the dental mirror, and wherein each one of the other plurality of photographs overlap at least in part with another one of the other plurality of photographs;

(f) in the overlapping portions of the other plurality of photographs, determining features that match between multiple photographs received in (e);

(g) based on the associated position information for the respective other photographs and the matching features determined in (f), aligning the other plurality of photographs to represent the series of adjacent teeth; and

(h) stitching the other plurality of photographs of the interior of the patient's mouth into another panoramic image representing another state of at least a portion of the patient's mouth to compare the patient's mouth before and after the dental treatment.

3. The method of claim 1 , further comprising:

(e) adjusting the plurality of photographs of the interior of the patient's mouth to account for variations in brightness between the plurality of photographs such that the panoramic image has a substantially uniform brightness.

4. The method of claim 1 , further comprising:

(e) adjusting the plurality of photographs of the interior of the patient's mouth to account for variations in scale between the plurality of photographs such that the panoramic image proportionally represents the patient's mouth.

5. The method of claim 1 , wherein steps (a)-(d) occur on a server remote from the dental mirror and wherein the receiving (a) comprises receiving the plurality of photographs and associated position information via a computer network.

6. The method of claim 1 , wherein the plurality of photographs of the interior of the patient's mouth are collected during a plurality of different dental visits.

7. The method of claim 1 , further comprising:

(e) associating a point on the panoramic image to another image representing a location that the point represents in the patient's mouth.

8. The method of claim 7 , wherein the other image is an x-ray image.

9. A program storage device tangibly embodying a program of instructions executable by at least one machine to perform a method for capturing an image representing a patient's dental status, comprising:

(a) receiving (i) a plurality of photographs of an interior of a patient's mouth, and (ii) associated position information for the respective photographs, wherein the plurality of photographs are collected from an image sensor affixed to a dental mirror, wherein the position information is collected relative to a base station capable of docking to the dental mirror, wherein the position information is determined using an accelerometer or gyroscope or both affixed to the dental mirror, wherein the accelerometer or gyroscope or both is calibrated with the dental mirror while docked to the base station, and wherein each one of the plurality of photographs overlap at least in part with another one of the plurality of photographs;

(b) in the overlapping portions, determining features that match between multiple photographs;

(c) based on the associated position information for the respective photographs and the matching features, aligning the plurality of photographs to represent a series of adjacent teeth; and

(d) stitching the plurality of photographs of the interior of the patient's mouth into a panoramic image representing a state of at least a portion of the patient's mouth.

10. The program storage device of claim 9 , wherein the plurality of photographs of the interior of the patient's mouth received in (a) are taken before a dental treatment of the patient's mouth, and the method further comprising:

(e) receiving (i) another plurality of photographs of the interior of the patient's mouth after the dental treatment, and (ii) associated position information for the respective other photographs, wherein the other plurality of photographs are collected from the image sensor affixed to the dental mirror, and wherein each one of the other plurality of photographs overlap at least in part with another one of the other plurality of photographs;

(f) in the overlapping portions of the other plurality of photographs, determining features that match between multiple photographs received in (e);

(g) based on the associated position information for the respective other photographs and the matching features determined in (f), aligning the other plurality of photographs to represent the series of adjacent teeth; and

(h) stitching the other plurality of photographs of the interior of the patient's mouth into another panoramic image representing another state of at least a portion of the patient's mouth to compare the patient's mouth before and after the dental treatment.

11. The program storage device of claim 9 , the method further comprising:

(e) adjusting the plurality of photographs of the interior of the patient's mouth to account for variations in brightness between the plurality of photographs such that the panoramic image has a substantially uniform brightness.

12. The program storage device of claim 9 , the method further comprising:

(e) adjusting the plurality of photographs of the interior of the patient's mouth to account for variations in scale between the plurality of photographs such that the panoramic image proportionally represents the patient's mouth.

13. The program storage device of claim 9 , wherein steps (a)-(d) occur on a server remote from the dental mirror and wherein the receiving (a) comprises receiving the plurality of photographs and associated position information via a computer network.

14. The program storage device of claim 9 , wherein the plurality of photographs of the interior of the patient's mouth are collected during a plurality of different dental visits.

15. The program storage device of claim 9 , the method further comprising:

(e) associating a point on the panoramic image to an x-ray image representing the same location in the patient's mouth.

16. A system for capturing an image representing a patient's dental status, comprising:

a processor;

a patient status database that stores historical patient status information including historical panoramic images of a patient's mouth; and

a server, executed on the processor, that receives (i) a plurality of photographs of an interior of the patient's mouth, and (ii) associated position information for the respective photographs, wherein the plurality of photographs are collected from an image sensor affixed to a dental mirror, wherein the position information is collected relative to a base station capable of docking to the dental mirror, wherein the position information is determined using an accelerometer or gyroscope or both affixed to the dental mirror, wherein the accelerometer or gyroscope or both is calibrated with the dental mirror while docked to the base station, and wherein each one of the plurality of photographs overlap at least in part with another one of the plurality of photographs, the server comprising:

a panorama stitcher module that (i) determines features in the overlapping portions that match between multiple photographs, (ii) based on associated position information for the respective photographs and the matching features, aligns the plurality of photographs to represent a series of adjacent teeth, and (iii) stitches the plurality of photographs of the interior of the patient's mouth into a panoramic image representing a state of at least a portion of the patient's mouth.

17. The system of claim 16 , wherein the panorama stitcher module adjusts the plurality of photographs of the interior of the patient's mouth to account for variations in scale between the plurality of photographs such that the panoramic image proportionally represents the patient's mouth.

18. The system of claim 16 , wherein the panorama stitcher module adjusts the plurality of photographs of the interior of the patient's mouth to account for variations in brightness between the plurality of photographs such that the panoramic image has a substantially uniform brightness.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 26, 2018
From: ELAZAR, GIDON ODED; HARKABI, DAN ZIDKIAHU; WACHSPRESS, JOSHUA ISRAEL; HARKABI, YAEL MIRIAM
To: DENTAL SMARTMIRROR, INC.
Reel/Frame 045041/0595 →
Continuity (7)
Continuation 15360479 · Nov 23, 2016
Continuation 15360560 · Nov 23, 2016
Provisional Application 62354694 · Jun 25, 2016
Provisional Application 62354273 · Jun 24, 2016
Provisional Application 62343034 · May 30, 2016
Provisional Application 62341629 · May 26, 2016
Related Publication 20180184891A1 · Jul 5, 2018