Imaging support device, scanner system, and imaging support method
An imaging support device that supports imaging of teeth inside an oral cavity is provided. The imaging support device includes an input unit, an identification unit, a specification unit, and an output unit. The input unit receives a tooth image obtained by imaging the teeth inside the oral cavity. The identification unit identifies a type of a tooth based on the tooth image received by the input unit. Based on the type of the tooth identified by the identification unit, the specification unit specifies a type of a tooth as a target for imaging support. The output unit outputs information about the type of the tooth specified by the specification unit to an outside at a prescribed timing.
1. An imaging support device that supports imaging of teeth inside an oral cavity, the imaging support device comprising:
an input unit that receives three-dimensional data including data of the teeth obtained by imaging the teeth inside the oral cavity;
an identification unit that identifies a type of a tooth based on the three-dimensional data;
a specification unit that, based on the type of the tooth identified by the identification unit, specifies a type of a tooth corresponding to a portion of the three-dimensional data that does not exceed a predetermined amount of data as a target for imaging support and predicts a type of a tooth to be imaged next; and
an output unit that outputs, as imaging support, information about the type of the tooth specified by specification unit and the type of the tooth to be imaged next.
2. The imaging support device according to claim 1 , wherein
the specification unit specifies a type of a tooth that needs to be imaged for a user, and
the output unit outputs information about the type of the tooth specified by the specification unit before the user performs imaging.
3. The imaging support device according to claim 2 , wherein, as a type of a tooth that needs to be imaged for the user, the specification unit specifies a type of a tooth for which information obtained from the tooth image fails to satisfy a prescribed criterion.
4. The imaging support device according to claim 1 , wherein
as a type of a tooth that needs to be imaged for a user, the specification unit specifies a type of a tooth that is imaged at a timing at which imaging is stopped, and
the output unit outputs at least one piece of information of:
the type of the tooth specified by the specification unit before a timing at which the user starts imaging; and
a type of a tooth adjacent to the specified type of the tooth.
5. The imaging support device according to claim 4 , wherein the timing at which imaging is stopped is a timing at which the imaging support device receives an imaging stop signal.
6. The imaging support device according to claim 4 , wherein, when a new tooth image is not input to the input unit during a prescribed time period from the timing at which imaging is stopped to the timing at which imaging is started, the output unit outputs information about the specified type of the tooth.
7. The imaging support device according to claim 1 , wherein the imaging support device supports a scanning device that forms an image of a dental arch by joining a plurality of tooth images obtained by scanning and imaging an inside of the oral cavity.
8. The imaging support device according to claim 7 , wherein the output unit outputs information about the type of the tooth specified by the specification unit at a timing at which a prescribed number of teeth are imaged.
9. The imaging support device according to claim 7 , wherein
the input unit receives three-dimensional data corresponding to a three-dimensional image of the dental arch from the scanning device, and
the specification unit specifies a type of a tooth for which information is insufficient in the three-dimensional data input from the input unit.
10. The imaging support device according to claim 7 , wherein the specification unit specifies an overlapping type of a tooth among the tooth images as a type of a tooth used for joining.
11. The imaging support device according to claim 1 , wherein
based on a feature of a tooth corresponding to the tooth image input from the input unit, the identification unit identifies a type of the tooth using an estimation model including a neural network, and
the estimation model is learned based on:
tooth information corresponding to a type of a tooth associated with the tooth image; and
an identification result of the type of the tooth that is obtained using the tooth image.
12. The imaging support device according to claim 11 , wherein
the input unit receives a tooth image including a plurality of teeth, and
the identification unit identifies a type of each of the teeth based on a feature of each of the teeth corresponding to the tooth image.
13. The imaging support device according to claim 11 , wherein the tooth image includes three-dimensional position information at each of points of a tooth.
14. The imaging support device according to claim 11 , wherein the estimation model is learned based on attribute information related to a subject having teeth in addition to the tooth information and the identification result obtained by the identification unit.
15. The imaging support device according to claim 14 , wherein the attribute information includes at least one piece of information of an age, a gender, a race, a height, a weight, and a place of residence about the subject.
16. A scanner system for imaging teeth inside an oral cavity, the scanner system comprising:
a three-dimensional scanner that images the teeth using a three-dimensional camera and acquires three-dimensional data including data of the teeth; and
an imaging support device that
identifies a type of a tooth based on the three-dimensional data, and
gives a notification about the identified type of the tooth, wherein
the imaging support device includes
an input unit that receives the three-dimensional data,
an identification unit that identifies a type of a tooth based on the three-dimensional data,
a specification unit that, based on the type of the tooth identified by the identification unit, specifies a type of a tooth corresponding to a portion of the three-dimensional data that does not exceed a predetermined amount of data as a target for imaging support and predicts a type of a tooth to be imaged next, and
an output unit that outputs, as imaging support, information about the type of the tooth specified by specification unit and the type of the tooth to be imaged next.
17. An imaging support method of supporting imaging of teeth inside an oral cavity, the method comprising:
receiving three-dimensional data including data of the teeth obtained by imaging the teeth inside the oral cavity;
identifying a type of a tooth based on the three-dimensional data;
based on the identified type of the tooth, specifying a type of a tooth corresponding to a portion of the three-dimensional data that does not exceed a predetermined amount of data as a target for imaging support and predicting a type of a tooth to be imaged next; and
outputting, as imaging support, information about the type of the tooth specified by specification unit and the type of the tooth to be imaged next.