Diagnosis supporting device and method of supporting diagnosis
A display, imaging units that capture a subject, an eye gaze detector that detects an eye gaze direction of the subject, from the captured image captured by the imaging units, a gaze point detector that detects a gaze point of the subject in a display region of the display, based on the eye gaze direction, an output controller that displays any of a plurality of diagnosis images on the display, selects the diagnosis image to be displayed next according to a position of the gaze point detected when the diagnosis image is displayed, from the plurality of diagnosis images, and further displays the selected diagnosis image on the display, and an evaluator that calculates an evaluation value of the subject, based on the gaze point detected by the gaze point detector when the diagnosis image is displayed.
1. A diagnosis supporting device comprising:
a display;
a stereo camera configured to capture an image of a subject;
an eye gaze detector configured to detect an eye gaze direction of the subject, from the image captured by the stereo camera;
a gaze point detector configured to detect a gaze point of the subject in a display region of the display based on the eye gaze direction;
an output controller configured to
display any of a plurality of diagnosis images on the display,
select a diagnosis image, of the plurality of diagnosis images, to be displayed next according to a position of the gaze point detected when the diagnosis image is displayed, and
display the diagnosis image on the display; and
an evaluator configured to calculate, for the respective diagnosis images, an evaluation value of the subject that corresponds to a degree of a development disorder and a ratio of looking at a predetermined region within the diagnosis image based on the gaze point detected by the gaze point detector when the diagnosis image is displayed,
wherein
each of the plurality of diagnosis images belongs to one out of a plurality of groups, and
the output controller selects,
when the diagnosis image belonging to a first group, of the plurality of groups, which includes similar diagnosis images used to calculate a similar evaluation value is displayed, and, further,
when a ratio of positions of the gaze point indicates that a number of the gaze points detected in a predetermined region in the diagnosis image and in a predetermined period is equal to or greater than a predetermined threshold,
another diagnosis image belonging to the first group as the diagnosis image to be displayed next, and
when the ratio of the positions of the gaze point indicates that the number of the gaze point detected in the predetermined region in the diagnosis image and in the predetermined period is less than the predetermined threshold,
a diagnosis image belonging to a second group, of the plurality of groups, that is different than the first group as the diagnosis image to be displayed next,
wherein the ratio is a ratio of the number of gaze points detected in the predetermined region to a total number of the detected gaze points, or a ratio of a total time in which the gaze point is detected within the predetermined region to a total time in which the gaze point is detected.
2. The diagnosis supporting device according to claim 1 , wherein
the diagnosis image includes an image of a person and an image of a geometrical pattern,
the first group includes a first diagnosis image and a second diagnosis image in which a position of the image of the person and a position of the image of the geometrical pattern are symmetrical about a line that passes through a vicinity of a center of the diagnosis image in an up and down direction, and
the output controller selects, according to the position of the gaze point detected when the first diagnosis image classified into the first group is displayed, one of the second diagnosis image or the diagnosis image classified in the second group as the diagnosis image to be displayed next.
3. The diagnosis supporting device according to claim 1 , further comprising:
an illuminator including a light source that performs irradiation of light;
a target position provided on the display;
a position detector configured to calculate a first position indicating a center of a pupil and a second position indicating a center of a corneal reflection, from an image of an eye ball of the subject irradiated with the light by the illuminator and captured by the stereo camera; and
a calculator configured to calculate a third position indicating a curvature center of a cornea as an intersection point of a straight line that connects the first position and the target position, and a straight line that connects the second position and a position of the light source, wherein
the eye gaze detector detects an eye gaze of the subject based on the first position and the third position.
4. The diagnosis supporting device according to claim 1 , wherein
the output controller is configured to, when the ratio of the positions of the gaze point not included in the predetermined region is equal to or greater than than the predetermined threshold in a last diagnosis image included in the first group, select a diagnosis image from the second group to be displayed next.
5. A method of supporting diagnosis, the method comprising:
an eye gaze detection step of detecting an eye gaze direction of a subject from a captured image captured by a stereo camera that captures the subject;
a gaze point detection step of detecting a gaze point of the subject in a display region of a display based on the eye gaze direction;
an output control step of displaying any of a plurality of diagnosis images on the display, selecting a diagnosis image, of the plurality of diagnosis images, to be displayed next according to a position of the gaze point detected when the diagnosis image is displayed, and displaying the selected diagnosis image on the display; and
an evaluation step of calculating, for the respective diagnosis images, an evaluation value of the subject that corresponds to a degree of a developmental disorder and a ratio of looking at a predetermined region within the diagnosis image based on the gaze point detected in the gaze point detection step when the diagnosis image is displayed, wherein
each of the plurality of diagnosis images belongs to one of a plurality of groups, and
the output control step selects,
when the diagnosis image belonging to a first group which includes similar diagnosis images used to calculate a similar evaluation value is displayed, and, further,
when a ratio of positions of the gaze point indicates that a number of the gaze points detected in a predetermined region in the diagnosis image and in a predetermined period is equal to or greater than a predetermined threshold,
another diagnosis image belonging to the first group as the diagnosis image to be displayed next, and
when the ratio of positions of the gaze point indicates that the number of the gaze point detected in the predetermined region in the diagnosis image and in the predetermined period is less than the predetermined threshold,
a diagnosis image belonging to a second group, of the plurality of groups, different from the first group as the diagnosis image to be displayed next, wherein
the ratio is a ratio of the number of gaze points detected in the predetermined region to a total number of the detected gaze points, or a ratio of a total time in which the gaze point is detected within the predetermined region to a total time in which the gaze point is detected.
6. The method of supporting diagnosis according to claim 5 , wherein
the output control step selects a diagnosis image to be displayed next included in the second group if the ratio of the positions of the gaze point not included in the predetermined region is equal to or greater than than the predetermined threshold in a last diagnosis image included in the first group.