Information processing device and information processing method

1. An information processing device, comprising:

a central processing unit (CPU) configured to:

control a display device to project a plurality of content images duplicated from a single content image towards eyeballs of a wearer, wherein

the display device has optical transparency, and

each of the plurality of content images includes an operation object that corresponds to a real object in a real world;

detect a gesture operation of the wearer on the plurality of content images viewed by the wearer;

measure three-dimensional coordinates of the detected gesture operation;

estimate three-dimensional coordinates of the real object based on the measured three-dimensional coordinates of the detected gesture operation;

compare the estimated three-dimensional coordinates of the real object with three-dimensional coordinates of the operation object;

detect, based on the comparison of the estimated three-dimensional coordinates of the real object with the three-dimensional coordinates of the operation object, a wearing state of the wearer with respect to the display device, wherein

the wearing state corresponds to a positional relationship between the eyeballs of the wearer and eyeboxes,

the eyeboxes are areas in which the plurality of content images is projected, and

the eyeboxes are between the eyeballs of the wearer and the display device;

determine a mounting misalignment of the display device with the wearer based on the detected wearing state; and

control, based on the determined mounting misalignment, the display device to display a notification regarding the mounting misalignment.

2. The information processing device according to claim 1 , wherein

the CPU is further configured to measure, based on a sensing result of a sensor that senses a surrounding environment of the display device, the three-dimensional coordinates of the detected gesture operation, and

the sensor is at the display device.

3. The information processing device according to claim 2 , wherein the CPU is further configured to determine the mounting misalignment in a case where a distance between the measured three-dimensional coordinates of the detected gesture operation and the three-dimensional coordinates of the operation object exceeds a threshold value.

4. The information processing device according to claim 3 , wherein the CPU is further configured to:

correct display positions of the plurality of content images with respect to the detected gesture operation at a time of default setting; and

the mounting misalignment in a case where a relationship between the detected gesture operation and the display positions of the plurality of content images changes by more than a specific value after the correction.

5. The information processing device according to claim 4 , wherein the CPU is further configured to set, at the time of the default setting, the threshold value based on the detected gesture operation and the display positions of the plurality of content images.

6. The information processing device according to claim 4 , wherein the CPU is further configured to correct the display positions of the plurality of content images based on the mounting misalignment.

7. The information processing device according to claim 1 , wherein the CPU is further configured to:

detect the wearing state each time the operation object is displayed; and

determine the mounting misalignment each time the wearing state is detected.

8. The information processing device according to claim 1 , wherein

the CPU is further configured to control the display device to blur the plurality of content images, and

the blurred plurality of content images corresponds to the notification regarding the mounting misalignment.

9. The information processing device according to claim 8 , wherein the CPU is further configured to increase level of the blur of the plurality of content images based on an increase in a degree of the mounting misalignment.

10. The information processing device according to claim 1 , wherein

the CPU is further configured to control the display device to display an axis image as the notification regarding the mounting misalignment, and

the axis image indicates a misalignment from a reference axis caused by the mounting misalignment.

11. The information processing device according to claim 1 , wherein the CPU is further configured to control the display device to display a warning image as the notification regarding the mounting misalignment.

12. The information processing device according to claim 1 , wherein the CPU is further configured to control output of a specific sound based on the mounting misalignment.

13. An information processing method, comprising:

controlling a display device to project a plurality of content images duplicated from a single content image towards eyeballs of a wearer, wherein

the display device has optical transparency, and

each of the plurality of content images includes an operation object that corresponds to a real object in a real world;

detecting a gesture operation of the wearer on the plurality of content images viewed by the wearer;

measuring three-dimensional coordinates of the detected gesture operation;

estimating three-dimensional coordinates of the real object based on the measured three-dimensional coordinates of the detected gesture operation;

comparing the estimated three-dimensional coordinates of the real object with three-dimensional coordinates of the operation object;

detecting, based on the comparison of the estimated three-dimensional coordinates of the real object with the three-dimensional coordinates of the operation object, a wearing state of the wearer with respect to the display device, wherein

the wearing state corresponds to a positional relationship between the eyeballs of the wearer and eyeboxes,

the eyeboxes are areas in which the plurality of content images is projected, and

the eyeboxes are between the eyeballs of the wearer and the display device;

determining a mounting misalignment of the display device with the wearer based on the detected wearing state; and

controlling, based on the determined mounting misalignment, the display device to display a notification regarding the mounting misalignment.

14. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

controlling a display device to project a plurality of content images duplicated from a single content image towards eyeballs of a wearer, wherein

the display device has optical transparency, and

each of the plurality of content images includes an operation object that corresponds to a real object in a real world;

detecting a gesture operation of the wearer on the plurality of content images viewed by the wearer;

measuring three-dimensional coordinates of the detected gesture operation;

estimating three-dimensional coordinates of the real object based on the measured three-dimensional coordinates of the detected gesture operation;

comparing the estimated three-dimensional coordinates of the real object with three-dimensional coordinates of the operation object;

detecting, based on the comparison of the estimated three-dimensional coordinates of the real object with the three-dimensional coordinates of the operation object, a wearing state of the wearer with respect to the display device, wherein

the wearing state corresponds to a positional relationship between the eyeballs of the wearer and eyeboxes,

the eyeboxes are areas in which the plurality of content images is projected, and

the eyeboxes are between the eyeballs of the wearer and the display device;

determining a mounting misalignment of the display device with the wearer based on the detected wearing state; and

controlling, based on the determined mounting misalignment, the display device to display a notification regarding the mounting misalignment.