Display system, control program for information processor, and control method for information processor that are configured to adjust display of a first image on a first display unit based on the position of a second display unit
It is provided that a display system including a HMD and a smartphone connected to the HMD, wherein the HMD configured to visually recognize an external scene and display a first image overlapping the external scene, the smartphone includes a display panel configured to display a second image, a touch sensor arranged at the display panel, a first determination unit configured to determine whether the display panel is facing the HMD, a detection unit configured to detect a position of the display panel with respect to the HMD, a second determination unit configured to determine whether the position of the display panel is included in the first image, and an adjustment unit configured to adjust display of the first image on an image display unit based on a determination result of the first determination unit and a determination result of the second determination unit.
1. A display system comprising:
a display device mounted on a head of a user; and
an information processor to which the display device is coupled, wherein the display device includes:
a first display unit configured to visually recognize an external scene and display a first image overlapping the external scene; and
a first processor configured to display the first image on the first display unit,
the information processor includes:
a second display unit configured to display a second image;
a position sensor arranged at the second display unit, and configured to receive a position input operation to detect coordinates of an operating position; and
a second processor configured to:
determine whether the second display unit is facing the display device;
detect a position of the second display unit with respect to the display device;
determine whether the position of the second display unit with respect to the display device is included in the first image visually recognized by the first display unit; and
adjust display of the first image on the first display unit by always removing a part of the first image that overlaps the second image such that the second image is spaced from the first image based on a determination result of whether the second display unit is facing the display device and a determination result of whether the position of the second display unit with respect to the display device is included in the first image visually recognized by the first display unit;
acquire a distance between the second display unit and the display device;
determine that the second display unit is not facing the display device when:
the second processor determines that the distance is greater than a threshold distance, and
the second display unit is positioned within a field of view of the user and the display device is positioned in a normal direction of a display surface of the second display unit; and
determine that the second display unit is not facing the display device when the second display unit is either not positioned within the field of view of the user or the display device is not positioned in the normal direction of the display surface of the second display unit.
2. The display system according to claim 1 , wherein
the display device includes a camera configured to capture the external scene, and
the second processor is configured to determine, based on an image captured by the camera, whether the second display unit of the information processor is facing the display device.
3. The display system according to claim 1 , wherein
the first processor configured to detect a line-of-sight direction of the user, and
the second processor is configured to determine, based on a detection result of the first processor regarding detection of the line-of-sight direction of the user, whether the second display unit of the information processor is facing the display device.
4. The display system according to claim 1 , wherein
the information processor includes an infrared ray emitter configured to emit an infrared ray,
the display device includes an infrared ray receiver configured to receive the infrared ray, and
the second processor is configured to determine, based on a receiving result of the infrared ray receiver, whether the second display unit of the information processor is facing the display device.
5. The display system according to claim 4 , wherein
the infrared emitter emits the infrared ray in a normal direction of a display surface of the second display unit.
6. The display system according to claim 1 , wherein
the display device includes a distance sensor configured to detect a distance, and
the second processor is configured to determine, based on a distance between the display device and the second display unit detected by the distance sensor, whether the second display unit is facing the display device.
7. The display system according to claim 1 , wherein
the second processor is configured to adjust the display of the first image on the first display unit when the second processor determines that the second display unit is facing the display device, and the second processor determines that the position of the second display unit with respect to the display device is included in the first image visually recognized by the first display unit.
8. The display system according to claim 7 , wherein
the second processor is configured to reduce a density of an image corresponding to a position of the second display unit in the first image on the first display unit.
9. The display system according to claim 7 , wherein
the second processor is configured to adjust the display of the first image on the first display unit such that the position of the second display unit is not included in the first image.
10. The display system according to claim 9 , wherein
the second processor is configured to hide at least a part of the first image on the first display unit such that the position of the second display unit is not included in the first image.
11. The display system according to claim 9 , wherein
the second processor is configured to move a display position of the first image on the first display unit such that the position of the second display unit is not included in the first image.
12. The display system according to claim 9 , wherein
the second processor is configured to reduce and display the first image such that the position of the second display unit is not included in the first image.
13. The display system of claim 1 , wherein
the second processor is configured to:
display the second image on the second display unit; and
transmit data indicating the first image to the display device, and
the second image matches the first image.
14. A non-transitory computer-readable storage medium storing a control program for an information processor, the information processor, to which a display device mounted on a head of a user including a first display unit configured to visually recognize an external scene and display a first image overlapping the external scene is coupled, including a second display unit configured to display a second image, a position sensor arranged at the second display unit, and a computer, wherein
the control program causes the computer to function as a processor configured to:
determine whether the second display unit is facing the display device;
detect a position of the second display unit of the information processor with respect to the display device;
determine whether the position of the second display unit with respect to the display device is included in the first image displayed on the first display unit;
adjust display of the first image on the first display unit by always removing a part of the first image that overlaps the second image such that the second image is spaced from the first image, based on a determination result of whether the second display unit is facing the display device and a determination result of whether the position of the second display unit with respect to the display device is included in the first image displayed on the first display unit;
acquire a distance between the second display unit and the display device;
determine that the second display unit is not facing the display device when:
the second processor determines that the distance is greater than a threshold distance, and
the second display unit is positioned within a field of view of the user and the display device is positioned in a normal direction of a display surface of the second display unit; and
determine that the second display unit is not facing the display device when the second display unit is either not positioned within the field of view of the user or the display device is not positioned in the normal direction of the display surface of the second display unit.
15. A control method for an information processor, to which a display device mounted on a head of a user including a first display unit configured to visually recognize an external scene and display a first image overlapping the external scene is coupled, including a second display unit configured to display a second image, a position sensor arranged at the second display unit, and a computer, wherein
the control method comprises:
a first determination step for determining whether the second display unit is facing the display device;
a detection step for detecting a position of the second display unit of the information processor with respect to the display device;
a second determination step for determining whether the position of the second display unit with respect to the display device is included in the first image displayed on the first display unit;
an adjustment step for adjusting display of the first image on the first display unit by always removing a part of the first image that overlaps the second image such that the second image is spaced from the first image, based on a determination result of the first determination step and a determination result of the second determination step;
an acquiring step for acquiring a distance between the second display unit and the display device;
a third determination step for determining that the second display unit is not facing the display device when:
the distance is greater than a threshold distance, and
the second display unit is positioned within a field of view of the user and the display device is positioned in a normal direction of a display surface of the second display unit; and
a fourth determination step for determining that the second display unit is not facing the display device when the second display unit is either not positioned within the field of view of the user or the display device is not positioned in the normal direction of the display surface of the second display unit.