Portable terminal that is connected to a headmounted display to display information in cooperation
In a cooperative display system that connects a portable terminal and a head mounted display to display information in cooperation, the portable terminal displays information on a first display, and transmits at least a part of the information that is displayed to the head mounted display, and the head mounted display shares and displays the information transmitted from the portable terminal on a second display. Here, the information displayed on the portable terminal is hierarchical information, and the information displayed on the head mounted display is lower-level information in the hierarchical information. In addition, whether a user is stationary or moving is detected by a sensor of the portable terminal, and in a case where the user is stationary, the display of the information on the portable terminal is stopped, and the information is displayed only on the head mounted display.
1 . A portable terminal that is connected to a head mounted display to display information in cooperation, the portable terminal comprising:
a display;
a memory configured to store information displayed on the display;
an external equipment interface configured to perform transmission and reception of information with respect to the head mounted display;
a sensor configured to detect a state of the portable terminal;
a camera; and
a controller,
wherein the controller is configured to:
determine whether a user of the portable terminal is moving based on a detection result from the sensor;
display the information stored in the memory on the display when determining that the user is moving;
control the camera to capture an image around the user of the portable terminal when determining that the user is not moving;
determine whether at least one person other than the user of the portable terminal is included in the image around the user captured by the camera; and
display the information stored in the memory on the display when determining the at least one person other than the user is not included in the image.
2 . The portable terminal according to claim 1 ,
wherein, when determining that the user is not moving and that the at least one person other than the user is included in the image, the controller is configured to stop displaying the information on the display, and transmit at least part of the information displayed on the display to the head mounted display using the external equipment interface.
3 . The portable terminal according to claim 2 ,
wherein the information displayed on the display is hierarchical information, and
wherein the at least part of the information is lower-level information in the hierarchical information.
4 . The portable terminal according to claim 2 ,
wherein the sensor is a position sensor or an acceleration sensor or a gyroscope, and
wherein the controller is configured to inform people around the portable terminal that the camera is being operated when the camera is capturing the image around the user.
5 . The portable terminal according to claim 2 ,
wherein the information stored in the memory is a log recording a use of an application of the portable terminal.
6 . The portable terminal according to claim 1 ,
wherein the controller is configured to:
detect an angle of a direction of a face of the at least one person other than the user with respect to the display when determining that the at least one person other than the user is included in the image;
determine whether the detected angle is greater than or equal to a viewing angle of the display; and
when determining that the user is not moving and that the detected angle is less than the viewing angle of the display, stop displaying the information on the display, and transmit at least part of the information displayed on the display to the head mounted display using the external equipment interface.
7 . The portable terminal according to claim 6 ,
wherein the sensor is a position sensor or an acceleration sensor or a gyroscope, and
wherein the controller is configured to inform people around the portable terminal that the camera is being operated when the camera is capturing the image around the user.
8 . The portable terminal according to claim 6 ,
wherein the information displayed on the display is hierarchical information, and
wherein the at least part of the information is lower-level information in the hierarchical information.
9 . The portable terminal according to claim 6 ,
wherein the information stored in the memory is a log recording a use of an application of the portable terminal.
10 . The portable terminal according to claim 1 ,
wherein the controller is configured to inform people around the portable terminal that the camera is being operated when the camera is capturing the image around the user.
11 . The portable terminal according to claim 1 ,
wherein, when determining that the user is not moving and that the at least one person other than the user is included in the image, the controller is configured to stop displaying the information on the display, and transmit additional information with respect to the information displayed on the display to the head mounted display using the external equipment interface.
12 . The portable terminal according to claim 11 ,
wherein the sensor is a position sensor or an acceleration sensor or a gyroscope, and
wherein the controller is configured to inform people around the portable terminal that the camera is being operated when the camera is capturing the image around the user.
13 . The portable terminal according to claim 11 ,
wherein the information stored in the memory is a log recording a use of an application of the portable terminal.
14 . The portable terminal according to claim 1 , further comprising a touch sensor,
wherein the controller is configured to:
detect a touch operation of the user with respect to an item of the information displayed on the display using the touch sensor; and
when determining that the user is not moving and that the at least one person other than the user is included in the image, stop displaying the information on the display, and transmit detailed information of the detected item to the head mounted display using the external equipment interface.
15 . The portable terminal according to claim 14 ,
wherein the sensor is a position sensor or an acceleration sensor or a gyroscope, and
wherein the controller is configured to inform people around the portable terminal that the camera is being operated when the camera is capturing the image around the user.
16 . The portable terminal according to claim 1 , further comprising an in-camera,
wherein the controller is configured to:
detect a visual line direction of the user with respect to an item of the information displayed on the display using the in-camera; and
when determining that the user is not moving and that the at least one person other than the user is included in the image, stop displaying the information on the display, and transmit detailed information of the detected item to the head mounted display using the external equipment interface.
17 . The portable terminal according to claim 16 ,
wherein the sensor is a position sensor or an acceleration sensor or a gyroscope, and
wherein the controller is configured to inform people around the portable terminal that the camera is being operated when the camera is capturing the image around the user.
18 . The portable terminal according to claim 1 ,
wherein the information stored in the memory is a log recording a use of an application of the portable terminal.
19 . The portable terminal according to claim 1 , wherein the sensor is a position sensor or an acceleration sensor or a gyroscope.