Head-mounted display control apparatus, method for controlling head-mounted display control apparatus, and non-transitory computer readable storage medium
A head-mounted display control apparatus includes one or more circuits, or one or more processors and at least one memory, the at least one memory being coupled to the one or more processors and having stored thereon instructions executable by the one or more processors. At least one of the one or more circuits or the execution of the instructions causes the head-mounted display control apparatus to function as an image capturing unit configured to capture an image; and a control unit configured to, based on phone call reception information, phone conversation information, or message reception information, perform control to display the captured image or a virtual space image on a display unit.
1 . A head-mounted display control apparatus that is in communication with an external apparatus comprising:
at least one camera that captures images of a real space;
at least one memory having stored thereon instructions;
one or more processors that executes the stored instructions and is configured to:
receive information output by the external apparatus and determine if the output information represents any of phone call reception information, phone conversation information, or message reception information; and
perform control to display, on a display of the head-mounted display, a selection screen within virtual space image that (i) includes options for starting or refusing a phone call, and switching ON or OFF a video see-through mode, and (ii) controls the at least one camera to begin capture images of real space and suspend an application that is rendering the virtual space image.
2 . The head-mounted display control apparatus according to claim 1 , wherein execution of the stored instructions further configures the one or more processors to:
when it is determined that the received information output by the external apparatus is not a phone call or is not a phone conversation being performed, perform control to display the virtual space image on the display of the head-mounted display, and
when it is determined that the received information output by the external apparatus indicates a phone call is being received or a phone conversation is being performed, and a selection from within the selection screen is made to cause capturing of the real space image, perform control to display the captured real space image on the display of the head-mounted display.
3 . The head-mounted display control apparatus according to claim 1 , wherein execution of the stored instructions further configures the one or more processors to:
when it is determined that the received information output by the external apparatus is not a phone call is being received or is not a phone conversation being performed, perform control to display the virtual space image on the display of the head-mounted display, and
when it is determined that the received information output by the external apparatus indicates a phone call is being received or a phone conversation is being performed, perform control to display the captured image and the virtual space image on the display of the head-mounted display.
4 . The head-mounted display control apparatus according to claim 1 , wherein execution of the stored instructions further configures the one or more processors to:
when it is determined that the received information output by the external apparatus indicates that no message is received, perform control to display the virtual space image on the display of the head-mounted display, and
when it is determined that the received information output by the external apparatus indicates a message is received, perform control to display the captured image on the display of the head-mounted display for a predetermined period.
5 . The head-mounted display control apparatus according to claim 1 , wherein execution of the stored instructions further configures the one or more processors to:
when it is determined that the received information output by the external apparatus indicates that no message is received, perform control to display the virtual space image on the display of the head-mounted display, and
when it is determined that the received information output by the external apparatus indicates that a message is received, perform control to display the captured image and the virtual space image on the display of the head-mounted display for a predetermined period.
6 . The head-mounted display control apparatus according to claim 1 , wherein execution of the stored instructions further configures the one or more processors to:
when a person different from a person wearing the head-mounted display control apparatus is present within a predetermined range,
perform control to display the captured image or the virtual space image on the display of the head-mounted display, based on the phone call reception information, the phone conversation information, or the message reception information.
7 . The head-mounted display control apparatus according to claim 1 , wherein execution of the stored instructions further configures the one or more processors to:
acquire the phone call reception information, the phone conversation information, or the message reception information from an external apparatus.
8 . The head-mounted display control apparatus according to claim 1 , wherein execution of the stored instructions further configures the one or more processors to determine that the received information from the external apparatus represents any of phone call reception information, phone conversation information, or message reception information based on a phone call reception sound or a message reception sound sensed by a sensor of the head mount display and perform control to display the selection screen on the display of the head mount display.
9 . The head-mounted display control apparatus according to claim 8 , wherein the phone call reception sound or the message reception sound is a phone call reception sound or a message reception sound collected by a microphone.
10 . The head-mounted display control apparatus according to claim 2 , wherein execution of the stored instructions further configures the one or more processors to:
when it is determined that the received information output by the external apparatus indicates that a phone call is being received or a phone conversation is being performed, and an instruction is provided via the selection screen, perform control to display the captured image on the display of the head-mounted display, and
when it is determined that the received information output by the external apparatus indicates that a phone call is being received or a phone conversation is being performed, and no instruction is provided via the selection screen, perform control to display the virtual space image on the display of the head-mounted display.
11 . The head-mounted display control apparatus according to claim 10 , wherein execution of the stored instructions further configures the one or more processors to:
when it is determined that the received information output by the external apparatus indicates that a phone call is being received or a phone conversation is being performed, perform control to display an instruction button on the selection screen being displayed such that the instruction button is superimposed on the virtual space image,
when it is determined that the received information output by the external apparatus indicates that a phone call is being received or a phone conversation is being performed, and an operation instruction for the instruction button is provided via the selection screen, perform control to display the captured image on the display of the head-mounted display, and
when it is determined that the received information indicates that a phone call is being received or a phone conversation is being performed, and no operation instruction for the instruction button is provided via the selection screen, perform control to display the virtual space image on the display of the head-mounted display.
12 . The head-mounted display control apparatus according to claim 3 , execution of the stored instructions further configures the one or more processors to:
when it is determined that the received information output by the external apparatus indicates that a phone call is being received or a phone conversation is being performed, and an instruction is provided via the selection screen, perform control to display the captured image and the virtual space image on the display of the head-mounted display, and
when it is determined that the received information output by the external apparatus indicates that a phone call is being received or a phone conversation is being performed, and no instruction is provided via the selection screen, perform control to display the virtual space image on the display of the head-mounted display.
13 . The head-mounted display control apparatus according to claim 12 , wherein
execution of the stored instructions further configures the one or more processors to:
when it is determined that the received information output by the external apparatus indicates that a phone call is being received or a phone conversation is being performed, perform control to display an instruction button on the selection screen being displayed such that the instruction button is superimposed on the virtual space image,
when it is determined that the received information output by the external apparatus indicates that a phone call is being received or a phone conversation is being performed, and an operation instruction for the instruction button is provided via the selection screen, perform control to display the captured image and the virtual space image on the display unit, and
when a phone call is being received or a phone conversation is being performed, and no operation instruction for the instruction button is provided, perform control to display the virtual space image on the display unit.
14 . A method for controlling a head-mounted display control apparatus that is in communication with an external apparatus, comprising:
capturing, via at least one camera of the head-mounted display control apparatus, an image of real-space; and
receiving information output by the external apparatus;
determining if the output information represents any of a phone call reception information, phone conversation information, or message reception information;
performing control to display, on a display of the head-mounted display, a selection screen within a virtual space image that (i) includes options for starting or refusing a phone call, and switching ON or OFF a video see-through mode, and (ii) controls the at least one camera to begin capturing images of real space and suspend an application that is rendering the virtual space image.
15 . A non-transitory computer readable storage medium storing instructions that, when executed by one or more processors of a head-mounted display control apparatus that is in communication with an external apparatus, configures the head-mounted display control apparatus to execute a process of:
capturing, via at least one camera of the head-mounted display control apparatus, an image of real-space; and
receiving information output by the external apparatus;
determining if the output information represents any of a phone call reception information, phone conversation information, or message reception information;
performing control to display, on a display of the head-mounted display, a selection screen within a virtual space image that (i) includes options for starting or refusing a phone call, and switching ON or OFF a video see-through mode, and (ii) controls the at least one camera to begin capturing images of real space and suspend an application that is rendering the virtual space image.