Controlling VR/AR headsets

1 . An apparatus comprising:

a headset, wherein the headset is a virtual reality and/or augmented reality capable headset; and

a sensor arrangement,

wherein the sensor arrangement is arranged to image a real environment,

wherein the sensor arrangement is arranged to determine a facing direction,

wherein the facing direction is the direction in which a user is facing,

wherein the headset is arranged to display a virtual scene,

wherein the headset is arranged to provide corresponding virtual audio to the user in a virtual mode,

wherein the headset is arranged to show the real environment,

wherein the headset is arranged to provide corresponding real audio to the user in a local mode;

wherein the headset is arranged to display a portion of the virtual scene and a portion of the real environment to the user in a transition mode,

wherein the headset is arranged to switch from the virtual mode to the local mode in response to a detection of a real person and based on the position of the real person, the facing direction, the angle between a first direction in which the real person is detected and the facing direction,

wherein switching from the virtual mode to the local mode comprises:

switching from the virtual mode to the transition mode if the angle between the first direction and the facing direction is between a first threshold and a second, threshold; and

switching from the transition mode to the local mode if the angle between the first direction and the facing direction is smaller than the first threshold.

2 . The apparatus of claim 1 , wherein a ratio between the portion of the virtual scene displayed to the user and the portion of the real environment displayed to the user, in the transition mode is base on the angle between the first direction and the facing direction.

3 . The apparatus of claim 1 ,

wherein the headset is arranged to identify a common reference object,

wherein the common reference object appears in both the virtual scene and the real environment at a reference direction from the user,

wherein the headset is arranged to stitch the virtual scene and the real environment, as captured by the sensor arrangement, around the common reference object so as to generate a transition image; and

wherein the headset is arranged to display the transition image in the transition mode.

4 . The apparatus of claim 1 ,

wherein the virtual scene comprises a virtual object at a second direction relative to the user,

wherein the headset is arranged to switch from the virtual mode to the local mode if the angle between the second direction and the facing direction is larger than a third threshold.

5 . The apparatus of claim 1 ,

wherein the virtual scene comprises a virtual object at a second direction relative to the user,

wherein the first threshold is based on the angle between the second direction and the facing direction.

6 . The apparatus of claim 5 , wherein the headset is arranged to switch from the virtual mode to the local mode if the angle between the second direction and the facing direction is larger than a third threshold angle.

7 . The apparatus of claim 1 ,

wherein the headset is arranged to determine the color characteristics of the real environment as imaged by the sensor arrangement,

wherein the headset is arranged to change the virtual scene based on the color characteristics of the real environment.

8 . A method comprising:

displaying a virtual scene on a headset, wherein the headset is a virtual reality and/or augmented reality capable headset;

providing corresponding virtual audio to a user in a virtual mode;

showing a real environment;

providing corresponding real audio to the user in a local mode;

displaying a portion of the virtual scene and a portion of the real environment to the user in a transition mode; and

switching from the virtual mode to the local mode in response to a detection of a real person and based on the position of the real person, a facing direction, the angle between a first direction in which the real person is detected and the facing direction wherein the facing direction is the direction in which a user is facing;

wherein switching from the virtual mode to the local mode comprises:

switching from the virtual mode to the transition mode if the angle between the first direction and the facing direction is between a first threshold and a second, threshold; and

switching from the transition mode to the local mode if the angle between the first direction and the facing direction is smaller than the first threshold.

9 . The method of claim 8 , wherein a ratio between the portion of the virtual scene displayed to the user and the portion of the real environment displayed to the user, in the transition mode is base dependent on the angle between the first direction and the facing direction.

10 . The method of claim 8 , further comprising:

identifying a common reference object, wherein the common reference object appears in both the virtual scene and the real environment at a reference direction from the user;

stitching the virtual scene and the real environment, as captured by a sensor arrangement, around the common reference object so as to generate a transition image; and

displaying the transition image in the transition mode.

11 . The method of claim 8 , further comprising switching from the virtual mode to the local mode if the angle between the second direction and the facing direction is larger than a third threshold angle, wherein the virtual scene comprises a virtual object at a second direction relative to the user.

12 . A non-transitory computer-readable medium storing a computer program, wherein the computer program when executed on a processor performs the method as claimed in claim 8 .

13 . The method of claim 8 ,

wherein the virtual scene comprises a virtual object at a second direction relative to the user,

wherein the first threshold angle is based on the angle between the second direction and the facing direction.

14 . The method of claim 13 , further comprising switching from the virtual mode to the local mode if the angle between the second direction and the facing direction is larger than a third threshold angle.

15 . The method of claim 8 , further comprising:

determining the color characteristics of the real environment as imaged by the sensor arrangement; and

changing the virtual scene based on the color characteristics of the real environment.