Camera based safety mechanisms for users of head mounted displays
View Patent ↗The disclosure provides methods and systems for warning a user of a head mounted display during gameplay of a video game. A game is executed causing interactive scenes of the game to be rendered on a display portion of a head mounted display (HMD) worn by a user. A change in position of the HMD worn by the user, while the user is interacting with the game, is detected. The change in position is evaluated, the evaluation causing a signal to be generated when the change exceeds a pre-defined threshold value. When the signal is generated, content is sent to interrupt the interactive scenes being rendered on the display portion of the HMD. The data sent provides descriptive context for the signal.
1. A method, comprising:
executing a game, the execution causing interactive scenes of the game to be rendered on a display portion of a head mounted display (HMD) worn by a user, the HMD when worn by the user is configured to block a view to a real-world environment;
determining coordinates of the HMD in a three-dimensional space of the real-world environment, the coordinates used to identify a current position of the user wearing the HMD;
monitoring a movement of the HMD during execution of the game, the movement of the HMD determined by identifying a change in one or more coordinates of the HMD in the three-dimensional space;
evaluating the change in the one or more coordinates of the HMD worn by the user to determine when the user is approaching a physical object present in the real-world environment;
blending in an image of the physical object with the interactive scenes when the evaluating determines that the user continues to approach the physical object; and
fading out the image of the physical object when the evaluating determines that the user is moving away from the physical object,
wherein the method operations are performed by a processor.
2. The method of claim 1 , further comprising,
determining a position of the physical object in the real-world environment using a depth sensing device that collects data usable to map depth information of the real-world environment.
3. The method of claim 2 , wherein the depth sensing device is one of a depth sensor, or an image sensor, or a stereo three-dimensional camera, or an infrared camera, or an ultraviolet camera, or a video camera, or a radar device, or a laser radar device, or a depth camera, or combinations of any two or more thereof.
4. The method of claim 1 , further comprising,
performing a calibration operation to identify locations of the physical object and other physical objects in the real-world environment; and
using the locations of the physical object or other physical objects in the real-world environment and the change in the one or more coordinates of the HMD to assist in determining when the user is approaching or moving away from the physical object.
5. The method of claim 1 , further comprising,
providing a warning on the display portion of the HMD that includes instructions on how the user is to move away from the physical object.
6. The method of claim 1 , wherein blending further includes increasing a brightness of the image of the physical object as the user approaches closer to the physical object.
7. A method, comprising:
executing an interactive application, the execution causing interactive content of the interactive application to be rendered on a display portion of a head mounted display (HMD) worn by a user, the HMD when worn by the user is configured to block a view to a real-world environment;
determining coordinates of the HMD in a three-dimensional space of the real-world environment, the coordinates used to identify a current position of the user wearing the HMD;
monitoring a movement of the HMD during execution of the interactive application, the movement of the HMD determined by identifying a change in one or more coordinates of the HMD in the three-dimensional space;
evaluating the change in the one or more coordinates of the HMD worn by the user to determine when the user is approaching a physical object present in the real-world environment;
blending in an image of the physical object with the interactive content when the evaluating determines that the user continues to approach the physical object; and
fading out the image of the physical object when the evaluating determines that the user is moving away from the physical object,
wherein the method operations are performed by a processor.
8. The method of claim 7 , further comprising,
performing a calibration operation to identify locations of the physical object and other physical objects in the real-world environment; and
using the locations of the physical object or other physical objects in the real-world environment and the change in the one or more coordinates of the HMD to assist in determining when the user is approaching or moving away from the physical object.