Spectator view tracking of virtual reality (VR) user in VR environments
A method, system, computer readable media and cloud systems are provided for generating views of a virtual reality environment for a spectator. One example method includes enabling a spectator to view into a virtual reality environment, and control what specific content within the environment the spectator wishes to see. Motions of an HMD worn by an HMD player can be tracked so as to provide a geared spectator view into the virtual reality environment. The gearing of the spectator view enables a spectator to view the virtual reality content in a more normal way which is not tied to the strict movements of the HMD worn by the HMD player. The gearing effects can be programmable or can be set based on the content being navigated by the HMD player or preferences of the individual spectators.
1. A method for processing virtual reality content for viewing by spectators, comprising,
receiving, at a server, a virtual reality stream associated with interaction by a head mounted display (HMD) player, the HMD player is configured to navigate a virtual reality environment, and the navigation of the virtual reality environment produces the virtual reality stream having an HMD player view;
receiving, at the server, a request via a device of a spectator to view the virtual reality stream via an HMD of the spectator;
sending, by the server, a feed of the virtual reality stream to the HMD of the spectator, the feed of the virtual reality stream being provided in real-time while the HMD player is navigating the virtual reality environment, the feed providing an HMD spectator view into the virtual reality environment shown in the HMD player view; and
adjusting, by the server, the HMD spectator view into the virtual reality environment in accordance with a gearing ratio, the gearing ratio defining a rate at which the HMD spectator view virtually moves to follow the HMD player view in real-time as the HMD player navigates the virtual reality environment, the HMD spectator view is virtually tied to and pulled by the HMD player view,
wherein the gearing ratio provides a dynamically adjustable delay to the HMD spectator view in relation to the HMD player view, based on a physics metric associated to a virtual rubber band connection between a virtual location of the HMD player view relative to a virtual location of the HMD spectator view.
2. The method of claim 1 , wherein the gearing ratio is dynamically adjusted by the server based on content encountered in the virtual reality environment.
3. The method of claim 1 , wherein the gearing ratio is dynamically adjusted by the server based on a preference of the spectator.
4. The method of claim 1 , wherein the dynamically adjustable delay provided by the gearing ratio causes movement of the HMD spectator view to change slower than movement of the HMD player view, the HMD player view moving at a rate controlled by the HMD player as the HMD player moves the HMD of the HMD player in a real-world space while navigating or moving in the virtual reality environment.
5. The method of claim 1 , wherein the dynamically adjustable delay provided by the gearing ratio causes movement of the HMD spectator view to automatically change in speed relative to movement of the HMD player view, the HMD player view moving at a rate controlled by the HMD player as the HMD player moves the HMD of the HMD player in a real-world space while navigating or moving in the virtual reality environment.
6. The method of claim 1 , wherein the dynamically adjustable delay provided by the gearing ratio is approximated by the physics metric that includes an elasticity of the virtual rubber band, such that an acceleration of speed of movement of the HMD player view causes an initial jerk pull on the virtual rubber band that then reacts to force the HMD spectator view to follow the HMD player view.
7. The method of claim 1 , wherein the dynamically adjustable delay provided by the gearing ratio is approximated by the physics metric that includes an elasticity of the virtual rubber band, such that an acceleration of speed of movement of the HMD player view causes the virtual rubber band to expand and pull to force the HMD spectator view to follow the HMD player view.
8. The method of claim 1 , wherein the gearing ratio skips or reduces following the HMD player view when the HMD player view moves faster than the dynamically adjustable delay imparted by the gearing ratio.
9. A method for processing virtual reality content for viewing by spectators, comprising,
processing, at a computer, a virtual reality stream associated with interaction by a head mounted display (HMD) worn by an HMD player, the HMD player is configured to navigate a virtual reality environment, and the navigation of the virtual reality environment produces the virtual reality stream having an HMD player view;
receiving, at the computer, a request associated with an HMD of a spectator to view the virtual reality stream via the HMD of the spectator;
sending, by the computer, a feed of the virtual reality stream to the HMD of the spectator, the feed of the virtual reality stream being provided in real-time while the HMD player is navigating the virtual reality environment, the feed providing an HMD spectator view into the virtual reality environment being navigated by the HMD player; and
adjusting, by the computer, the HMD spectator view into the virtual reality environment in accordance with a gearing ratio, the gearing ratio defining a rate at which the HMD spectator view virtually moves to follow the HMD player view in real-time as the HMD player navigates the virtual reality environment, the HMD spectator view is virtually tied to and pulled by the HMD player view,
wherein the gearing ratio provides a dynamically adjustable delay to the HMD spectator view in relation to the HMD player view based on a physics metric associated to a virtual rubber band connection between a virtual location of the HMD player view relative to a virtual location of the HMD spectator view.
10. The method of claim 9 , wherein the gearing ratio is dynamically adjusted by the computer based on content encountered in the virtual reality environment.
11. The method of claim 9 , wherein the gearing ratio is dynamically adjusted by the computer based on a preference of the spectator.
12. The method of claim 9 , wherein the dynamically adjustable delay provided by the gearing ratio causes movement of the HMD spectator view to change or react slower than movement of the HMD player view, the HMD player view moving at a rate controlled by the HMD player as the HMD player moves the HMD of the HMD player in a real-world space while navigating or moving in the virtual reality environment.
13. The method of claim 9 , wherein the dynamically adjustable delay provided by the gearing ratio causes movement of the HMD spectator view to automatically change in speed relative to movement of the HMD player view, the HMD player view moving at a rate controlled by the HMD player as the HMD player moves the HMD of the HMD player in a real-world space while navigating or moving in the virtual reality environment.
14. The method of claim 9 , wherein the dynamically adjustable delay provided by the gearing ratio is approximated by the physics metric that includes an elasticity of the virtual rubber band, such that an acceleration of speed of movement of the HMD player view causes an initial jerk pull on the virtual rubber band that then reacts to force the HMD spectator view to follow the HMD player view.
15. The method of claim 9 , wherein the dynamically adjustable delay provided by the gearing ratio is approximated by the physics metric that includes an elasticity of the virtual rubber band, such that an acceleration of speed of movement of the HMD player view causes the virtual rubber band to expand and pull to force the HMD spectator view to follow the HMD player view.
16. A non-transitory computer-readable medium having program instructions for processing virtual reality content for viewing by spectators, comprising,
program instructions for processing, at a computer, a virtual reality stream associated with interaction by a head mounted display (HMD) worn by an HMD player, the HMD player is configured to navigate a virtual reality environment, and the navigation of the virtual reality environment produces the virtual reality stream having an HMD player view;
program instructions for receiving, at the computer, a request associated with an HMD of a spectator to view the virtual reality stream via an HMD of the spectator;
program instructions for sending, by the computer, a feed of the virtual reality stream to the HMD of the spectator, the feed of the virtual reality stream being provided in real-time while the HMD player is navigating the virtual reality environment, the feed providing an HMD spectator view into the virtual reality environment being navigated by the HMD player; and
program instructions for adjusting, by the computer, the HMD spectator view into the virtual reality environment in accordance with a gearing ratio, the gearing ratio defining a rate at which the HMD spectator view virtually moves to follow the HMD player view in real-time as the HMD player navigates the virtual reality environment, the HMD spectator view is virtually tied to and pulled by the HMD player view,
wherein the gearing ratio provides a dynamically adjustable delay to the HMD spectator view in relation to the HMD player view based on a physics metric associated to a virtual rubber band connection between a virtual location of the HMD player view relative to a virtual location of the HMD spectator view.
17. The non-transitory computer-readable medium of claim 16 , wherein the dynamically adjustable delay provided by the gearing ratio causes movement of the HMD spectator view to change or react slower than movement of the HMD player view, the HMD player view moving at a rate controlled by the HMD player as the HMD player moves the HMD of the HMD player in a real-world space while navigating or moving in the virtual reality environment.
18. The non-transitory computer-readable medium of claim 16 , wherein the dynamically adjustable delay provided by the gearing ratio causes movement of the HMD spectator view to automatically change in speed relative to movement of the HMD player view, the HMD player view moving at a rate controlled by the HMD player as the HMD player moves the HMD of the HMD player in a real-world space while navigating or moving in the virtual reality environment.
19. The non-transitory computer-readable medium of claim 16 , wherein the dynamically adjustable delay provided by the gearing ratio is approximated by the physics metric that includes an elasticity of the virtual rubber band, such that an acceleration of speed of movement of the HMD player view causes an initial jerk pull on the virtual rubber band that then reacts to force the HMD spectator view to follow the HMD player view in accordance to the gearing ratio.