Dual perspective rendering in virtual reality
Systems and methods are described to render a Live Avatar View third-person view as an overlay of a first person Spectator View, as mirrored from a Virtual Reality headset, in a Dual Perspective View. In some embodiments, a clinician tablet may display Dual Perspective View with a full screen Spectator View, to maximize visibility, and render a translucent avatar from Live Avatar View (LAV) to overlay the Spectator View for simultaneous visibility during a therapy session. Spectator View may be critical to monitor for therapy guidance and an LAV conveys valuable movement and safety data. A translucent avatar overlay and activity cues allows monitoring the avatar from Live Avatar View in a way that would not block the Spectator View or occlude other body parts potentially hidden.
1. A method for generating a dual perspective display to monitor a virtual reality environment, the method comprising:
receiving a first-person display in the virtual reality environment;
receiving avatar skeleton data;
generating a second display by rendering a translucent avatar based on the avatar skeleton data; and
generating for display the dual perspective display by overlaying the second display over the first-person display in the virtual reality environment.
2. The method of claim 1 , wherein the first-person display is generated by a headset, comprising:
receiving sensor data;
converting the sensor data to avatar skeleton data; and
rendering the first-person display based on the avatar skeleton data.
3. The method of claim 2 , wherein the first-person display and avatar skeleton data are transmitted from the headset.
4. The method of claim 2 , wherein the first-person display is rendered by a virtual reality environment rendering engine.
5. The method of claim 4 , wherein the virtual reality environment rendering engine comprises a three-dimensional environment developing platform.
6. The method of claim 2 , wherein the translucent avatar is rendered by a real-time three-dimensional engine for displaying three-dimensional graphics in a web browser.
7. The method of claim 2 , wherein the receiving sensor data further includes receiving position and orientation data from a plurality of sensors placed a virtual reality participant's body and wherein converting the sensor data to avatar skeleton data further includes generating avatar skeletal data based on the position and orientation data from the plurality of sensors.
8. The method of claim 1 , wherein the second display is a third-person view of the translucent avatar.
9. The method of claim 1 further comprising receiving activity information including activity cues.
10. The method of claim 9 further comprising rendering activity cues in the second display as at least one indication of a direction to look.
11. The method of claim 9 , wherein the activity cues comprise virtual object locations.
12. The method of claim 2 , wherein the first-person display is transmitted from the headset to a tablet.
13. The method of claim 12 , wherein the transmission is at least one of the following connection types: WiFi and Bluetooth.
14. The method of claim 1 , wherein the dual perspective display is part of a user interface that includes patient data and activity data.
15. The method of claim 1 , wherein the dual perspective display comprises a filter for the first-person display to distinguish the second display.
16. The method of claim 1 , wherein the translucent avatar changes degree of transparency based on selective adjustment of a transparency setting.
17. A system of generating a dual perspective display to monitor a virtual reality environment, the system comprising:
input/output computer processor circuitry configured to:
receive a first-person display;
receive avatar skeleton data; and
processing circuitry configured to:
generate a second display by rendering a translucent avatar based on the avatar skeleton data; and
generate for display the dual perspective display by overlaying the second display over the first-person display in the virtual reality environment.
18. The system of claim 17 , wherein the first-person display is generated by a headset comprising second input/output circuitry configured to receive sensor data; and
second processing circuitry configured to convert the sensor data to avatar skeleton data and render the first-person display based on the avatar skeleton data.
19. The system of claim 18 , wherein the second input/output circuitry is further configured to transmit the first-person display and avatar skeleton data from the headset.
20. The system of claim 18 , wherein the second processing circuitry is further configured to use a virtual reality environment rendering engine to render the first-person display.