Virtual and augmented reality telecommunication platforms
Provided herein are clinical evaluation and treatment as well as training protocols in virtual or augmented reality that create fully immersive environments, which enable real-time rendering for communication, specifically telecommunication, between two or more parties. In various embodiments, a virtual environment is provided to a first user at a first location. A first set of data comprising positional data of the first user is provided to a second user (e.g., an instructor) at a second location. An activity (e.g., a treatment or assessment protocol) may be received from the second user (e.g., an instructor) and the activity may be displayed to the first user via layering the activity over the virtual environment. An adjustment may be applied to the activity by the second user based on compliance of the first user with the activity protocols. Additional users at other locations may also receive the first activity from the second user.
1. A method comprising:
providing a virtual environment to a first user via a virtual or augmented reality system at a first location;
collecting a first set of data based on the first user's interaction with the virtual environment, the first set of data comprising positional data of the first user;
providing the first set of data to a second user at a second location via a network;
receiving, from the second user, a first activity;
displaying the first activity to the first user by layering the first activity over the virtual environment;
collecting a second set of data related to the first user and the first activity in the virtual environment, the second set of data comprising positional data of the first user;
determining a compliance metric based on the second set of data;
when the compliance metric differs from a predetermined range, applying a first adjustment to the first activity, the first adjustment based on the second set of data;
displaying the adjusted first activity to the first user by layering the adjusted first activity over the virtual environment;
providing the virtual environment to a third user at a third location via the virtual or augmented reality system, wherein the third user is enabled to interact with the first user;
collecting a third set of data based on the third user's interaction with the virtual environment, the third set of data comprising positional data of the third user;
displaying the first activity to the third user by layering the first activity over the virtual environment;
collecting a fourth set of data related to the third user and the first activity in the virtual environment, the fourth set of data comprising positional data of the third user; and
applying a second adjustment to the first activity for the third user, the second adjustment based on the fourth set of data.
2. The method of claim 1 , wherein the first activity is a treatment protocol.
3. The method of claim 1 , wherein the first activity is an assessment protocol.
4. The method of claim 1 , wherein the first activity is a rehabilitation protocol.
5. The method of claim 1 , wherein the second adjustment is different from the first adjustment.
6. The method of claim 1 , wherein the second adjustment is the same as the first adjustment.
7. A system comprising:
a virtual or augmented reality system, comprising a virtual or augmented reality display adapted to display a virtual environment to a first user;
one or more biometric sensors coupled to the first user;
a computing node comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor of the computing node to cause the processor to perform a method comprising:
providing a virtual environment to a first user via the virtual or augmented reality system at a first location;
collecting a first set of data from the one or more biometric sensor based on the first user's interaction with the virtual environment, the first set of data comprising audio data and positional data of the first user;
providing the first set of data to a second user at a second location via a network;
receiving, from the second user, a first activity;
displaying the first activity to the first user by layering the first activity over the virtual environment;
collecting a second set of data related to the first user and the first activity in the virtual environment, the second set of data comprising audio data and positional data of the first user;
determining a compliance metric based on the second set of data;
when the compliance metric differs from a predetermined range, applying a first adjustment to the first activity, the first adjustment based on the second set of data;
adjustment to the first activity, the first adjustment based on the second set of data; and displaying the adjusted first activity to the first user by layering the adjusted first activity over the virtual environment;
providing the virtual environment to a third user at a third location via the virtual or augmented reality system, wherein the third user is enabled to interact with the first user;
collecting a third set of data based on the third user's interaction with the virtual environment, the third set of data comprising positional data of the third user;
displaying the first activity to the third user by layering the first activity over the virtual environment;
collecting a fourth set of data related to the third user and the first activity in the virtual environment, the fourth set of data comprising positional data of the third user; and
applying a second adjustment to the first activity for the third user, the second adjustment based on the fourth set of data.
8. The system of claim 7 , wherein the first activity is a treatment protocol.
9. The system of claim 7 , wherein the first activity is an assessment protocol.
10. The system of claim 7 , wherein the first activity is a rehabilitation protocol.
11. A computer program product for providing a virtual or augmented reality platform, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform a method comprising:
providing a virtual environment to the first user via a virtual or augmented reality system at a first location;
collecting a first set of data based on the first user's interaction with the virtual environment, the first set of data comprising positional data of the first user;
providing the first set of data to a second user at a second location via a network;
receiving, from the second user, a first activity;
displaying the first activity by layering the first activity over the virtual environment;
collecting a second set of data related to the user and the first activity in the virtual environment, the second set of data comprising positional data of the first user;
determining a compliance metric based on the second set of data;
when the compliance metric differs from a predetermined range, applying an adjustment of the first activity, the first adjustment based on the second set of data;
adjustment to the first activity, the first adjustment based on the second set of data; and displaying the adjusted first activity to the first user by layering the adjusted first activity over the virtual environment;
providing the virtual environment to a third user at a third location via the virtual or augmented reality system, wherein the third user is enabled to interact with the first user;
collecting a third set of data based on the third user's interaction with the virtual environment, the third set of data comprising positional data of the third user;
displaying the first activity to the third user by layering the first activity over the virtual environment;
collecting a fourth set of data related to the third user and the first activity in the virtual environment, the fourth set of data comprising positional data of the third user; and
applying a second adjustment to the first activity for the third user, the second adjustment based on the fourth set of data.