Systems and methods for responsively adaptable virtual environments
The present disclosure relates to methods and systems for providing virtual environments that are responsively adaptable to users' characteristics. Embodiments provide for identifying a virtual action to be performed by a virtual representation of a patient within a virtual environment. The virtual action corresponds to a physical action by a physical limb of the patient in the real-world. In embodiments, the virtual action is required to be performed to a first target area within the virtual environment. Embodiments determine that the patient has at least one limitation that limits the patient performing the physical action. A determination of whether the patient has performed the physical action to at least a physical threshold associated is made. The virtual environment is caused to adapt in order to allow the virtual action to be performed in response to the determination that the patient has performed the physical action to the physical threshold.
1. A method for tracking movements of a patient within a virtual environment, the method comprising:
determining that a patient has a physical limitation with respect to performing one or more physical actions by the patient in the real-world corresponding to one or more virtual actions of a virtual task to be performed by the patient within a virtual environment, wherein the limitation limits a movement of the patient when performing the one or more physical actions;
tracking the limited performance of the one or more physical actions by the patient using one or more sensors mounted on one or more extremities of the patient; and
displaying the virtual environment to facilitate the patient performing the virtual task, including displaying performance of the one or more virtual actions within the virtual environment in response to limited performance of the one or more physical actions by the patient in the real-world determined based on the tracking, wherein displaying performance of the one or more virtual actions includes moving a virtual target of the one or more virtual actions while the one or more physical actions are performed by the patient in the real-world such that the virtual target is reached within the virtual environment in response to the limited performance of the one or more physical actions by the patient in the real-world.
2. The method of claim 1 , wherein the one or more extremities of the patient include one or more of:
the patient's legs;
the patient's arms;
the patient's head; or
the patient's hands.
3. The method of claim 2 , wherein the one or more sensors are mounted on the patient's legs, and wherein the one or more sensors include one or more inertial sensors configured to capture acceleration data.
4. The method of claim 1 , wherein determining that the patient has a physical limitation includes determining that the patient has a physical limitation based on sensor data corresponding to at least one of a conformation, location, movement, speed, velocity, tilt, and position of the patient or part thereof.
5. A system for dynamically adjusting a virtual environment, the system comprising:
a virtual representation unit configured to display a virtual environment; and
a controller communicatively coupled to the virtual representation unit, the controller configured to perform operations including:
determining that a patient has a physical limitation with respect to performing one or more physical actions by the patient in the real-world corresponding to one or more virtual actions of a virtual task to be performed by the patient within a virtual environment, wherein the limitation limits a movement of the patient when performing the one or more physical actions;
tracking the limited performance of the one or more physical actions by the patient using one or more sensors mounted on one or more extremities of the patient; and
causing the virtual representation unit to display the virtual environment to facilitate the patient performing the virtual task, including displaying performance of the one or more virtual actions within the virtual environment in response to limited performance of the one or more physical actions by the patient in the real-world determined based on the tracking; wherein displaying performance of the one or more virtual actions includes moving a virtual target of the one or more virtual actions while the one or more physical actions are performed by the patient in the real-world such that the virtual target is reached within the virtual environment in response to the limited performance of the one or more physical actions by the patient in the real-world.
6. The system of claim 5 , wherein the one or more extremities of the patient include one or more of:
the patient's legs;
the patient's arms;
the patient's head; or
the patient's hands.
7. The system of claim 6 , wherein the one or more sensors are mounted on the patient's legs, and wherein the one or more sensors include one or more inertial sensors configured to capture acceleration data.
8. The system of claim 5 , wherein determining that the patient has a physical limitation includes determining that the patient has a physical limitation based on sensor data corresponding to at least one of a conformation, location, movement, speed, velocity, tilt, and position of the patient or part thereof.
9. A non-transitory computer readable medium storing instructions that, when executed by a processor, cause the processor to perform operations comprising:
determining that a patient has a physical limitation with respect to performing one or more physical actions by the patient in the real-world corresponding to one or more virtual actions of a virtual task to be performed by the patient within a virtual environment, wherein the limitation limits a movement of the patient when performing the one or more physical actions;
tracking the limited performance of the one or more physical actions by the patient using one or more sensors mounted on one or more extremities of the patient; and
displaying the virtual environment to facilitate the patient performing the virtual task, including displaying performance of the one or more virtual actions within the virtual environment in response to limited performance of the one or more physical actions by the patient in the real-world determined based on the tracking, wherein displaying performance of the one or more virtual actions includes moving a virtual target of the one or more virtual actions while the one or more physical actions are performed by the patient in the real-world such that the virtual target is reached within the virtual environment in response to the limited performance of the one or more physical actions by the patient in the real-world.
10. The non-transitory computer readable medium of claim 9 , wherein the one or more extremities of the patient include one or more of:
the patient's legs;
the patient's arms;
the patient's head; or
the patient's hands.
11. The non-transitory computer readable medium of claim 10 , wherein the one or more sensors are mounted on the patient's legs, and wherein the one or more sensors include one or more inertial sensors configured to capture acceleration data.
12. The non-transitory computer readable medium of claim 9 , wherein determining that the patient has a physical limitation includes determining that the patient has a physical limitation based on sensor data corresponding to at least one of a conformation, location, movement, speed, velocity, tilt, and position of the patient or part thereof.