Systems and methods for responsively adaptable virtual environments
View Patent ↗The present disclosure relates to methods and systems for providing virtual environments that are responsively adaptable to users' characteristics. Embodiments provide for identifying a virtual action to be performed by a virtual representation of a patient within a virtual environment. The virtual action corresponds to a physical action by a physical limb of the patient in the real-world. In embodiments, the virtual action is required to be performed to a first target area within the virtual environment. Embodiments determine that the patient has at least one limitation that limits the patient performing the physical action. A determination of whether the patient has performed the physical action to at least a physical threshold associated is made. The virtual environment is caused to adapt in order to allow the virtual action to be performed in response to the determination that the patient has performed the physical action to the physical threshold.
1. A method for dynamically adjusting a virtual environment to complete a virtual task within the virtual environment, wherein the virtual task includes a virtual action performed by a virtual limb of a patient in the virtual environment, wherein the virtual action corresponds to a physical action performed by a physical limb of the patient, the method comprising:
determining, while the patient is moving the physical limb in the real world, whether the patient has a physical limitation that limits the movement of the physical limb to a physical threshold area, the physical threshold area corresponding to an area in the virtual environment to which the virtual limb is reaching, wherein the physical limitation prevents the patient from completing the virtual task of reaching to a virtual target area within the virtual environment; and
dynamically adjusting, in response to determining that the patient is unable to move to the physical threshold area and is unable to complete the virtual task, the virtual environment to complete the virtual task while the physical action is being performed.
2. The method of claim 1 , wherein the physical limitation is to a physical threshold area that corresponds to an area in the virtual environment to which the virtual limb is reaching, wherein the area in the virtual environment is different from the virtual target area.
3. The method of claim 1 , wherein the virtual task is deemed complete when the virtual action is performed to the virtual target area within the virtual environment.
4. The method of claim 1 , wherein the determining whether the patient has the physical limitation is based on sensor data corresponding to at least one of a conformation, location, movement, speed, velocity, tilt, and position of the physical limb.
5. The method of claim 4 , wherein the sensor data is obtained from at least one sensor configured to be mounted upon the physical limb of the patient.
6. The method of claim 4 , wherein the sensor data is obtained from at least one sensor configured to be mounted external to the patient.
7. The method of claim 4 , wherein the determining whether the patient has performed the physical action to the physical threshold area includes determining whether the virtual limb has entered an area of interactivity around a virtual object.
8. The method of claim 7 , wherein the virtual task is deemed complete if the virtual limb stays in the area of interactivity for a predetermined time.
9. A system for dynamically adjusting a virtual environment to complete a virtual task within the virtual environment, wherein the virtual task includes a virtual action performed by a virtual limb of a patient in the virtual environment, wherein the virtual action corresponds to a physical action performed by a physical limb of the patient, the system comprising:
at least one sensor configured to detect data associated with the physical limb of the patient;
a virtual representation unit configured to display the virtual environment, the virtual environment including at least one interactable virtual object located at a virtual target area in the virtual environment, and a virtual representation of the patient within the virtual environment; and
a controller communicatively coupled to the at least one sensor and the virtual representation unit, the controller configured to:
determine, while the patient is moving the physical limb in the real world, whether the patient has a physical limitation that limits the movement of the physical limb to a physical threshold area, the physical threshold area corresponding to an area in the virtual environment to which the virtual limb is reaching, wherein the physical limitation prevents the patient from completing the virtual task of reaching to a virtual target area within the virtual environment; and
dynamically adjust, in response to determining that the patient unable to move to the physical threshold area and is unable to complete the virtual task, the virtual environment to complete the virtual task while the physical action is being performed.
10. The system of claim 9 , wherein the physical limitation is to a physical threshold area that corresponds to an area in the virtual environment to which the virtual limb is reaching, wherein the area in the virtual environment is different from the virtual target area.
11. The system of claim 9 , wherein the virtual task is deemed complete when the virtual action is performed to the virtual target area within the virtual environment.
12. The system of claim 9 , wherein the determining whether the patient has the physical limitation is based on sensor data corresponding to at least one of a conformation, location, movement, speed, velocity, tilt, and position of the physical limb.
13. The system of claim 12 , wherein the sensor data is obtained from at least one sensor configured to be mounted upon the physical limb of the patient.
14. The system of claim 12 , wherein the sensor data is obtained from at least one sensor configured to be mounted external to the patient.
15. The system of claim 12 , wherein the determining whether the patient has performed the physical action to the physical threshold area includes determining whether the virtual limb has entered an area of interactivity around a virtual object.
16. The system of claim 15 , wherein the virtual task is deemed complete if the virtual limb stays in the area of interactivity for a predetermined time.
17. A method for dynamically adjusting a virtual environment to complete a virtual task within the virtual environment, wherein the virtual task includes a virtual action performed by a virtual limb of a patient to seize a virtual object having an area of interactivity around it, wherein the virtual action corresponds to a physical action performed by a physical limb of the patient, the method comprising:
determining, while the patient is moving the physical limb in the real world, whether the patient has a physical limitation that limits the movement of the physical limb to a physical threshold area, the physical threshold area corresponding to an area in the virtual environment to which the virtual limb is reaching, wherein the physical limitation also prevents the patient from reaching the virtual object; and
dynamically adjusting, in response to determining that the patient unable to move to the physical threshold area and has been in the area of interactivity for a predetermined time, the virtual environment to complete the virtual task while the virtual limb is in the area of interactivity.
18. The method of claim 17 , wherein the virtual task is deemed complete if the virtual limb stays in the area of interactivity for a predetermined time.
19. The method of claim 18 , wherein the predetermined time is configurable based on a difficulty of the virtual task.
20. The method of claim 17 , wherein the area of interactivity is adaptable based on a difficulty of the virtual task.
21. The method of claim 1 , wherein the determining whether the patient has entered the area of interactivity is based on sensor data corresponding to at least one of a conformation, location, movement, speed, velocity, tilt, and position of the physical limb.