Systems and methods for responsively adaptable virtual environments
View Patent ↗The present disclosure relates to methods and systems for providing virtual environments that are responsively adaptable to users' characteristics. Embodiments provide for identifying a virtual action to be performed by a virtual representation of a patient within a virtual environment. The virtual action corresponds to a physical action by a physical limb of the patient in the real-world. In embodiments, the virtual action is required to be performed to a first target area within the virtual environment. Embodiments determine that the patient has at least one limitation that limits the patient performing the physical action. A determination of whether the patient has performed the physical action to at least a physical threshold associated is made. The virtual environment is caused to adapt in order to allow the virtual action to be performed in response to the determination that the patient has performed the physical action to the physical threshold.
1 . A method for dynamically adjusting a virtual environment, the method comprising:
presenting a virtual environment within which a patient is to perform a virtual task including completing a first virtual action that corresponds to a first physical action by the patient in the real-world, wherein the virtual task comprises interacting with a virtual object;
establishing an area of interactivity around the virtual object;
determining one or more characteristics associated with the patient, wherein the one or more characteristics associated with the patient include an effective height of the patient related to the patient's inability to stand, wherein the effective height of the patient related to the patient's inability to stand is different from a standing height of the patient;
determining at least one limitation of the patient with respect to the first physical action, wherein the at least one limitation limits the patient to performing the first physical action to a measurable limit, wherein the measurable limit corresponds to a virtual point different than a virtual target area within the virtual environment at which the virtual object is located;
determining, based on sensor data, whether a physical limb of the patient has performed the first physical action to at least a physical point associated with the measurable limit, wherein the physical point corresponds to a virtual space different than the virtual target area within the virtual environment;
determining that a virtual representation of the patient has remained within the area of interactivity for a predetermined period of time;
dynamically adjusting, based on a determination that the patient has remained within the area of interactivity for the predetermined period of time, based on determining that the physical limb has performed the first physical action to at least the physical point associated with the measurable limit, and based on the effective height of the patient, the virtual environment, wherein dynamically adjusting the virtual environment include modifying elements of the virtual environment to make the elements reachable to the patient from the effective height of the patient; and
presenting the dynamically modified virtual environment to the patient, wherein the patient is to perform the virtual task within the dynamically modified virtual environment.
2 . The method of claim 1 , wherein dynamically adjusting the virtual environment includes:
receiving a command to dynamically adjust the virtual environment, wherein the command is based on an input by a therapist requesting an adjustment to the virtual environment.
3 . The method of claim 1 , wherein the one or more characteristics associated with the patient include a level of performance of the patient with respect to completing the first virtual action within the virtual environment.
4 . The method of claim 3 , further comprising:
determining that the level of performance of the patient with respect to completing the first virtual action within the virtual environment indicates an increase in physical capabilities of the patient with respect to completing the first physical action by the patient in the real-world.
5 . The method of claim 4 , wherein dynamically adjusting the virtual environment includes:
increasing a difficulty of performing the virtual task, wherein the virtual task includes completing a second virtual action within the dynamically adjusted virtual environment that corresponds to a second physical action by the patient in the real-world, the second physical action having a greater difficulty than the first physical action.
6 . The method of claim 3 , wherein the level of performance of the patient with respect to completing the first virtual action within the virtual environment includes a level of effort of the patient with respect to completing the first virtual action within the virtual environment.
7 . The method of claim 6 , wherein the level of effort of the patient with respect to completing the first virtual action within the virtual environment may be measured based on one or more of:
a speed of the patient within the virtual environment;
a distance traveled by the patient within the virtual environment; and
an amount of objects collected by the patient within the virtual environment.
8 . The method of claim 1 , wherein the virtual task includes completing a second virtual action within the dynamically adjusted virtual environment that corresponds to a second physical action by the patient in the real-world, and wherein dynamically adjusting the virtual environment includes:
scaling a virtual movement of the patient to complete the second virtual action within the virtual environment based on the one or more characteristics associated with the patient such that the virtual movement of the patient to complete the second virtual action within the virtual environment represents an amplified version of a physical movement by the patient to complete the second physical action in the real-world.
9 . The method of claim 1 , wherein the one or more characteristics associated with the patient include one or more of:
a physical limitation of the patient;
a height of the patient;
a weight of the patient; and
an age of the patient.
10 . The method of claim 9 , wherein the one or more characteristics associated with the patient include the physical limitation of the patient, wherein the physical limitation of the patient includes a limitation of the patient with respect to walking, standing, or sitting.
11 . The method of claim 10 , wherein dynamically adjusting the virtual environment includes adapting the virtual environment to the physical limitation of the patient.
12 . A system for dynamically adjusting a virtual environment:
a virtual representation unit configured to display a virtual environment within which a patient is to perform a virtual task including completing a first virtual action that corresponds to a first physical action by the patient in the real-world, wherein the virtual task comprises interacting with a virtual object; and
a controller communicatively coupled to the virtual representation unit, the controller configured to perform operations including:
establishing an area of interactivity around the virtual object;
determining one or more characteristics associated with the patient, wherein the one or more characteristics associated with the patient include an effective height of the patient related to the patient's inability to stand, wherein the effective height of the patient related to the patient's inability to stand is different from a standing height of the patient;
determining at least one limitation of the patient with respect to the first physical action, wherein the at least one limitation limits the patient to performing the first physical action to a measurable limit, wherein the measurable limit corresponds to a virtual point different than a virtual target area within the virtual environment at which the virtual object is located;
determining, based on sensor data, whether a physical limb of the patient has performed the first physical action to at least a physical point associated with the measurable limit, wherein the physical point corresponds to a virtual space different than the virtual target area within the virtual environment;
determining that a virtual representation of the patient has remained within the area of interactivity for a predetermined period of time;
dynamically adjusting, based on a determination that the patient has remained within the area of interactivity for the predetermined period of time, based on determining that the physical limb has performed the first physical action to at least the physical point associated with the measurable limit, and based on the effective height of the patient, the virtual environment, wherein dynamically adjusting the virtual environment include modifying elements of the virtual environment to make the elements reachable to the patient from the effective height of the patient; and
presenting the dynamically modified virtual environment to the patient, wherein the patient is to perform the virtual task within the dynamically modified virtual environment.
13 . The system of claim 12 , wherein dynamically adjusting the virtual environment includes:
receiving a command to dynamically adjust the virtual environment, wherein the command is based on an input by a therapist requesting an adjustment to the virtual environment.
14 . The system of claim 12 , wherein the one or more characteristics associated with the patient include a level of performance of the patient with respect to completing the first virtual action within the virtual environment.
15 . The system of claim 14 , wherein the operations further include:
determining that the level of performance of the patient with respect to completing the first virtual action within the virtual environment indicates an increase in physical capabilities of the patient with respect to completing the first physical action by the patient in the real-world.
16 . The system of claim 15 , wherein dynamically adjusting the virtual environment includes:
increasing a difficulty of performing the virtual task, wherein the virtual task includes completing a second virtual action within the dynamically adjusted virtual environment that corresponds to a second physical action by the patient in the real-world, the second physical action having a greater difficulty than the first physical action.
17 . The system of claim 14 , wherein the level of performance of the patient with respect to completing the first virtual action within the virtual environment includes a level of effort of the patient with respect to completing the first virtual action within the virtual environment, and wherein the level of effort of the patient with respect to completing the first virtual action within the virtual environment may be measured based on one or more of:
a speed of the patient within the virtual environment;
a distance traveled by the patient within the virtual environment; and
an amount of objects collected by the patient within the virtual environment.
18 . The system of claim 12 , wherein the virtual task includes completing a second virtual action within the dynamically adjusted virtual environment that corresponds to a second physical action by the patient in the real-world, and wherein dynamically adjusting the virtual environment includes:
scaling a virtual movement of the patient to complete the second virtual action within the virtual environment based on the one or more characteristics associated with the patient such that the virtual movement of the patient to complete the second virtual action within the virtual environment represents an amplified version of a physical movement by the patient to complete the second physical action in the real-world.
19 . The system of claim 1 , wherein the one or more characteristics associated with the patient include one or more of:
a physical limitation of the patient, wherein the physical limitation of the patient includes a limitation of the patient with respect to walking, standing, or sitting;
a height of the patient;
a weight of the patient; and
an age of the patient.
20 . A non-transitory computer readable medium storing instructions that, when executed by a processor, cause the processor to perform operations comprising:
presenting a virtual environment within which a patient is to perform a virtual task including completing a first virtual action that corresponds to a first physical action by the patient in the real-world, wherein the virtual task comprises interacting with a virtual object;
establishing an area of interactivity around the virtual object;
determining one or more characteristics associated with the patient, wherein the one or more characteristics associated with the patient include an effective height of the patient related to the patient's inability to stand, wherein the effective height of the patient related to the patient's inability to stand is different from a standing height of the patient;
determining at least one limitation of the patient with respect to the first physical action, wherein the at least one limitation limits the patient to performing the first physical action to a measurable limit, wherein the measurable limit corresponds to a virtual point different than a virtual target area within the virtual environment at which the virtual object is located;
determining, based on sensor data, whether a physical limb of the patient has performed the first physical action to at least a physical point associated with the measurable limit, wherein the physical point corresponds to a virtual space different than the virtual target area within the virtual environment;
determining that a virtual representation of the patient has remained within the area of interactivity for a predetermined period of time;
dynamically adjusting, based on a determination that the patient has remained within the area of interactivity for the predetermined period of time, based on determining that the physical limb has performed the first physical action to at least the physical point associated with the measurable limit, and based on the effective height of the patient, the virtual environment, wherein dynamically adjusting the virtual environment include modifying elements of the virtual environment to make the elements reachable to the patient from the effective height of the patient; and
presenting the dynamically modified virtual environment to the patient, wherein the patient is to perform the virtual task within the dynamically modified virtual environment.