Granted Patent B2

US 11,771,955 · App. 18/089,467 · Granted Oct 3, 2023

Inventor: Coleman Fung (Austin, TX)

Assignee: BLUE GOJI LLC

A63B24/0003A63B22/0046A63B22/0285A63B22/0292A63B22/06A63B23/04A63F13/212A63F13/214A63F13/40A63F13/65G06F1/163G06F3/011G06F3/016G06T19/006H04W84/18

Abstract

Claims (54)

1. A system for virtual reality therapy, comprising:

a computing device comprising a memory, a processor, and a non-volatile data storage device;

a virtual reality engine, comprising a first plurality of programming instructions stored in the memory and operating on the processor, wherein the first plurality of programming instructions, when operating on the processor, causes the computing device to:

receive sensor data from a plurality of sensors;

perform data fusion to integrate the plurality of sensor data;

generate an environmental model of a real-world environment based on the integrated sensor data, in which a shared virtual environment is presented to a first person receiving virtual reality therapy and a second person providing the virtual reality therapy;

generate a unified tracking model based on the integrated sensor data for each of the first and second persons;

for each particular user, apply the environmental model and the tracking model to generate frames of the shared virtual environment corresponding to a real-time field of view of the particular user;

receive response data from a therapeutic engine for the first person;

perform real-time updates to the shared virtual environment based on first and second person interactions with the shared virtual environment, to movement of users and real objects and surfaces within the real-world space, and the response data; and

the therapeutic engine, comprising a second plurality of programming instructions stored in the memory and operating on the processor, wherein the second plurality of programming instructions, when operating on the processor, causes the computing device to:

generate a distinct therapeutic layer associated with the first person in the shared virtual environment, wherein the therapeutic layer:

receives a neurological assessment for the first person comprising a neurological condition of the first person;

selects a primary task from a neurological database associated with the neurological condition;

selects an associative activity from the neurological database associated with the neurological condition; and

assigns a dual task stimulation for the first person to perform, the dual task stimulation comprising the primary task and the associative activity;

capture the response data to performing primary task and the associative activity;

send the response data to the virtual reality engine; and

update the therapeutic layer for the first person based on the real-time updates to the shared virtual environment.

2. The system of claim 1 , wherein the therapeutic engine is further configured to:

select a brainwave entrainment therapy for application while the first person is engaged in the dual task stimulation, the therapy comprising a stimulation frequency; and

apply the brainwave entrainment therapy by operating virtual elements as transducers at the stimulation frequency while the first person is engaged in the dual task stimulation.

3. The system of claim 2 , wherein the primary task is physical exercise and the system further comprises an exercise machine on which the primary task is performed.

4. The system of claim 2 , wherein the brainwave entrainment therapy comprises operating the virtual element transducers to provide either visual, auditory, vibratory, or electrical stimulation at a stimulation frequency between 0.5 Hz and 100 Hz.

5. The system of claim 2 , comprising a plurality of transducers wherein at least two transducers are of different modalities, and wherein the brainwave entrainment therapy comprises operation of transducers of at least two different modalities.

6. The system of claim 2 , comprising a plurality of transducers wherein at least two transducers are of different scales, and wherein the brainwave entrainment therapy comprises operation of transducers of at least two different scales.

7. The system of claim 1 , wherein the training regimen comprises brainwave entrainment therapy.

8. The system of claim 1 , further comprising a scene object model, wherein the scene object model is used to assist the generation of the environmental model.

9. A method for extended reality therapy with physical interactivity, comprising the steps of:

receiving a plurality of sensor data;

performing data fusion to integrate the plurality of sensor data;

generating an environmental model of a real-world environment based on the integrated sensor data, in which a shared virtual environment is presented to first and second persons;

generating a unified tracking model based on the integrated sensor data for each of the first and second persons;

for each particular user, applying the environmental model and the tracking model to generate frames of the shared virtual environment corresponding to a real-time field of view of the particular user;

receiving user response data from a therapeutic engine;

performing real-time updates to the shared virtual environment based on user interaction with the shared virtual environment, to movement of users and real objects and surfaces within the real-world space, and the user response data;

for each particular user:

generating a distinct therapeutic layer associated with the user in the shared virtual environment, wherein the therapeutic layer:

receives a neurological assessment for each user comprising a neurological condition of the user;

selects a primary task from a neurological database associated with the neurological condition;

selects an associative activity from the neurological database associated with the neurological condition; and

assigns a dual task stimulation for the user to perform, the dual task stimulation comprising the primary task and the associative activity;

capturing user response data to performing the primary task and the associative task;

sending the user response data to the virtual reality engine; and

updating the therapeutic layer for each user based on the real-time updates to the shared virtual environment.

10. The method of claim 9 , further comprising the steps of:

selecting a brainwave entrainment therapy for application while the user is engaged in the dual task stimulation, the therapy comprising a stimulation frequency; and

applying the brainwave entrainment therapy by operating virtual elements as transducers at the stimulation frequency while the user is engaged in the dual task stimulation.

11. The method of claim 10 , wherein the primary task is physical exercise and the system further comprises an exercise machine on which the primary task is performed.

12. The method of claim 10 , wherein the brainwave entrainment therapy comprises operating the virtual element transducers to provide either visual, auditory, vibratory, or electrical stimulation at a stimulation frequency between 0.5 Hz and 100 Hz.

13. The method of claim 10 , comprising a plurality of transducers wherein at least two transducers are of different modalities, and wherein the brainwave entrainment therapy comprises operation of transducers of at least two different modalities.

14. The method of claim 10 , comprising a plurality of transducers wherein at least two transducers are of different scales, and wherein the brainwave entrainment therapy comprises operation of transducers of at least two different scales.

15. The method of claim 9 , wherein the training regimen comprises brainwave entrainment therapy.

16. The method of claim 9 , further comprising a scene object model, wherein the scene object model is used to assist the generation of the environmental model.

Assignments (1)

Continuity (35)