Granted Patent B2

US 12,737,977 · App. 18/806,801 · Granted Sep 15, 2026

Inventors: Magesh Chandramouli (Schereville, IN); Ashayla Williams (Merrillville, IN)

Assignee: Purdue Research Foundation

G06T17/00

Abstract

Claims (45)

1 . A method of providing training in a virtual reality training room for training a trainee, comprising:

presenting to a trainee a virtual training projection (VIC), the VIC includes a virtual robot (VOB) that is configured to guide the trainee in the virtual training; and

executing instructions maintained on a non-transitory memory by a processor to:

rendering a virtual reality training room scene that includes a specialized processing equipment (SPE) on which to train the trainee,

presenting to the trainee an introduction to the VIC, and

presenting to the trainee one or more modules associated with operation or assembly of the SPE,

for each module:

STEP A: presenting a step-by-step initial set of instructions constituting one or more submodules for operating or assembling the SPE, organized by the VOB,

STEP (B): at the end of each submodule, requesting the trainee to repeat the steps covered in said submodule,

receiving inputs from the trainee via an input device, the inputs representing the trainee's virtual actions in repeating the step-by-step instructions,

using the trainee's received inputs, constructing a trainee action including timing of the action and virtual location of the action and comparing the trainee action with an expected action,

if the trainee action is within the expected action by a predetermined threshold, proceeding to the next submodule (Step A), and

if the trainee action is different from the expected action by the predetermined threshold, generating an error signal, and real-time customizing and rendering a new training for said submodule and presenting the new customized rendering to the trainee (STEP B),

wherein the step of constructing the trainee action includes establishing a virtual 3-dimensional (3D) space using an octree having a plurality of voxels with one or more voxels of the plurality of voxels being sensorized voxels which is configured to provide a proximity signal when the constructed virtual position via the input device indicates proximity to said sensorized voxels within a predetermined distance threshold.

2 . The method of claim 1 , wherein the VIC is presented to the trainee by one or more of computer screen, a tablet, a monitor, or a projection on a screen.

3 . The method of claim 1 , wherein the input device is one or more of a mouse, a handheld controller, a virtual reality goggle, a touchpad, or a keyboard.

4 . The method of claim 1 , further comprising providing a status indicator to indicate status of the training based on progression of the one or more modules.

5 . The method of claim 1 , wherein the step of real-time customizing and rendering a new training includes varying the step-by-step instructions in each submodule.

6 . The method of claim 5 , wherein the variation of the step-by-step instructions in each submodule includes skipping one or more of the step-by-step instructions.

7 . The method of claim 5 , wherein the variation of the step-by-step instructions in each submodule includes speeding up time between each of the step-by-step instructions.

8 . The method of claim 5 , wherein the variation of the step-by-step instructions in each submodule includes slowing down time between each of the step-by-step instructions.

9 . The method of claim 5 , wherein the variation of the step-by-step instructions in each submodule includes real-time adding a new step in the step-by-step instructions.

10 . A virtual reality system for providing training in a virtual reality training room for training a trainee, comprising:

one or more rendering devices configured to display a virtual training projection (VIC), the VIC includes a virtual robot (VOB) that is configured to guide the trainee in the virtual training; and

one or more input devices configured to provide inputs from the trainee; and

a processing system having a processor configured to execute instructions maintained on a non-transitory memory, the processor configured to:

render a virtual reality training room scene that includes a specialized processing equipment (SPE) on which to train the trainee,

present to the trainee an introduction to the VIC, and

present to the trainee one or more modules associated with operation or assembly of the SPE,

for each module:

STEP A: present a step-by-step initial set of instructions constituting one or more submodules for operating or assembling the SPE, organized by the VOB,

STEP (B): at the end of each submodule, request the trainee to repeat the steps covered in said submodule,

receive inputs from the trainee via the one or more input devices, the inputs representing the trainee's virtual actions in repeating the step-by-step instructions,

using the trainee's received inputs, construct a trainee action including timing of the trainee action and virtual location of the trainee action and comparing the trainee action with an expected action,

if the trainee action is within the expected action by a predetermined threshold, proceed to the next submodule (Step A), and

if the trainee's action is different from the expected action by the predetermined threshold, generate an error signal, and real-time customize and render a new training for said submodule and presenting the new customized rendering to the trainee (STEP B),

wherein the processor is configured to construct the trainee action based on establishing a virtual 3-dimensional (3D) space using an octree having a plurality of voxels with one or more voxels of the plurality of voxels being sensorized voxels which are configured to provide a proximity signal when the constructed virtual position via the input device indicates proximity to said sensorized voxels within a predetermined distance threshold.

11 . The system of claim 10 , wherein the VIC is presented to the trainee by one or more of computer screen, a tablet, a monitor, or a projection on a screen.

12 . The system of claim 10 , wherein the input device is one or more of a mouse, a handheld controller, a virtual reality goggle, a touchpad, or a keyboard.

13 . The system of claim 10 , further comprising providing a status indicator to indicate status of the training based on progression of the one or more modules.

14 . The system of claim 10 , wherein the step of real-time customizing and rendering a new training includes varying the step-by-step instructions in each submodule.

15 . The system of claim 14 , wherein the variation of the step-by-step instructions in each submodule includes skipping one or more of the step-by-step instructions.

16 . The system of claim 14 , wherein the variation of the step-by-step instructions in each submodule includes speeding up time between each of the step-by-step instructions.

17 . The system of claim 14 , wherein the variation of the step-by-step instructions in each submodule includes slowing down time between each of the step-by-step instructions.

18 . The system of claim 14 , wherein the variation of the step-by-step instructions in each submodule includes real-time adding a new step in the step-by-step instructions.

Assignments (1)

Continuity (1)

References Cited (50)