IP Library Granted Patent US 12,106,676
Granted Patent B2
US 12,106,676 · App. 16/451,730 · Granted Oct 1, 2024

Virtual reality training and evaluation system

Inventors: J. Eric Pike (Lewisville, NC); Lamar Kearson (Savannah, GA)
Assignee: PIKE ENTERPRISES, LLC
G09B19/003G06F3/011G06T19/003G09B5/02G06T2200/04G09B19/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,106,676
App. No.
16/451,730
Granted
Oct 1, 2024
Kind
B2
Abstract

A virtual reality training and evaluation system may comprise a visual display device, one or more user input devices, one or more computer processors, a memory, and a network communication device. Computer-executable instructions are stored in the memory and configured to cause the one or more computer processors to execute a virtual reality training program that simulates a virtual environment displayed on the visual display device. A user is typically prompted to complete a task within the virtual environment. The task may be an electrical, gas, or water construction, maintenance, or service task. User interactions with the virtual environment in order to complete the task are received via the one or more user input devices. The user's performance of the task (and related subtasks) is typically monitored and compared to defined evaluation criteria. Thereafter, the user may be provided with an evaluation.

Claims (75)

1. A virtual reality training and evaluation system, comprising:

a visual display device;

one or more user input devices;

one or more computer processors;

a memory;

a network communication device; and

computer-executable instructions stored in the memory, executable by the one or more computer processors, and configured to cause the one or more computer processors to perform the steps of:

executing a virtual reality training module, wherein the virtual reality training module is configured to simulate a virtual environment, wherein simulating the virtual environment comprises displaying at least a portion of the virtual environment on the visual display device and receiving user interactions with the virtual environment via the one or more user input devices, wherein the virtual environment is a virtual electrical line working environment;

during execution of the virtual reality training module, prompting a user to perform a task in the virtual environment, wherein the task is an electrical line working task, wherein the task is selected from a group consisting of replacement of a transformer bank, use of a load break tool, use of a mechanical jumper, crossarm replacement, fanning out phases to make room for a reconductor, underground primary elbow installation, moving a deadened tap, proper cover up, and removal of three phase jumpers;

during performance of the task, monitoring the user interactions with the virtual environment;

comparing the user interactions with predefined safety criteria, wherein comparing the user interactions with the predefined safety criteria comprises determining whether the user has completed one or more subtasks associated with the task, wherein each of the one or more subtasks is associated with a numeric safety level score weighting factor, wherein the one or more subtasks comprises a first subtask associated with a first safety level score weighting factor and a second subtask associated with a second safety level score factor, wherein the first safety level score weighting factor is greater than the second safety level score weighting factor;

computing a weighted safety score for each of the one or more subtasks based on the numeric safety level score weighting factor and whether the user has completed the one or more subtasks;

computing a cumulative safety score based on the weighted safety score for each of the one or more subtasks; and

based on comparing the user interactions with the predefined safety criteria, providing the user with a safety evaluation, wherein the safety evaluation comprises:

determining whether the cumulative safety score surpasses a predetermined threshold safety score; and

determining whether the user has passed the safety evaluation.

2. The virtual reality training and evaluation system according to claim 1 , wherein the computer-executable instructions are configured to cause the one or more computer processors to perform the steps of:

based on monitoring the user interactions with the virtual environment, comparing the user interactions with predefined efficiency criteria; and

based on comparing the user interactions with the predefined efficiency criteria, providing the user with an efficiency evaluation.

3. The virtual reality training and evaluation system according to claim 2 , wherein:

monitoring the user interactions with the virtual environment comprises recording event data for a plurality of user interaction events; and

the efficiency evaluation is further based on an order and timing of the user interaction events.

4. The virtual reality training and evaluation system according to claim 1 , wherein the computer-executable instructions are configured to cause the one or more computer processors to perform the steps of:

based on monitoring the user interactions with the virtual environment, comparing the user interactions with predefined step-process criteria; and

based on comparing the user interactions with the predefined step-process criteria, providing the user with a step-process evaluation.

5. The virtual reality training and evaluation system according to claim 4 , wherein:

monitoring the user interactions with the virtual environment comprises recording event data for a plurality of user interaction events; and

the step-process evaluation is further based on an order of the user interaction events.

6. The virtual reality training and evaluation system according to claim 1 , wherein comparing the user interactions with the predefined safety criteria comprises determining that the user has not completed a first subtask associated with the task in accordance with the predefined safety criteria, and wherein providing the user with the safety evaluation comprises notifying the user that the first subtask was not completed in accordance with the predefined safety criteria.

7. The virtual reality training and evaluation system according to claim 1 , wherein the virtual environment is a virtual hazardous environment.

8. The virtual reality training and evaluation system according to claim 1 , wherein the user is a first user, and the virtual environment is a shared virtual environment further comprising a second user, wherein the computer-executable instructions are configured to cause the one or more computer processors to perform the steps of:

displaying the shared virtual environment to the first user and the second user;

simultaneously monitoring interactions of the first user and the second user with the shared virtual environment; and

comparing the interactions of the first user and the second user with the predefined safety criteria.

9. The virtual reality training and evaluation system according to claim 8 , wherein the second user is a qualified observer for the first user.

10. A computer-implemented method for virtual reality training and evaluation, the computer-implemented method comprising the steps of:

executing a virtual reality training module, wherein the virtual reality training module is configured to simulate a virtual environment, wherein simulating the virtual environment comprises displaying at least a portion of the virtual environment on a visual display device and receiving user interactions with the virtual environment via one or more user input devices, wherein the virtual environment is a virtual electrical line working environment;

during execution of the virtual reality training module, prompting a user to perform a task in the virtual environment, wherein the task is an electrical line working task, wherein the task is selected from a group consisting of replacement of a transformer bank, use of a load break tool, use of a mechanical jumper, crossarm replacement, fanning out phases to make room for a reconductor, underground primary elbow installation, moving a deadened tap, proper cover up, and removal of three phase jumpers;

during performance of the task, monitoring the user interactions with the virtual environment;

comparing the user interactions with predefined safety criteria, wherein comparing the user interactions with the predefined safety criteria comprises determining whether the user has completed one or more subtasks associated with the task, wherein each of the one or more subtasks is associated with a numeric safety level score weighting factor, wherein the one or more subtasks comprises a first subtask associated with a first safety level score weighting factor and a second subtask associated with a second safety level score factor, wherein the first safety level score weighting factor is greater than the second safety level score weighting factor;

computing a weighted safety score for each of the one or more subtasks based on the numeric safety level score weighting factor and whether the user has completed the one or more subtasks;

computing a cumulative safety score based on the weighted safety score for each of the one or more subtasks; and

based on comparing the user interactions with the predefined safety criteria, providing the user with a safety evaluation, wherein the safety evaluation comprises:

determining whether the cumulative safety score surpasses a predetermined threshold safety score; and

determining whether the user has passed the safety evaluation.

11. The computer-implemented method according to claim 10 further comprising the steps of:

based on monitoring the user interactions with the virtual environment, comparing the user interactions with predefined efficiency criteria; and

based on comparing the user interactions with the predefined efficiency criteria, providing the user with an efficiency evaluation.

12. The computer-implemented method according to claim 11 , wherein:

monitoring the user interactions with the virtual environment comprises recording event data for a plurality of user interaction events; and

the efficiency evaluation is further based on an order and timing of the user interaction events.

13. The computer-implemented method according to claim 10 further comprising the steps of:

based on monitoring the user interactions with the virtual environment, comparing the user interactions with predefined step-process criteria; and

based on comparing the user interactions with the predefined step-process criteria, providing the user with a step-process evaluation.

14. The computer-implemented method according to claim 13 , wherein:

monitoring the user interactions with the virtual environment comprises recording event data for a plurality of user interaction events; and

the step-process evaluation is further based on an order of the user interaction events.

15. The computer-implemented method according to claim 10 , wherein the virtual environment is a virtual electrical line working environment, and the task is an electrical line working task.

16. The computer-implemented method according to claim 10 , wherein the user is a first user, and the virtual environment is a shared virtual environment further comprising a second user, the computer-implemented method further comprising the steps of:

displaying the shared virtual environment to the first user and the second user;

simultaneously monitoring interactions of the first user and the second user with the shared virtual environment; and

comparing the interactions of the first user and the second user with the predefined safety criteria.

17. A computer program product for virtual reality training and evaluation, wherein the computer program product comprises a non-transitory computer-readable medium comprising computer-readable instructions, the computer-readable instructions, when executed by a processing device, cause the processing device to perform the steps of:

executing a virtual reality training module, wherein the virtual reality training module is configured to simulate a virtual environment, wherein simulating the virtual environment comprises displaying at least a portion of the virtual environment on a visual display device and receiving user interactions with the virtual environment via one or more user input devices, wherein the virtual environment is a virtual electrical line working environment;

during execution of the virtual reality training module, prompting a user to perform a task in the virtual environment, wherein the task is an electrical line working task, wherein the task is selected from a group consisting of replacement of a transformer bank, use of a load break tool, use of a mechanical jumper, crossarm replacement, fanning out phases to make room for a reconductor, underground primary elbow installation, moving a deadened tap, proper cover up, and removal of three phase jumpers;

during performance of the task, monitoring the user interactions with the virtual environment;

comparing the user interactions with predefined safety criteria, wherein comparing the user interactions with the predefined safety criteria comprises determining whether the user has completed one or more subtasks associated with the task, wherein each of the one or more subtasks is associated with a numeric safety level score weighting factor, wherein the one or more subtasks comprises a first subtask associated with a first safety level score weighting factor and a second subtask associated with a second safety level score factor, wherein the first safety level score weighting factor is greater than the second safety level score weighting factor;

computing a weighted safety score for each of the one or more subtasks based on the numeric safety level score weighting factor and whether the user has completed the one or more subtasks;

computing a cumulative safety score based on the weighted safety score for each of the one or more subtasks; and

based on comparing the user interactions with the predefined safety criteria, providing the user with a safety evaluation, wherein the safety evaluation comprises:

determining whether the cumulative safety score surpasses a predetermined threshold safety score; and

determining whether the user has passed the safety evaluation.

18. The virtual reality training and evaluation system according to claim 1 , wherein the computer-executable instructions are configured to cause the one or more computer processors to perform the step of tracking use of virtual tools provided to the user within the virtual environment, wherein the virtual tools are stored in a virtual toolbox within the virtual environment, wherein the virtual tools comprise at least one tool selected from a group consisting of a cable connection, load break tool, square cut tool, spiral cut tool, crimp tool, insulation scoring tool, elbow probe insert tool, and a tool to manipulate switches, wherein computing the cumulative safety score is further based on tracking the use of the virtual tools by the user, wherein tracking the use of the virtual tools by the user comprises detecting that the user has failed to use the at least one tool or has unnecessarily used multiple tools of the virtual tools.

19. The computer-implemented method according to claim 10 , wherein the computer-implemented method further comprises the step of tracking use of virtual tools provided to the user within the virtual environment, wherein the virtual tools are stored in a virtual toolbox within the virtual environment, wherein the virtual tools comprise at least one tool selected from a group consisting of a cable connection, load break tool, square cut tool, spiral cut tool, crimp tool, insulation scoring tool, elbow probe insert tool, and a tool to manipulate switches, wherein computing the cumulative safety score is further based on tracking the use of the virtual tools by the user, wherein tracking the use of the virtual tools by the user comprises detecting that the user has failed to use the at least one tool or has unnecessarily used multiple tools of the virtual tools.

20. The computer program product according to claim 17 , wherein the computer-readable instructions, when executed by a processing device, further cause the processing device to perform the step of tracking use of virtual tools provided to the user within the virtual environment, wherein the virtual tools are stored in a virtual toolbox within the virtual environment, wherein the virtual tools comprise at least one tool selected from a group consisting of a cable connection, load break tool, square cut tool, spiral cut tool, crimp tool, insulation scoring tool, elbow probe insert tool, and a tool to manipulate switches, wherein computing the cumulative safety score is further based on tracking the use of the virtual tools by the user, wherein tracking the use of the virtual tools by the user comprises detecting that the user has failed to use the at least one tool or has unnecessarily used multiple tools of the virtual tools.

Assignments (4)
PATENT SECURITY AGREEMENT Recorded Dec 19, 2025
From: PIKE ENTERPRISES, LLC
To: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
Reel/Frame 073968/0428 →
RELEASE OF SECURITY INTEREST Recorded Aug 16, 2022
From: MORGAN STANLEY SENIOR FUNDING, INC., AS ADMINISTRATIVE AGENT
To: PIKE ENTERPRISES, LLC; PIKE ENGINEERING, LLC
Reel/Frame 060822/0339 →
GRANT OF SECURITY INTEREST Recorded Aug 11, 2022
From: PIKE ENTERPRISES, LLC; PIKE ENGINEERING, LLC
To: MORGAN STANLEY SENIOR FUNDING, INC., AS ADMINISTRATIVE AGENT
Reel/Frame 061148/0859 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2020
From: PIKE, J. ERIC; KEARSON, LAMAR
To: PIKE ENTERPRISES, LLC
Reel/Frame 051452/0688 →
Continuity (2)
Provisional Application 62689487 · Jun 25, 2018
Related Publication 20190392728A1 · Dec 26, 2019
Cited By (1)
US 12,505,757