Granted Patent B2

US 12,254,434 · App. 17/655,966 · Granted Mar 18, 2025

Inventor: Syed Munib Hadi (Dhahran, SA)

Assignee: SAUDI ARABIAN OIL COMPANY

G06Q10/0639G06F3/011

Abstract

Claims (114)

1. A method, comprising:

determining, by a first user device, a plurality of tasks for a first user associated with a first user assessment;

generating, by the first user device, a user avatar within a virtual reality (VR) space for the first user assessment based on the plurality of tasks;

transmitting, by the first user device during the first user assessment, first VR image data to a first headset coupled to the first user device, wherein the first VR image data corresponds to the VR space;

obtaining, by the first user device and from a second user device, a request to access the VR space for a second user;

generating, in response to obtaining the request to access the VR space, an evaluator avatar in the VR space;

transmitting, by the first user device during the first user assessment, second VR image data to a second headset coupled to the second user device;

transmitting, from the second user device and to the first user device during the first user assessment, assessment feedback in real time within the VR space in response to the evaluator avatar observing the user avatar performing a first task among the plurality of tasks;

transmitting, from the second user device and to the first user device, a first command that adjusts a second task among the plurality of tasks in real time to produce an adjusted task, wherein the adjusted task comprises an additional VR component not included in the second task; and

generating, by the first user device, a user assessment recording in response to the first user performing the first task and the adjusted task in the VR space,

wherein the user assessment recording is based on the first VR image data and the second VR image data,

wherein the user assessment recording comprises the assessment feedback, a first viewpoint from the user avatar, and a second viewpoint from the evaluator avatar,

wherein the user avatar of the first user is based on image data from a camera device coupled to the first user device, and

wherein the user assessment recording is a mixed-reality recording of the first user assessment.

2. The method of claim 1 , further comprising:

obtaining, from a touch controller coupled to the first user device, one or more user inputs in response to performing one or more tasks among the plurality of tasks in the VR space; and

determining, by the first user device, whether the first user satisfied the first user assessment based on the one or more user inputs.

3. The method of claim 2 , further comprising:

transmitting, to a server, a second command that updates one or more user records in response to determining that the first user satisfied the first user assessment.

4. The method of claim 1 , further comprising:

presenting, to a display device coupled to a third user device, third VR image data,

wherein the third VR image data presents a third-person viewpoint of the user avatar and the evaluator avatar in the VR space.

5. The method of claim 1 ,

wherein the first VR image data presents a first-person viewpoint of the VR space to the first user.

6. The method of claim 1 , further comprising:

obtaining, from the camera device, first image data of a second user performing a second user assessment; and

determining, by the first user device and using an artificial intelligence (AI) model, whether the second user that is performing the second user assessment is an authorized user that used a user credential to initiate a VR session for the second user assessment.

7. The method of claim 6 ,

wherein the AI model is a deep neural network comprising an input layer, a plurality of hidden layers, and an output layer,

wherein the input layer obtains as inputs an image in the user credential and second image data of the second user that is obtained by the camera device prior to initiating the VR session, and

wherein the deep neural network predicts whether the second user is the same as the authorized user at the output layer.

8. The method of claim 1 , further comprising:

obtaining biometric data from the first user;

obtaining user registration data associated with the first user assessment; and

determining whether the first user is authorized to perform the first user assessment based on the biometric data and the user registration data, and

wherein the VR space is generated in response to determining that the first user is authorized to perform the first user assessment.

9. The method of claim 1 ,

wherein the VR space is a virtual reality environment corresponding to a plant facility,

wherein the VR space comprises a plurality of VR plant components that are affected by a VR environmental factor, and

wherein the plurality of VR plant components correspond to a plurality of plant devices and the VR environmental factor corresponds to a predetermined amount of wind in the VR space at a predetermined wind direction and wind speed.

10. The method of claim 1 ,

wherein the first user assessment is selected from a group consisting of a plant inspector certification, a supervisor certification, an electric hazard recognition assessment, and a scaffolding certification.

11. The method of claim 1 ,

wherein the first user device is a kiosk comprising a first pod and a second pod,

wherein the first user assessment is performed at the first pod simultaneously with a second user assessment that is performed at the second pod, and

wherein the first user assessment corresponds to a plant certification that is different from the second user assessment.

12. A user device, comprising:

a first touch controller;

a first headset;

a first tracking sensor;

a first display device;

a first camera device; and

a user assessment manager comprising a computer processor and memory, wherein the user assessment manager is coupled to the first touch controller, the first headset, the first tracking sensor, the first display device, and the first camera device, and wherein the user assessment manager is configured to perform a method comprising:

determining a plurality of tasks associated with a first user assessment;

generating a user avatar within a virtual reality (VR) space for the first user assessment based on the plurality of tasks;

, transmitting, to the first headset, first VR image data corresponding to the VR space;

obtaining, from a second user device, a request to access the VR space for a second user;

generating, in response to obtaining the request to access the VR space, an evaluator avatar in the VR space;

transmitting, during the first user assessment, second VR image data to a second headset coupled to the second user device;

obtaining, from the second user device during the first user assessment, assessment feedback in real time within the VR space in response to the evaluator avatar observing the user avatar performing a first task among the plurality of tasks;

obtaining, from the second user device, a command that adjusts a second task among the plurality of tasks in real time to produce an adjusted task, wherein the adjusted task comprises an additional VR component not included in the second task;

generating, in response to a first user performing the first task and the adjusted task, a user assessment recording,

wherein the user assessment recording is based on the first VR image data and the second VR image data,

wherein the user assessment recording comprises the assessment feedback, a first viewpoint from the user avatar, and a second viewpoint from the evaluator avatar,

wherein the user avatar of the first user is based on first image data from the first camera device,

wherein the user assessment recording is a mixed-reality recording of the first user assessment.

13. The user device of claim 12 , further comprising:

a plurality of pods comprising a first pod and a second pod,

wherein the first pod comprises the first touch controller, the first headset, the first tracking sensor, the first display device, and the first camera device,

wherein the second pod comprises a second touch controller, a second headset, a second tracking sensor, a second display device, and a second camera device, and

wherein the user assessment manager is configured to perform a plurality of user assessments simultaneously using the plurality of pods.

14. The user device of claim 12 , further comprising:

a printing device coupled to the user assessment manager,

wherein the printing device is configured to produce a printed hardcopy of assessment feedback based on the first user assessment.

15. The user device of claim 12 , further comprising:

a second camera device coupled to the user assessment manager,

wherein the first VR image data corresponds to a first viewpoint,

wherein the user assessment recording further comprises second VR image data for a second viewpoint that corresponds to the second camera device, and

wherein the user assessment recording is configured to switch between the first viewpoint and the second viewpoint in response to a user selection.

16. The user device of claim 12 , wherein the user assessment manager is further configured to:

obtain, from the first camera device, second image data regarding the first user;

obtain third image data regarding a user credential of the first user; and

determine, automatically based on an analysis of the second image data and the third image data, whether the first user is authorized to perform the first user assessment, and

wherein the VR space is generated in response to determining that the first user is authorized to perform the first user assessment.

17. The user device of claim 12 , wherein the user assessment manager is further configured to:

obtain, from the first camera device, second image data regarding the first user;

obtain third image data of a second user performing the first user assessment in the VR space;

determine whether the first user and the second user are the same user based on an analysis of the third image data and the second image data; and

terminate, in response to determining that the first user and the second user are different users, the VR space for the first user assessment.

18. The user device of claim 12 , further comprising:

a microphone device coupled to the user assessment manager,

wherein the user assessment manager is further configured to:

obtain, from the microphone device, sound data of the first user performing the first user assessment;

determine whether the first user is receiving assistance from an external source based on an analysis of the sound data; and

terminate, in response to determining that the first user is receiving the assistance from the external source, the VR space for the first user assessment.

19. A server, comprising:

a computer processor; and

a memory coupled to the computer processor, wherein the memory is configured to perform a method comprising:

obtaining, from a first user device, a first request to access a first VR space for a first user that is performing a user assessment;

obtaining, from a second user device, a second request to access the first VR space for a second user;

establishing, in response to obtaining the first request and the second request, a network connection between the first user device and the second user device, wherein the first user device hosts the first VR space;

determining a plurality of tasks for the first user associated with the user assessment;

transmitting, to the first user device, first VR image data comprising a user avatar and an evaluator avatar in the first VR space,

wherein the user avatar corresponds to the first user performing the user assessment, and

wherein the evaluator avatar corresponds to the second user that is an evaluator of the user assessment;

transmitting, to the second user device, second VR image data;

obtaining, from the second user device during the user assessment, assessment feedback in response to the evaluator avatar observing the user avatar performing a first task among the plurality of tasks;

transmitting, to the first user device, the assessment feedback in real time within the VR space;

obtaining, from the second user device, a command that adjusts a second task among the plurality of tasks in real time to produce an adjusted task, wherein the adjusted task comprises an additional VR component not included in the second task; and

generating a user assessment recording in response to the first user performing the first task and the adjusted task in the VR space,

wherein the user assessment recording is based on the first VR image data and the second VR image data,

wherein the user assessment recording comprises the assessment feedback, a first viewpoint from the user avatar, and a second viewpoint from the evaluator avatar,

wherein the user avatar of the first user is based on image data from a camera device coupled to the first user device, and

wherein the user assessment recording is a mixed-reality recording of the user assessment.

Assignments (1)

Continuity (1)

References Cited (58)