IP Library Granted Patent US 11,747,909
Granted Patent B2
US 11,747,909 · App. 17/498,971 · Granted Sep 5, 2023

Augmented reality task flow optimization systems

Inventor: Karim Fikani (Santa Clara, CA)
Assignee: WEST TEXAS TECHNOLOGY PARTNERS, LLC
G06F3/017G02B27/017G06F3/011G06F3/012G06F3/0482G06F3/0485G06F3/04845G06Q10/0633G06Q10/06316G06Q10/063116G06T7/60G06T7/73G06V40/107G06V40/28G02B2027/014G02B2027/0138G06F2203/04806G06T2207/30196G06V40/117
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,747,909
App. No.
17/498,971
Granted
Sep 5, 2023
Kind
B2
Abstract

A method, system, apparatus, and/or device for adjusting a task or a task flow in an augmented reality environment. The method, system, apparatus, and/or device may include: identifying a first task in a task flow to collect data associated with a user performing the first task; collecting a first set of data associated with the user performing the first task; comparing an amount of time the user expends to perform the first task to a first threshold amount of time; and in response to the amount of time the user expends to perform the first task exceeding the first threshold amount of time displaying a notification to the user or another device.

Claims (58)

1. A device, comprising:

a head-mounted display configured to display a virtual object in an augmented reality environment;

a sensor configured to monitor a user performing a task;

a processing device coupled to the head-mounted display and the sensor, wherein the processing device is configured to:

identify the task in a task flow for a project to collect data associated with the user performing the task;

display a message associated with the task;

collect data for the task using the sensor;

identify a data model based on a user profile for the user;

compare an amount of time the user expends to perform the task to a threshold amount of time associated with the data model; and

in response to the amount of time the user expends to perform the task exceeding the threshold amount of time:

provide a first notification to the user while performing the task;

provide a second notification to the user when the task or the project is completed;

send a third notification to another device indicating an improvement to the task or the task flow for the project; and

adjust at least one of the device, the task flow, the message associate with the task, the first notification, the second notification, or the third notification based on the collected data.

2. The device of claim 1 , wherein the first notification includes a suggestion to aid the user in performing the task.

3. The device of claim 1 , wherein the first notification includes communication link to another device associated with an expert or an individual with experience performing the task.

4. The device of claim 1 , wherein the first notification includes a request for the user to provide feedback via an input device indicating whether the first notification was helpful to the user in completing the task.

5. The device of claim 1 , wherein the second notification includes a communication link to another device associated with an expert or an individual with experience performing the task.

6. The device of claim 1 , wherein the second notification includes a message indicating the user performed an extra step or an extra activity when performing the task.

7. The device of claim 1 , wherein the first notification or the second notification include a safety notification.

8. The device of claim 1 , wherein the third notification includes a message indicating an improvement to the task or the task flow based on the collected data.

9. The device of claim 1 , wherein the processing device is configured to, in response to the amount of time the user expends to perform the task not exceeding the threshold amount of time, select another task of the task flow to compare to another threshold amount of time and provide an associated notification for.

10. The device of claim 1 , wherein to adjust the device the processing device is configured to adjust a configuration of the head-mounted display based on the collected data.

11. The device of claim 10 , wherein to adjust the configuration of the head-mounted display the processing device is configure to adjust a lighting configuration of the head-mounted display.

12. The device of claim 1 , wherein the processing device is configured to adjust the task flow based on the collected data.

13. The device of claim 1 , wherein the processing device is configured to adjust the message associated with the task, the first notification, the second notification, or the third notification based on the collected data.

14. A device, comprising:

a display configured to display a virtual object in an augmented reality environment or a virtual reality environment;

a sensor configured to monitor a user performing a task; and

a processing device coupled to the display and the sensor, wherein the processing device is configured to:

identify the task in a task flow for a project to collect data associated with the user performing the task;

collect data for the task using the sensor;

compare an amount of time the user expends to perform the task to a threshold amount of time associated with a user profile for the user; and

in response to the amount of time the user expends to perform the task exceeding the threshold amount of time:

display a first notification to the user while performing the task;

display a second notification to the user when the task or the project is completed; or

send a third notification to another device indicating an improvement to the first task or the task flow.

15. The device of claim 14 , wherein the processing device is further configured to, in response to the amount of time the user expends to perform the task exceeding the threshold amount of time, adjust at least one of the device, the task flow, the first notification, or the second notification based on the collected data.

16. A method, comprising:

identifying, by a processing device, a first task in a task flow to collect data associated with a user performing the first task;

collecting, by a sensor, a first set of data associated with the user performing the first task;

comparing, by the processing device, an amount of time the user expends to perform the first task to a first threshold amount of time; and

in response to the amount of time the user expends to perform the first task exceeding the first threshold amount of time:

displaying, by the display, a first notification to the user while performing the first task;

displaying, by the display, a second notification to the user when the first task or the project is completed;

sending, by the processing device, a third notification to another device indicating an improvement to the first task or the task flow for a project; or

adjusting, by the processing device, the at least one of the task flow, the first notification, the second notification, or the third notification based on the first set of data.

17. The method of claim 16 , wherein the first threshold amount of time corresponds to a user profile associated with the user.

18. The method of claim 17 , wherein the first threshold amount of time is based on an experience feature of the user, an industry associated with the first task, or an environmental condition in an area where the first task is performed by the user.

19. The method of claim 16 , further comprising:

identifying, by the processing device, a second task in the task flow to collect data associated with the user performing the second task;

collecting, by the sensor, a second set of data associated with the user performing the second task;

comparing, by the processing device, an amount of time the user expends to perform the second task to a second threshold amount of time; and

in response to the amount of time the user expends to perform the second task exceeding the second threshold amount of time:

displaying, by the display, a fourth notification to the user while performing the second task;

displaying, by the display, a fifth notification to the user when the second task or the project is completed;

sending, by the processing device, a sixth notification to the other device indicating an improvement to the second task or the task flow for the project; or

adjusting, by the processing device, at least one of the task flow, the fourth notification, the fifth notification, or the sixth notification based on the second set of data.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2022
From: ATHEER, INC.
To: WEST TEXAS TECHNOLOGY PARTNERS, LLC
Reel/Frame 058962/0067 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2022
From: FIKANI, KARIM
To: ATHEER, INC.
Reel/Frame 058926/0017 →
Continuity (3)
Continuation 16422013 · May 24, 2019
Provisional Application 62678211 · May 30, 2018
Related Publication 20220028297A1 · Jan 27, 2022