CLASSIFYING WORK PROCESSES
A system and method for classifying tasks are described. A server receives first sensor data from an augmented reality (AR) device and second sensor data from a first machine detected by the AR device. The first and second sensor data are related to a user of the AR device operating the first machine. The server identifies a task of the user based on the first and second sensor data. A task result of the user of the AR device operating the first machine is determined. The server accesses task patterns and corresponding levels of difficulty related to the first machine and determines a difficulty of the task based on a comparison of the task, the task result, and the task patterns and corresponding levels of difficulty. The AR application generates AR content based on the task and the difficulty of the task.
1 . A server comprising:
one or more hardware processors comprising an AR application and a classification engine,
the classification engine configured to:
receive first sensor data from an AR device and second sensor data from a first machine detected by the AR device, the first and second sensor data related to a user of the AR device operating the first machine;
identify a task of the user based on the first and second sensor data;
identify a task result of the user of the AR device operating the first machine;
access task patterns and corresponding levels of difficulty related to the first machine; and
determine a difficulty of the task based on a comparison of the task, the task result, and the task patterns and corresponding levels of difficulty, and
the AR application configured to:
generate AR content based on the task and the difficulty of the task.
2 . The server of claim 1 , wherein the classification engine is further configured to:
receive third sensor data from a sensor external to the AR device and to the first machine; and
identify the task and the task result based on the first, second, and third sensor data.
3 . The server of claim 1 , wherein the first sensor data comprises a combination of at least user data, AR device data, and sensor data generated by sensors of the AR device.
4 . The server of claim 1 , wherein the second sensor data comprises a combination of at least first machine specification data, first machine operational status data, and sensor data generated by sensors of the first machine.
5 . The server of claim 1 , wherein the classification engine is further configured to:
receive third sensor data from a second machine;
determine a first interaction between the user of the AR device and the first machine, a second interaction between the user of the AR device and the second machine, and a third interaction between the first machine and the second machine based on the first, second, and third sensor data;
identify a second task of the user based on the first, second, and third interactions;
identify a second task result of the user of the AR device operating the first and second machines;
access task patterns and corresponding levels of difficulty related to the first and second machines; and
determine a difficulty of the second task based on a comparison of the second task, the second task result, and the task patterns and corresponding levels of difficulty related to the first and second machines.
6 . The server of claim 5 , wherein the AR application is further configured to:
generate a first AR content based on the difficulty of the task and a second AR content based on the difficulty of the second task; and
communicate the first and second AR content to the AR device, the first and second AR content to be displayed in a transparent display of the AR device.
7 . The server of claim 1 , wherein the classification engine is further configured to:
determine a skill level of the user based on the task of the user, the task result, and the difficulty of the task.
8 . The server of claim 1 , wherein the classification engine is further configured to:
receive a plurality of sensor data from a plurality of AR devices configured to detect the first machine;
determine the task patterns based on the plurality of sensor data and the second sensor data from the first machine;
determine the task result based on the plurality of sensor data and the second sensor data from the first machine; and
determine the level of difficulty for the first machine based on the task patterns and the task result.
9 . The server of claim 1 , wherein the first sensor data includes biometric data indicative of a physical and mental state of the user of the AR device operating the first machine, and
wherein the classification engine is further configured to:
identify an attention level of the user of the AR device in performing the task based on the biometric data; and
classify the level of difficulty of the task based on the attention level.
10 . The server of claim 1 , wherein the classification engine is further configured to:
identify an operation sequence of the user operating the first machine based on the first and second sensor data; and
determine a predicted task result based on a comparison of the operation sequence, the task patterns, and the corresponding levels of difficulty related to the first machine; and
wherein the AR application is further configured to:
generate a second AR content based on the predicted task result.
11 . A method comprising:
receiving, at a server, first sensor data from an AR device and second sensor data from a first machine detected by the AR device, the first and second sensor data related to a user of the AR device operating the first machine;
identifying a task of the user based on the first and second sensor data;
identifying a task result of the user of the AR device operating the first machine;
accessing task patterns and corresponding levels of difficulty related to the first machine;
determining a difficulty of the task based on a comparison of the task, the task result, and the task patterns and corresponding levels of difficulty; and
generating AR content based on the task and the difficulty of the task.
12 . The method of claim 11 , further comprising:
receiving third sensor data from a sensor external to the AR device and to the first machine; and
identifying the task and the task result based on the first, second, and third sensor data.
13 . The method of claim 11 , wherein the first sensor data comprises a combination of at least user data, AR device data, and sensor data generated by sensors of the AR device.
14 . The method of claim 11 , wherein the second sensor data comprises a combination of at least first machine specification data, first machine operational status data, and sensor data generated by sensors of the first machine.
15 . The method of claim 11 , further comprising:
receiving third sensor data from a second machine;
determining a first interaction between the user of the AR device and the first machine, a second interaction between the user of the AR device and the second machine, and a third interaction between the first machine and the second machine based on the first, second, and third sensor data;
identifying a second task of the user based on the first, second, and third interactions;
identifying a second task result of the user of the AR device operating the first and second machines;
accessing task patterns and corresponding levels of difficulty related to the first and second machines; and
determining a difficulty of the second task based on a comparison of the second task, the second task result, and the task patterns and corresponding levels of difficulty related to the first and second machines.
16 . The method of claim 15 , further comprising:
generating a first AR content based on the difficulty of the task and a second AR content based on the difficulty of the second task; and
communicating the first and second AR content to the AR device, the first and second AR content to be displayed in a transparent display of the AR device.
17 . The method of claim 11 , further comprising:
determining a skill level of the user based on the task of the user, the task result, and the difficulty of the task.
18 . The method of claim 11 , further comprising:
receiving a plurality of sensor data from a plurality of AR devices configured to detect the first machine;
determining the task patterns based on the plurality of sensor data and the second sensor data from the first machine;
determining the task result based on the plurality of sensor data and the second sensor data from the first machine; and
determining the level of difficulty for the first machine based on the task patterns and the task result.
19 . The method of claim 11 , wherein the first sensor data includes biometric data indicative of a physical and mental state of the user of the AR device operating the first machine, and
wherein the method further comprises:
identifying an attention level of the user of the AR device in performing the task based on the biometric data; and
classifying the level of difficulty of the task based on the attention level.
20 . A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
receiving, at a server, first sensor data from an AR device and second sensor data from a first machine detected by the AR device, the first and second sensor data related to a user of the AR device operating the first machine;
identifying a task of the user based on the first and second sensor data;
identifying a task result of the user of the AR device operating the first machine;
accessing task patterns and corresponding levels of difficulty related to the first machine;
determining a difficulty of the task based on a comparison of the task, the task result, and the task patterns and corresponding levels of difficulty; and
generating AR content based on the task and the difficulty of the task.