IP Library › Granted Patent US 12,373,734
Granted Patent B2
US 12,373,734 · App. 17/960,943 · Granted Jul 29, 2025

Apparatus for machine operatormachine operator feedback correlation

Inventors: Bradford Everman (Haddonfield, NJ); Brian Bradke (Brookfield, VT)
G06N20/00G06N3/0442G06N3/08G06N5/022
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,373,734
App. No.
17/960,943
Granted
Jul 29, 2025
Kind
B2
Abstract

In an aspect, an apparatus for machine operator feedback correlation is presented. An apparatus includes at least a processor and a memory communicatively connected to the at least a processor. A memory contains instructions configuring at least a processor to receive, through a sensing device, performance data of at least a machine operator. At least a processor is configured to classify performance data to a performance category through a performance classifier. At least a processor is configured to calculate a performance determination. At least a processor is configured to generate a feedback correlation through a machine operator feedback correlation machine learning model. At least a processor is configured to provide a feedback correlation to a user through a display device.

Claims (46)

1. An apparatus for machine operator feedback correlation, comprising:

at least a processor; and

a memory communicatively connected to the at least a processor, the memory containing instructions configuring the at least a processor to:

receive, through a sensing device, performance data of at least a machine operator;

classify the performance data to a performance category using a performance classifier;

compare the performance data to a performance parameter comprising a metric related to a task;

calculate a performance determination comprising a scoring of completion of the task as a function of the comparison;

generate, as a function of the performance determination, a feedback correlation using a machine operator feedback machine learning model comprising a supervised machine learning process, wherein generating the feedback correlation further comprises:

receive machine operator feedback training data and wherein the machine operator feedback training data is a data set that correlates performance parameters and performance determination to machine operator feedback parameters;

train, iteratively, the machine operator feedback machine learning model using the machine operator training data and utilizing a scoring function representing an expected loss of an algorithm relating inputs to outputs wherein the expected loss is computed as an error function representing a degree to which a prediction generated by the relation is incorrect when compared to an input-output pair provided in the machine operator training data;

generate, as a function of the trained machine operator feedback machine learning model, a feedback correlation; and

generate at least one confidence level for the feedback correlation;

generate an automation determination as a function of the performance determination and an automation threshold, wherein the automation determination comprises a level of control of a machine of the at least a machine operator, wherein generating the automation determination further comprises:

training an automation machine learning model using training data correlating performance determinations and automation thresholds to automation determinations; and

generating the automation determination as a function of the performance determination and the automation threshold using the trained automation machine learning model; and

provide the feedback correlation and the at least one confidence level for the feedback correlation to the at least a machine operator through a display device.

2. The apparatus of claim 1 , wherein the memory contains instructions further configuring the at least a processor to predict, as a function of the machine operator feedback machine learning model, the performance determination of the at least a machine operator.

3. The apparatus of claim 1 , wherein the memory contains instructions further configuring the at least a processor to generate, as a function of the feedback correlation, a machine operator optimization plan.

4. The apparatus of claim 3 , wherein the memory contains instructions further configuring the at least a processor to display, through the display device, the machine operator optimization plan to the at least a machine operator.

5. The apparatus of claim 1 , wherein the memory contains instructions further configuring the at least a processor to classify the performance data to an environmental parameter.

6. The apparatus of claim 1 , wherein the memory contains instructions further configuring the at least a processor to classify the performance data to a physiological parameter.

7. The apparatus of claim 1 , wherein the memory contains instructions further configuring the at least a processor to generate a machine operator feedback timeline as a function of the machine operator feedback machine learning model.

8. The apparatus of claim 1 , wherein the sensing device comprises an eye movement sensor.

9. The apparatus of claim 1 , wherein the memory contains instructions further configuring the at least a processor to determine a temporal element of the performance determination.

10. A method of machine operator feedback correlation using a computing device, comprising:

receiving, at a computing device and using a sensing device, performance data of at least a machine operator;

classifying, at the computing device, the performance data to a performance category using a performance classifier;

comparing, at the computing device, the performance data to a performance parameter comprising a metric related to a task;

calculating, at the computing device, a performance determination comprising a scoring of completion of the task as a function of the comparison;

generating, at the computing device, as a function of the performance determination, a feedback correlation using a machine operator feedback machine learning model, comprising a supervised machine learning process, wherein generating the feedback correlation further comprises:

receiving machine operator feedback training data and wherein the machine operator feedback training data is a data set that correlates performance parameters and performance determination to machine operator feedback parameters;

training, iteratively, the machine operator feedback machine learning model using the machine operator training data and utilizing a scoring function representing an expected loss of an algorithm relating inputs to outputs wherein the expected loss is computed as an error function representing a degree to which a prediction generated by the relation is incorrect when compared to an input-output pair provided in the machine operator training data;

generating, as a function of the trained machine operator feedback machine learning model, a feedback correlation; and

generating at least one confidence level for the feedback correlation;

generating, an automation determination as a function of the performance determination and an automation threshold, wherein the automation determination comprises a level of control of a machine of the at least a machine operator, wherein generating the automation determination further comprises:

training an automation machine learning model using training data correlating performance determinations and automation thresholds to automation determinations; and

generating the automation determination as a function of the performance determination and the automation threshold using the trained automation machine learning model; and

providing the feedback correlation and the at least one confidence level for the feedback correlation to the at least a machine operator through a display device.

11. The method of claim 10 , further comprising predicting, as a function of the machine operator feedback machine learning model, the performance determination of the at least a machine operator.

12. The method of claim 10 , wherein generating further comprises generating, as a function of the feedback correlation, a machine operator optimization plan.

13. The method of claim 12 , further comprising displaying, through the display device, the machine operator optimization plan to the at least a machine operator.

14. The method of claim 10 , wherein classifying further comprises classifying the performance data to an environmental parameter.

15. The method of claim 10 , wherein classifying further comprises classifying the performance data to a world event parameter.

16. The method of claim 10 , wherein generating comprises generating a performance timeline as a function of the machine operator feedback machine learning model.

17. The method of claim 10 , wherein the sensing device comprises an eye movement sensor.

18. The method of claim 10 , further comprising determining, at the computing device, a temporal element of the performance determination.

Continuity (1)
Related Publication 20240119345A1 · Apr 11, 2024
References Cited (13)
US 9808185B2 · Arnold · 2017 [cited by applicant]
US 11382510B2 · Khare · 2022 [cited by applicant]
US 20120245439A1 · Andre · 2012 [cited by applicant]
Qiao, Z., et al Automatically Generated Curriculum based Reinforcement Learning for Autonomous Vehicles in Urban Environment, [received May 31, 2023]. Retrieved from Internet :< https://ieeexplore.jeee.org/abstract/docu… [cited by examiner]
Harrivel, A., et al, Prediction of Cognitive States during Flight Simulation using Multimodal Psychophysiological Sensing, [received [May 30, 2023]. Retrieved from Internet:<chrome-extension://efaidnbmnnnibpcajpcglclefi… [cited by examiner]
Bernold, L., et al, Equipment Operator Training in the Age of Internet2, [received May 30, 2003]. Retrieved from Internet :<chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/https://citeseerx.ist.psu.edu/document?repi… [cited by examiner]
Jian-Gang, et al, Space Flight Training Simulation Project Technology Research, [received May 31, 2023]. Retrieved from Internet :<https://ieeexplore.ieee.org/abstract/document/5718346> (Year: 2010). [cited by examiner]
Juang, J.R., et al, SimCrane 3D+: A crane simulator with kinesthetic and stereoscopic vision, [received May 31, 2023]. Retrieved from Internet :< https://www.sciencedirect.com/science/article/pii/S1474034613000529> (Yea… [cited by examiner]
Qiao, Z., et al Automatically Generated Curriculum based Reinforcement Learning for Autonomous Vehicles in Urban Environment, [received May 31, 2023]. Retrieved from Internet:< https://ieeexplore.ieee.org/abstract/docum… [cited by examiner]
Rezazadeh, I., et al, Using affective human-machine interface to increase the operation performance in virtual construction crane training system: A novel approach, [received May 31, 2023]. Retrieved from Internet:< htt… [cited by examiner]
Wilson, G., et al, Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks, [received on Sep. 29, 2023]. Retrieved from Internet:<https://journals.sagepub.com/doi/abs/10… [cited by examiner]
Gupta, et al, Performance Monitoring and Assessment of Neuro-Adaptive Controllers for Aerospace Applications Using a Bayesian Approach, [received on Feb. 7, 2024]. Retrieved from Internet:<chrome-extension://efaidnbmnnn… [cited by examiner]
Parasuraman, R., et al, A Model for Types and Levels of Human Interaction with Automation, [received Jul. 1, 2024]. Retrieved from Internet:<https://ieeexplore.ieee.org/abstract/document/844354> (Year: 2000). [cited by examiner]
Cited By (1)
US 12,647,722