IP Library Granted Patent US 12,314,039
Granted Patent B2
US 12,314,039 · App. 17/484,031 · Granted May 27, 2025

Providing a model as an industrial automation object

Inventors: Jordan C. Reynolds (Austin, TX); John J. Hagerbaumer (Mequon, WI); Troy W. Mahr (Pleasant Prairie, WI); Thomas K. Jacobsen (Wake Forest, NC); Giancarlo Scaturchio (Pisa, IT)
Assignee: Rockwell Automation Technologies, Inc.
G05B19/41845G05B19/05G05B19/4183G05B19/4185G05B23/0272G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,314,039
App. No.
17/484,031
Granted
May 27, 2025
Kind
B2
Abstract

Various embodiments of the present technology generally relate to solutions for integrating machine learning models into industrial automation environments. More specifically, embodiments of the present technology include systems and methods for implementing machine learning models within industrial control code to improve performance, increase productivity, and add capability to existing control programs. In an embodiment, a system comprises an interface component configured to display a graphical representation of a machine learning asset in an industrial automation environment, wherein the graphical representation includes a visual indicator representative of an output from the machine learning asset. The interface component is further configured to adjust the visual indicator based on the output from the machine learning asset. In addition, a process control component is configured to control an industrial process in the industrial automation environment based at least in part on the output from the machine learning asset.

Claims (44)

1. A system comprising:

a memory that stores executable components; and

a processor, operatively coupled to the memory, that executes the executable components, the executable components comprising:

an interface component configured to:

display, on a graphical user interface in an industrial automation environment, a graphical representation of a machine learning asset comprising at least one machine learning model, wherein the graphical representation includes:

an asset visual element representing the machine learning asset,

an output visual indicator representing an output from the at least one machine learning model,

a status visual element depicting an operational status of the machine learning asset, and

one or more selectable elements for controlling a behavior of the machine learning asset; and

adjust the graphical representation based at least in part on the output from the at least one machine learning model; and

a process control component configured to adjust at least one parameter for controlling an industrial device in the industrial automation environment based at least in part on the output from the at least one machine learning model, wherein the industrial device is also visible to an operator viewing the graphical user interface from inside the industrial automation environment.

2. The system of claim 1 , wherein the at least one machine learning model uses operational data from the industrial device as input.

3. The system of claim 2 , wherein the executable components further comprise a feedback component configured to provide, to the machine learning asset, the operational data.

4. The system of claim 1 , wherein the at least one machine learning model uses external data obtained via a network as input.

5. The system of claim 1 , wherein the graphical representation further includes an option to turn the machine learning asset off, wherein turning the machine learning asset off comprises disconnecting the machine learning asset from the industrial device.

6. The system of claim 1 , wherein the at least one machine learning model is trained on historical industrial data.

7. The system of claim 1 , wherein the process control component is further configured to control a second industrial process in the industrial automation environment based at least in part on the output from the at least one machine learning model.

8. A non-transitory computer-readable medium having stored thereon instructions that, in response to execution, cause a system comprising a processor to perform operations, the operations comprising:

displaying, on a graphical user interface in an industrial automation environment, a graphical representation of a machine learning asset comprising at least one machine learning model, wherein the graphical representation includes:

an asset visual element representing the machine learning asset,

an output visual indicator representing an output from the at least one machine learning model,

a status visual element depicting an operational status of the machine learning asset, and

one or more selectable elements for controlling a behavior of the machine learning asset;

adjusting the graphical representation based at least in part on the output from the at least one machine learning model; and

adjusting at least one parameter for controlling an industrial device in the industrial automation environment based at least in part on the output from the at least one machine learning model, wherein the industrial device is also visible to an operator viewing the graphical user interface from inside the industrial automation environment.

9. The non-transitory computer-readable medium of claim 8 , wherein the at least one machine learning model uses operational data from the industrial device as input.

10. The non-transitory computer-readable medium of claim 9 , the operations further comprising providing, to the machine learning asset, the operational data.

11. The non-transitory computer-readable medium of claim 8 , wherein the at least one machine learning model uses external data obtained via a network as input.

12. The non-transitory computer-readable medium of claim 8 , wherein the graphical representation further includes an option to turn the machine learning asset off, wherein turning the machine learning asset off comprises disconnecting the machine learning asset from the industrial device.

13. The non-transitory computer-readable medium of claim 8 , wherein the at least one machine learning model is trained on historical industrial data.

14. The non-transitory computer-readable medium of claim 8 , the operations further comprising controlling a second industrial process in the industrial automation environment based at least in part on the output from the at least one machine learning model.

15. A method of integrating machine learning in industrial automation environments, the method comprising:

displaying, by a system comprising a processor, a graphical representation of a machine learning asset comprising at least one machine learning model on a graphical user interface in an industrial automation environment, wherein the graphical representation includes:

an asset visual element representing the machine learning asset

an ouput visual indicator representing an output from the at least one machine learning model,

a status visual element depicting an operational status of the machine learning asset, and

one or more selectable elements for controlling a behavior of the machine learning asset;

adjusting, by the system, the graphical representation based at least in part on the output from the at least one machine learning model; and

adjusting, by the system, at least one parameter for controlling an industrial device in the industrial automation environment based at least in part on the output from the at least one machine learning model, wherein the industrial device is also visible to an operator viewing the graphical user interface from inside the industrial automation environment.

16. The method of claim 15 , wherein the at least one machine learning model uses operational data from the industrial device as input.

17. The method of claim 16 , further comprising providing, by the system, to the machine learning asset, the operational data.

18. The method of claim 15 , wherein the at least one machine learning model uses external data obtained via a network as input.

19. The method of claim 15 , wherein the graphical representation further includes an option to turn the machine learning asset off, wherein turning the machine learning asset off comprises disconnecting the machine learning asset from the industrial device.

20. The method of claim 15 , further comprising controlling, by the system, a second industrial process in the industrial automation environment based at least in part on the output from the at least one machine learning model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 12, 2021
From: REYNOLDS, JORDAN C.; HAGERBAUMER, JOHN J.; MAHR, TROY W.; JACOBSEN, THOMAS K.; SCATURCHIO, GIANCARLO
To: ROCKWELL AUTOMATION TECHNOLOGIES, INC.
Reel/Frame 057767/0639 →
Continuity (1)
Related Publication 20230102717A1 · Mar 30, 2023
References Cited (17)
US 20170032281A1 · Hsu · 2017 [cited by examiner]
US 20190018374A1 · Kanokogi et al. · 2019 [cited by applicant]
US 20200150599A1 · Tsuneki · 2020 [cited by examiner]
US 20200167202A1 · Huang et al. · 2020 [cited by applicant]
US 20200327029A1 · Prakash · 2020 [cited by examiner]
US 20210027105A1 · Cheng · 2021 [cited by examiner]
US 20210081848A1 · Polleri et al. · 2021 [cited by applicant]
US 20210103262A1 · Naidoo et al. · 2021 [cited by applicant]
US 20210166080A1 · Podder · 2021 [cited by examiner]
US 20210263493A1 · Claussen · 2021 [cited by applicant]
US 20220101139A1 · Schmitt et al. · 2022 [cited by applicant]
WO 2021050285A1 · 2021 [cited by applicant]
Extended European Search Report for EP App. No. 22196834.0, mailed Feb. 9, 2023, European Patent Office 80298 Munich Germany; 9 pages. [cited by applicant]
Extended European Search Report from EP application 22195342.5-1205 issued by the European Patent Office on Feb. 20, 2023, 10 pages. [cited by applicant]
Non-Final Office Action issued by the United States Patent and Trademark Office in U.S. Appl. No. 17/484,461 on Jan. 9, 2023, 8 pages. [cited by applicant]
Final Office Action issued by the United States Patent and Trademark Office in U.S. Appl. No. 17/484,461 on Jul. 5, 2023, 32 pages. [cited by applicant]
Non-Final Office Action issued by the United States Patent and Trademark Office in U.S. Appl. No. 17/484,461 on Nov. 8, 2023, 35 pages. [cited by applicant]