IP Library Granted Patent US 12,440,988
Granted Patent B2
US 12,440,988 · App. 17/581,095 · Granted Oct 14, 2025

Systems and methods for manipulating control panels using robotic arms based on control system data analytics

Inventors: Jose Meraz (Houston, TX); Andrew James Pratt (The Woodlands, TX)
Assignee: Aquila Engineering LLC
B25J9/1674B25J9/1664B25J9/1679B25J9/1697
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,440,988
App. No.
17/581,095
Granted
Oct 14, 2025
Kind
B2
Abstract

Systems and methods presented herein utilize one or more robotic arms and a data analytics server in conjunction with existing control systems. The data analytics server is configured to receive operational data relating to operation of industrial equipment being controlled by a control system. The data analytics server is also configured to perform data analytics on the operational data. The data analytics server is further configured to determine one or more control signals configured to cause the one or more robotic arms to automatically manipulate one or more control elements of a control panel of the control system. In addition, the data analytics server is configured to automatically transmit the one or more control signals to the one or more robotic arms to cause the one or more robotic arms to automatically manipulate the one or more control elements of the control panel of the control system.

Claims (35)

1. A system, comprising:

one or more robotic arms comprising one or more sensors configured to detect visual and audible indicators of a control panel of a control system controlling operation of drilling or well control equipment; and

a data analytics server configured to:

receive operational data relating to the operation of the drilling or well control equipment being controlled by the control system;

receive feedback data relating to the visual and audible indicators of the control panel of the control system controlling operation of the drilling or well control equipment;

perform data analytics on the operational data relating to the operation of the drilling or well control equipment being controlled by the control system and the feedback data relating to the visual and audible indicators of the control panel of the control system controlling operation of the drilling or well control equipment;

determine one or more control signals configured to cause the one or more robotic arms to automatically manipulate one or more control elements of a control panel of the control system in accordance with the data analytics; and

automatically transmit the one or more control signals to the one or more robotic arms to cause the one or more robotic arms to automatically manipulate the one or more control elements of the control panel of the control system.

2. The system of claim 1 , wherein the data analytics server is configured to perform the data analytics on the operational data in substantially real time during the operation of the drilling or well control industrial equipment.

3. The system of claim 1 , wherein the data analytics server is a data analytics kiosk located at a worksite that includes the drilling or well control equipment.

4. The system of claim 1 , wherein the data analytics server is located remotely from a worksite that includes the drilling or well control equipment.

5. The system of claim 1 , wherein the one or more robotic arms comprise one or more monitoring sensors configured to directly monitor functionality of the one or more robotic arms to enable real-time monitoring of performance of the one or more robotic arms.

6. The system of claim 1 , wherein the one or more control elements of the control panel of the control system comprises buttons, switches, knobs, levers, or some combination thereof.

7. A method, comprising:

detecting, via one or more sensors of one or more robotic arms, visual and audible indicators of a control panel of a control system controlling operation of drilling or well control equipment;

receiving, via a data analytics server, operational data relating to the operation of the drilling or well control equipment being controlled by the control system;

receiving, via the data analytics server, feedback data relating to the visual and audible indicators of the control panel of the control system controlling operation of the drilling or well control equipment;

performing, via the data analytics server, data analytics on the operational data relating to the operation of the drilling or well control equipment being controlled by the control system and the feedback data relating to the visual and audible indicators of the control panel of the control system controlling operation of the drilling or well control equipment;

determining, via the data analytics server, one or more control signals configured to cause one or more robotic arms to automatically manipulate one or more control elements of a control panel of the control system in accordance with the data analytics; and

automatically, via the data analytics server, transmitting the one or more control signals to the one or more robotic arms to cause the one or more robotic arms to automatically manipulate the one or more control elements of the control panel of the control system.

8. The method of claim 7 , comprising performing, via the data analytics server, the data analytics on the operational data in substantially real time during the operation of the drilling or well control equipment.

9. The method of claim 7 , wherein the data analytics server is a data analytics kiosk located at a worksite that includes the drilling or well control equipment.

10. The method of claim 7 , wherein the data analytics server is located remotely from a worksite that includes the drilling or well control equipment.

11. The method of claim 7 , comprising monitoring, via the data analytics server, performance of the one or more robotic arms using data detected by one or more monitoring sensors associated with the one or more robotic arms.

12. The method of claim 7 , wherein the one or more control elements of the control panel of the control system comprises buttons, switches, knobs, levers, or some combination thereof.

13. A data analytics server configured to:

receive operational data relating to operation of drilling or well control equipment being controlled by a control system;

receive, from one or more sensors of one or more robotic arms, feedback data relating to visual and audible indicators of a control panel of the control system controlling operation of the drilling or well control equipment;

perform data analytics on the operational data relating to the operation of the drilling or well control equipment being controlled by the control system and the feedback data relating to the visual and audible indicators of the control panel of the control system controlling operation of the drilling or well control equipment;

determine one or more control signals configured to cause one or more robotic arms to automatically manipulate one or more control elements of a control panel of the control system in accordance with the data analytics; and

automatically transmit the one or more control signals to the one or more robotic arms to cause the one or more robotic arms to automatically manipulate the one or more control elements of the control panel of the control system.

14. The data analytics server of claim 13 , wherein the data analytics server is configured to perform the data analytics on the operational data in substantially real time during the operation of the drilling or well control equipment.

15. The data analytics server of claim 13 , wherein the data analytics server is a data analytics kiosk located at a worksite that includes the drilling or well control equipment.

16. The data analytics server of claim 13 , wherein the data analytics server is located remotely from a worksite that includes the drilling or well control equipment.

17. The data analytics server of claim 13 , wherein the data analytics server is configured to monitor performance of the one or more robotic arms using data detected by one or more monitoring sensors associated with the one or more robotic arms.

Continuity (2)
Provisional Application 63140447 · Jan 22, 2021
Related Publication 20220234202A1 · Jul 28, 2022
References Cited (19)
US 11011077B2 · Kilroy et al. · 2021 [cited by applicant]
US 11637716B1 · Kerzner · 2023 [cited by examiner]
US 20150057961A1 · Montoya · 2015 [cited by examiner]
US 20160121479A1 · Lin · 2016 [cited by examiner]
US 20160282847A1 · Germann · 2016 [cited by examiner]
US 20170173795A1 · Tan · 2017 [cited by examiner]
US 20190167068A1 · Yoon · 2019 [cited by examiner]
US 20190287063A1 · Skaaksrud · 2019 [cited by examiner]
US 20210006425A1 · Hong · 2021 [cited by examiner]
US 20210046650A1 · Deyle · 2021 [cited by examiner]
US 20210086361A1 · Huang · 2021 [cited by examiner]
US 20210270858A1 · Imai · 2021 [cited by examiner]
US 20220057788A1 · Avireddi · 2022 [cited by examiner]
US 20220410391A1 · Aparicio · 2022 [cited by examiner]
CN 111531531A · 2020 [cited by examiner]
EP 3070548A2 · 2016 [cited by examiner]
F. Wang, G. Chen and K. Hauser, “Robot Button Pressing in Human Environments, ” 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia, 2018, pp. 7173-7180, doi: 10.1109/ICRA.2018… [cited by examiner]
V. Sukhoy and A. Stoytchev, “Learning to detect the functional components of doorbell buttons using active exploration and multimodal correlation,” 2010 10th IEEE-RAS International Conference on Humanoid Robots, Nashvil… [cited by examiner]
Translation of CN-111531531-A (Year: 2020). [cited by examiner]