IP Library Granted Patent US 11,353,865
Granted Patent B2
US 11,353,865 · App. 16/679,512 · Granted Jun 7, 2022

Coordination of mining and construction vehicles via scripting control

Inventors: Alberto Daniel Lacaze (Potomac, MD); Karl Nicholas Murphy (Cocoa Beach, FL)
Assignee: ROBOTIC RESEARCH OPCO, LLC
G05D1/0027G05D1/0033G06F8/40G06F8/61G06F11/3628G06F16/1734G05D2201/021G05D2201/0202
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,353,865
App. No.
16/679,512
Granted
Jun 7, 2022
Kind
B2
Abstract

Mines and construction sites are pnme applications for automation. The invention is composed of a protocol that allows multiple machines to be coordinated from a single application. The invention provides what in classical control is called a coordination layer between the machines (4D-RCS). This coordination layer is currently provided by humans as machines only interact with each other in the physical world, but there is no infrastructure to have them coordinated from an autonomous control standpoint. The system described in the present invention is a coordinating mining or construction machinery that is comprised of two or more mining (or construction) equipment with sensors and actuators, a database of stored behavior and sensing capabilities for each machine, a scripting editor that can concatenate sensing and behavior blocks, a controller (centralized or at each machine) that can interpret the scripts and command the machines according to the script, and a communication infrastructure that allows the machines to communicate.

Claims (54)

1. A system with coordination between different mining or construction machinery, the system comprising:

two or more autonomous mining or construction (M/C) machines, each M/C machine comprising:

a plurality of actuators;

a drive-by-wire kit operatively coupled to the plurality of actuators and configured to control one or more the actuators in performing an M/C function;

a plurality of sensors mounted on the M/C machine and configured to detect features in an environment surrounding the M/C machine, operation or movement of the M/C machine, or any combination of the foregoing; and

a first communication device;

a database storing a plurality of blocks for each M/C machine, the stored blocks comprising sensing blocks and behavior blocks, each behavior block corresponding to operation of one or more actuators in a respective one of the M/C machines, each sensing block corresponding to detection performed by one or more sensors in a respective one of the M/C machines;

a second communication device; and

a controller operatively coupled to the database and the second communication device,

wherein the controller is operable to execute stored instructions to:

(i) receive, via a user interface, a selection by an operator of first and second stored blocks defining performance of a first M/C function and/or sensing by a first of the M/C machines;

(ii) receive, via the user interface, a selection by the operator of third and fourth stored blocks defining performance of a second M/C function and/or sensing by a second of the M/C machines;

(iii) assemble the first and second stored blocks to form a first operation script for the first of the M/C machines;

(iv) assemble the third and fourth stored blocks to form a second operation script for the second of the M/C machines;

(v) send, via the second communication device to the respective first communication device, the first and the second operation scripts to the first and second of the M/C machines, respectively; and

(vi) control, via the respective drive-by-wire kit, the first and second of the M/C machines to perform the first and second operation scripts, respectively.

2. The system of claim 1 , wherein the controller is further operable to execute stored instructions to, prior to (v):

simulate operations of the first and second of the M/C machines in performing the first and second operation scripts; and

display, via the user interface, the simulated operations.

3. The system of claim 2 , wherein, in simulating the operations, the controller is operable to predict a timing of operations of the first and second of the M/C machines in performing the first and second operation scripts.

4. The system of claim 1 , wherein one or more of the behavior blocks comprises a range of values for operation of the corresponding one or more actuators.

5. The system of claim 1 , wherein the controller is further operable to execute stored instruction to, prior to (v):

(vi) simulate operations of the first and second of M/C machines in performing the first and second operation scripts;

(vii) adjust, in a behavior block of a least one of the first and second operation scripts, at least one M/C machine parameter; and

(viii) optimize for time, throughput, overall cost, fuel, wear, safety, or any combination of the foregoing by repeating (vi) and (vii).

6. The system of claim 5 , wherein the controller is further operable to employ measurements from prior execution of the first and second operation scripts in (vi).

7. The system of claim 1 , further comprising:

an operator control unit (OCU) constructed to be carried by a human, the OCU comprising one or more sensors and a third communication device,

wherein the database further stores behavior and sensing blocks for the OCU, each behavior block corresponding to an operation to be performed by the human, each sensing block corresponding to detection performed by one or more sensors of the OCU.

8. The system of claim 3 , wherein the simulator used controller is further operable to employ finite element analysis (FEA) to predict compute the timing.

9. The system of claim 1 , wherein the database stores at least one predetermined operation script for performing of an M/C function, the predetermined operation script comprising at least two behavior blocks.

10. The system of claim 1 , wherein:

the first of the M/C machines further comprises a local control module operatively coupled to plurality of actuators and the plurality of sensors, the local control module being configured to:

monitor the actuators and/or sensors as the first of the M/C machines is operated by a human; and

determine, based on the monitoring, a learned behavior block, a learned sensor block, or both, and

the plurality of blocks stored by the database comprises the learned behavior block, the learned sensor block, or both.

11. The system of claim 1 , wherein the controller is further operable to execute stored instructions to display, to the operator via the user interface, an indication of a block of the first or second operation script being executed by the respective M/C machine.

12. The system of claim 1 , wherein performance of at least one of the first and second operation scripts is multitask, or blocks in at least one of the first and second operation scripts are organized hierarchically.

13. The system of claim 1 , wherein the controller is further operable to execute stored instructions to log all information sent to the M/C machines.

14. The system of claim 1 , wherein the controller is further operable to execute stored instructions to, prior to (v):

receive an operation script from a different installation; and

merge the operation script from the different installation with at least one of the first and second operation scripts.

15. The system of claim 1 , wherein the controller is further operable to employ encryption and authentication in the sending of (v).

16. The system of claim 1 , further comprising:

a human-operated M/C machine comprising a plurality of sensors and a third communication device configured to communicate with the first communication devices of the two or more M/C machines, with the second communication device of the controller, or both,

wherein the database further stores one or more sensor blocks corresponding to detection performed by one or more sensors of the human-operated M/C machine.

17. The system of claim 6 , wherein the controller is further operable to execute stored instructions to perform multiple cycles of optimization and real time data logging.

18. The system of claim 5 , wherein the optimization of (viii) employs a genetic algorithm or a simplex optimization technique.

19. The system of claim 1 , wherein:

the two or more autonomous M/C machines comprise an excavator, a dump truck, or a loader; and

in performing the first and second operation scripts, the first and second of the M/C machines interact with each other.

20. The system of claim 1 , wherein:

the second operation script comprises a first sensing block for the second of the M/C machines; and

the first operation script comprises a logic block that delays performance of at least a portion of the first operation script by the first of the M/C machines until receipt of a signal corresponding to the first sensing block from the second of the M/C machines.

Assignments (5)
SECURITY INTEREST Recorded Jul 14, 2025
From: ROBOTIC RESEARCH OPCO, LLC
To: CRESCENT COVE OPPORTUNITY LENDING, LLC
Reel/Frame 071945/0001 →
TERMINATION AND RELEASE OF PATENT SECURITY INTEREST RECORDED AT REEL 066382, FRAME 0141 Recorded Jul 16, 2024
From: CRESCENT COVE OPPORTUNITY LENDING, LLC, AS ADMINISTRATIVE AGENT
To: ROBOTIC RESEARCH OPCO, LLC
Reel/Frame 068389/0707 →
SECURITY INTEREST Recorded Jan 30, 2024
From: ROBOTIC RESEARCH OPCO, LLC
To: CRESCENT COVE OPPORTUNITY LENDING, LLC
Reel/Frame 066382/0141 →
MERGER Recorded Jan 18, 2022
From: ROBOTIC RESEARCH, LLC
To: ROBOTIC RESEARCH OPCO, LLC
Reel/Frame 058767/0502 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2021
From: LACAZE, ALBERTO DANIEL; MURPHY, KARL NICHOLAS
To: ROBOTIC RESEARCH, LLC
Reel/Frame 057405/0157 →
Continuity (2)
Provisional Application 62760283 · Nov 13, 2018
Related Publication 20210141372A1 · May 13, 2021