Autonomous truck loading for mining and construction applications

1. A system comprising:

an autonomous truck with a drive-by-wire kit;

one or more sensors configured to detect features in an environment surrounding the autonomous truck and/or one or more loaders;

a database storing a plurality of elementary behaviors for various phases of a process of loading the autonomous truck by the one or more loaders, the stored elementary behaviors comprising (i) a plurality of predetermined maneuvers for the autonomous truck, (ii) a plurality of sensing behaviors, and (iii) a plurality of logic behaviors; and

a controller operatively coupled to the drive-by-wire kit, the database, and the one or more sensors,

wherein the controller is operable to execute stored instructions to:

receive, via a user interface, a selection by an operator of a first one of the stored elementary behaviors from the database, the first selected elementary behavior comprising a sensing behavior that causes the controller to determine a status of loading of the autonomous truck based on signals from the one or more sensors;

receive, via the user interface, a selection by the operator of a second one of the stored elementary behaviors from the database, the second selected elementary behavior comprising a logic behavior that causes the controller to maintain a state of the autonomous truck until the controller determines that loading of the autonomous truck is complete;

receive, via the user interface, a selection by the operator of a third one of the stored elementary behaviors from the database;

receive, via the user interface, a selection by the operator of a fourth one of the stored elementary behaviors from the database;

assemble together the first, second, third, and fourth selected elementary behaviors to form an operation script for loading of the autonomous truck by the one or more loaders; and

control, via the drive-by-wire kit, the autonomous truck to perform the operation script for loading.

2. The system of claim 1 , wherein:

the third selected elementary behavior comprises a predetermined maneuver that defines a trajectory for the autonomous truck to follow to a loading location of the one or more loaders; and

the fourth selected elementary behavior comprises another predetermined maneuver that defines another trajectory for the autonomous truck to follow away from the loading location.

3. The system of claim 2 , wherein at least one of the predetermined maneuvers comprises a trajectory recorded during previous manual operation of the autonomous truck.

4. The system of claim 1 , wherein:

the autonomous truck comprises one or more weight measuring sensors; and

the controller is further operable to execute stored instructions to:

determine a weight loaded onto the autonomous truck by the one or more loaders based on signals from the one or more weight measuring sensors;

compare the determined weight to a maximum load capacity of the autonomous truck; and

send, in response to the comparison indicating that the maximum load capacity has been reached, a signal to the one or more loaders to stop loading of the autonomous truck.

5. The system of claim 1 , wherein the stored elementary behaviors are classified in the database based on type of load or wetness of the load.

6. The system of claim 1 , wherein at least one of the one or more sensors is mounted on the autonomous truck.

7. The system of claim 1 , wherein the one or more sensors comprises a laser detection and ranging (LADAR) system, stereo pair, cameras, radio frequency (RF) beacons, a differential global positioning system (DGPS), acoustic sensor, radio detection and ranging (RADAR), or any combination of the foregoing.

8. The system of claim 1 , wherein the controller is further operable to execute stored instructions to, during the control of the autonomous truck to perform the operation script:

receive, from the one or more sensors, a signal indicating detection of an obstacle;

determine, in response to the received signal, one or more variations to the operation script that avoids a collision with the detected obstacle, the one or more variations comprising a trajectory deviation, a velocity change, or a stoppage of the autonomous truck; and

control, via the drive-by-wire kit, the autonomous truck to perform the operation script with the one or more variations.

9. The system of claim 1 , wherein:

the autonomous truck comprises one or more weight measuring sensors; and

the controller is further operable to execute stored instructions to:

determine, based on signals from the one or more weight measuring sensors, a current weight loaded onto the autonomous truck by the one or more loaders; and

send a signal to the one or more loaders indicating the current weight loaded onto the autonomous truck.

10. The system of claim 1 , wherein:

the autonomous truck comprises a weight measuring sensor for each wheel; and

the controller is further operable to execute stored instructions to:

determine, based on one or more signals from each weight measuring sensor, a current distribution of weight loaded onto the autonomous truck by the one or more loaders; and

send a signal to the one or more loaders indicating the current distribution of weight loaded onto the autonomous truck.

11. The system of claim 1 , wherein at least one of the one or more sensors is mounted on the one or more loaders or disposed in the environment surrounding the autonomous truck and/or the one or more loaders.

12. The system of claim 1 , wherein:

the third selected elementary behavior comprises a sensing behavior that causes the controller to determine a status of a loading area based on signals from the one or more sensors; and

the fourth selected elementary behavior comprises a logic behavior that causes the controller to maintain a location of the autonomous truck outside of the loading area until the loading area is clear.

13. The system of claim 1 , wherein:

the third selected elementary behavior comprises a sensing behavior that causes the controller to detect movement of a loading mechanism of one of the one or more loaders based on signals from the one or more sensors; and

the fourth selected elementary behavior comprises a maneuver that causes the controller to coordinate movement of the autonomous truck with the detected movement of the loading mechanism.

14. A method comprising:

receiving, via a user interface, a selection by an operator of a first one of a plurality of elementary behaviors for various phases of a process of loading of an autonomous truck by one or more loaders, the plurality of elementary behaviors comprising (i) a plurality of predetermined maneuvers for the autonomous truck, (ii) a plurality of sensing behaviors, and (iii) a plurality of logic behaviors;

receiving, via the user interface, a selection by the operator of a second one of the elementary behaviors;

forming, via a controller, an operation script for loading of the autonomous truck by the one or more loaders, the forming comprising assembling together at least the first selected elementary behavior and the second selected elementary behavior; and

controlling, via the controller, a drive-by-wire kit of the autonomous truck to perform the operation script for loading,

wherein the first selected elementary behavior comprises a sensing behavior that causes determination of a status or detection of movement based on signals from one or more sensors configured to detect features in an environment surrounding the autonomous truck and/or one or more loaders.

15. The method of claim 14 , wherein:

the sensing behavior of the first selected elementary behavior causes determination of the status of loading of the autonomous truck based on signals from the one or more sensors; and

the second selected elementary behavior comprises a logic behavior that causes maintenance of a state of the autonomous truck until the controller determines that loading of the autonomous truck is complete.

16. The method of claim 15 , further comprising:

receiving, via the user interface, a selection by the operator of a third one of the elementary behaviors; and

receiving, via the user interface, a selection by the operator of a fourth one of the elementary behaviors,

wherein the forming the operation script comprises assembling together the first, second, third, and fourth selected elementary behaviors.

17. The method of claim 16 , wherein:

(a) the third selected elementary behavior comprises a sensing behavior that causes the controller to determine a status of a loading area based on signals from the one or more sensors, and the fourth selected elementary behavior comprises a logic behavior that causes the controller to maintain a location of the autonomous truck outside of the loading area until the loading area is clear; or

(b) the third selected elementary behavior comprises a sensing behavior that causes the controller to detect movement of a loading mechanism of a one of the one or more loaders based on signals from the one or more sensors, and the fourth selected elementary behavior comprises a maneuver that causes the controller to coordinate movement of the autonomous truck with the detected movement of the loading mechanism.

18. Non-transitory computer-readable media storing computer-readable instructions that, when executed by one or more processors, cause:

receiving a selection by an operator of a first one of a plurality of elementary behaviors for various phases of a process of loading of an autonomous truck by one or more loaders, the plurality of elementary behaviors comprising (i) a plurality of predetermined maneuvers for the autonomous truck, (ii) a plurality of sensing behaviors, and (iii) a plurality of logic behaviors;

receiving a selection by the operator of a second one of the elementary behaviors;

assembling together at least the first selected elementary behavior and the second selected elementary behavior to form an operation script for loading of the autonomous truck by the one or more loaders; and

controlling a drive-by-wire kit of the autonomous truck to perform the operation script for loading,

wherein the first selected elementary behavior comprises a sensing behavior that causes determination of a status or detection of movement based on signals from one or more sensors configured to detect features in an environment surrounding the autonomous truck and/or one or more loaders.

19. The non-transitory computer-readable media of claim 18 , wherein:

the sensing behavior of the first selected elementary behavior causes determination of the status of loading of the autonomous truck based on signals from the one or more sensors; and

the second selected elementary behavior comprises a logic behavior that causes maintenance of a state of the autonomous truck until loading of the autonomous truck is complete.

20. The non-transitory computer-readable media of claim 19 , storing further instructions that, when executed by the one or more processors, further cause:

receiving a selection by the operator of a third one of the elementary behaviors; and

receiving a selection by the operator of a fourth one of the elementary behaviors,

wherein the assembling includes assembling together the first, second, third, and fourth selected elementary behaviors to form the operation script.