Granted Patent B2

US 12,372,944 · App. 17/148,093 · Granted Jul 29, 2025

Inventors: Jeffery Saunders (Quincy, MA); Benjamin C. Stringer (Boston, MA)

Assignee: Aurora Flight Sciences Corporation, a subsidiary of The Boeing Company

G05B19/4155G05D1/0088G05D1/0291G05D1/60G06N5/01G05B2219/33051G05B2219/50391G05D2101/10G05D2109/20

Abstract

Claims (109)

1. An apparatus for causing one or more aerial robots to execute a mission, the apparatus comprising:

a memory having computer-readable program code stored therein; and

processing circuitry configured to access the memory, and execute the computer-readable program code to cause the apparatus to at least:

identify the mission including tasks that are executable to cause the one or more aerial robots to execute respective maneuvers;

determine a behavior tree in which the mission is modeled, the behavior tree including a switch node, a trigger node representing a selected task, and action nodes representing others of the tasks,

the switch node connected to the trigger node and the action nodes in a parent-child relationship in which the trigger node and the action nodes are children of the switch node,

the trigger node being a first of the children that, when ticked by the switch node, returns an identifier of one of the action nodes to trigger the switch node to next tick the one of the action nodes, and

the action nodes include one or more of:

launch to hover,

transition up,

fly-to,

approach, or

vertical landing;

cause the one or more aerial robots to execute the mission using the behavior tree and a leaf node library including the tasks executable to cause the one or more aerial robots to execute the respective maneuvers;

detect occurrence of a contingency event during execution of the selected task,

the contingency event to provide an alternative task to the selected task; and

cause the one or more aerial robots to execute other respective maneuvers based on the alterative task causing the one or more aerial robots to execute maneuver commands using maneuver controls of the one or more aerial robots.

2. The apparatus of claim 1 , wherein the apparatus, on behalf of an aerial robot of the one or more aerial robots, is caused to at least:

access mission data including the behavior tree;

traverse the behavior tree; and

tick, based on the switch node being ticked, the trigger node to cause the trigger node representing the selected task to call on the leaf node library to execute the selected task and thereby cause the aerial robot to execute a respective maneuver, the trigger node returning the identifier.

3. The apparatus of claim 2 , wherein the apparatus, on behalf of an aerial robot of the one or more aerial robots, is caused to:

tick the one of the action nodes by the switch node according to the identifier, the ticking of the one of the action nodes causing the one of the action nodes representing one of the others of the tasks to call on the leaf node library to execute the one of the others of the tasks and thereby cause the aerial robot to execute another of the respective maneuvers.

4. The apparatus of claim 1 , wherein the tasks include a nominal sequence of selected tasks including the selected task and a next selected task, and an alternate task to be executed in place of the next selected task when a contingency event occurs during execution of the selected task, and

wherein the apparatus is caused to determine the behavior tree in which the others of the tasks represented by the action nodes include the next selected task and the alternate task.

5. The apparatus of claim 4 , wherein the apparatus, on behalf of an aerial robot of the one or more aerial robots, is caused to at least:

access mission data including the behavior tree in which the mission is modeled;

traverse the behavior tree; and

tick, based on the switch node being ticked, the trigger node to cause the trigger to call on the leaf node library to execute the selected task and thereby cause the aerial robot to execute a respective maneuver, the trigger node returning the identifier of the next selected task to the switch node absent occurrence of the contingency event.

6. The apparatus of claim 5 , wherein the apparatus, on behalf of an aerial robot of the one or more aerial robots, is caused to:

tick the one of the action nodes by the switch node according to the identifier, the ticking of the one of the action nodes causing the one of the action nodes representing the next selected task to call on the leaf node library to execute the next selected task and thereby cause the aerial robot to execute a third respective maneuver.

7. The apparatus of claim 4 , wherein the apparatus, on behalf of an aerial robot of the one or more aerial robots, is caused to at least:

access mission data including the behavior tree;

traverse the behavior tree; and

when the switch node is ticked,

tick the trigger node to cause the trigger node to call on the leaf node library to execute the selected task and thereby cause the aerial robot to execute a respective maneuver, and

detect occurrence of the contingency event during execution of the selected task, the trigger node returning the identifier of the alternate task to the switch node in response to the occurrence of the contingency event.

8. The apparatus of claim 1 , wherein the apparatus, on behalf of an aerial robot of the one or more aerial robots, is caused to at least:

dynamically replan the mission based on changes to the mission being made in real-time or near real-time as the mission is executed by the one or more aerial robots.

9. A method of causing one or more aerial robots to execute a mission, the method comprising:

identifying the mission including tasks that are executable to cause the one or more aerial robots to execute respective maneuvers;

determining a behavior tree in which the mission is modeled, the behavior tree including a switch node, a trigger node representing a selected task, and action nodes representing others of the tasks, the switch node connected to the trigger node and the action nodes in a parent-child relationship in which the trigger node and the action nodes are children of the switch node, the trigger node being a first of the children that, when ticked by the switch node, returns an identifier of one of the action nodes to trigger the switch node to next tick the one of the action nodes,

wherein the action nodes include one or more of:

launch to hover,

transition up,

fly-to,

approach, or

vertical landing;

causing the one or more aerial robots to execute the mission using the behavior tree and a leaf node library including the tasks executable to cause the one or more aerial robots to execute the respective maneuvers;

detecting occurrence of a contingency event during execution of the selected task, the contingency event to provide an alternative task to the selected task; and

causing the one or more aerial robots to execute other respective maneuvers based on the alterative task causing the one or more aerial robots to execute maneuver commands using maneuver controls of the one or more aerial robots.

10. The method of claim 9 , wherein causing the one or more aerial robots to execute the mission further includes for an aerial robot of the one or more aerial robots:

accessing mission data including the behavior tree;

traversing the behavior tree; and

ticking, based on the switch node being ticked, the trigger node to cause the trigger node representing the selected task to call on the leaf node library to execute the selected task and thereby cause the aerial robot to execute a respective maneuver, the trigger node returning the identifier.

11. The method of claim 10 , wherein causing the one or more aerial robots to execute the mission further includes for the aerial robot of the one or more aerial robots:

ticking the one of the action nodes by the switch node according to the identifier, the ticking of the one of the action nodes causing the one of the action nodes representing one of the others of the tasks to call on the leaf node library to execute the one of the others of the tasks and thereby cause the aerial robot to execute another of the respective maneuvers.

12. The method of claim 9 , wherein the tasks include a nominal sequence of selected tasks including the selected task and a next selected task, and an alternate task to be executed in place of the next selected task when a contingency event occurs during execution of the selected task, and

wherein determining the behavior tree includes determining the behavior tree in which the others of the tasks represented by the action nodes include the next selected task and the alternate task.

13. The method of claim 12 , wherein causing the one or more aerial robots to execute the mission includes for an aerial robot of the one or more aerial robots:

accessing mission data including the behavior tree;

traversing the behavior tree; and

ticking, based on the switch node being ticked, the trigger node to cause the trigger node to call on the leaf node library to execute the selected task and thereby cause the aerial robot to execute a respective maneuver, the trigger node returning the identifier of the next selected task to the switch node absent occurrence of the contingency event.

14. The method of claim 13 , wherein causing the one or more aerial robots to execute the mission further includes for the aerial robot of the one or more aerial robots:

ticking the one of the action nodes by the switch node according to the identifier, the ticking of the one of the action nodes causing the one of the action nodes representing the next selected task to call on the leaf node library to execute the next selected task and thereby cause the aerial robot to execute a third respective maneuver.

15. The method of claim 12 , wherein causing the one or more aerial robots to execute the mission includes for an aerial robot of the one or more aerial robots:

accessing mission data including the behavior tree;

traversing the behavior tree; and

ticking, based on the switch node being ticked, the trigger node to cause the trigger node to call on the leaf node library to execute the selected task and thereby cause the aerial robot to execute a respective maneuver; and

detecting occurrence of the contingency event during execution of the selected task, the trigger node returning the identifier of the alternate task to the switch node in response to the occurrence of the contingency event.

16. The method of claim 9 , further comprising:

dynamically replanning the mission based on changes to the mission being made in real-time or near real-time as the mission is executed by the one or more aerial robots.

17. A computer-readable storage medium for causing one or more aerial robots to execute a mission, the computer-readable storage medium being non-transitory and having computer-readable program code stored therein that, in response to execution by processing circuitry, causes an apparatus to at least:

identify the mission, the mission including tasks that are executable to cause the one or more aerial robots to execute respective maneuvers;

determine a behavior tree in which the mission is modeled, the behavior tree including a switch node, a trigger node representing a selected task, and action nodes representing others of the tasks, the switch node connected to the trigger node and the action nodes in a parent-child relationship in which the trigger node and the action nodes are children of the switch node, the trigger node being a first of the children that, when ticked by the switch node, returns an identifier of one of the action nodes to trigger the switch node to next tick the one of the action nodes,

wherein the action nodes include one or more of:

launch to hover,

transition up,

fly-to,

approach, or

vertical landing;

cause the one or more aerial robots to execute the mission using the behavior tree and a leaf node library including the tasks executable to cause the one or more aerial robots to execute the respective maneuvers;

detect occurrence of a contingency event during execution of the selected task,

the contingency event to provide an alternative task to the selected task; and

cause the one or more aerial robots to execute other respective maneuvers based on the alterative task causing the one or more aerial robots to execute maneuver commands using maneuver controls of the one or more aerial robots.

18. The computer-readable storage medium of claim 17 , wherein for an aerial robot of the one or more aerial robots, the apparatus is caused to at least:

access mission data including the behavior tree;

traverse the behavior tree; and

tick, based on the switch node being ticked, the trigger node to cause the trigger node to call on the leaf node library to execute the selected task and thereby cause the aerial robot to execute a respective maneuver, the trigger node returning the identifier.

19. The computer-readable storage medium of claim 18 , wherein, for the aerial robot of the one or more aerial robots, the apparatus is caused to:

tick the one of the action nodes by the switch node according to the identifier, the ticking of the one of the action nodes causing the one of the action nodes representing one of the others of the tasks to call on the leaf node library to execute the one of the others of the tasks and thereby cause the aerial robot to execute another of the respective maneuvers.

20. The computer-readable storage medium of claim 17 , wherein the tasks include a nominal sequence of selected tasks including the selected task and a next selected task, and an alternate task to be executed in place of the next selected task when a contingency event occurs during execution of the selected task, and

wherein the apparatus is caused to determine the behavior tree in which the others of the tasks represented by the action nodes include the next selected task and the alternate task.

21. The computer-readable storage medium of claim 20 , wherein for an aerial robot of the one or more aerial robots, the apparatus is caused to at least:

access mission data including the behavior tree;

traverse the behavior tree; and

tick, based on the switch node being ticked, the trigger node to cause the trigger node to call on the leaf node library to execute the selected task and thereby cause the aerial robot to execute a respective maneuver, the trigger node returning the identifier of the next selected task to the switch node absent occurrence of the contingency event.

22. The computer-readable storage medium of claim 21 , wherein for the aerial robot of the one or more aerial robots, the apparatus is caused to:

tick the one of the action nodes by the switch node according to the identifier, the ticking of the one of the action nodes causing the one of the action nodes representing the next selected task to call on the leaf node library to execute the next selected task and thereby cause the aerial robot to execute a third respective maneuver.

23. The computer-readable storage medium of claim 20 , wherein for an aerial robot of the one or more aerial robots, the apparatus is caused to at least:

access mission data including the behavior tree;

traverse the behavior tree;

when the switch node is ticked, tick the trigger node to cause the trigger node to call on the leaf node library to execute the selected task and thereby cause the aerial robot to execute a respective maneuver;

access mission data including the behavior tree in which the mission is modeled;

traverse the behavior tree;

tick, based on the switch node being ticked, the trigger node to cause the trigger node to call on the leaf node library to execute the selected task and thereby cause the aerial robot to execute a respective maneuver; and

detect occurrence of the contingency event during execution of the selected task, the trigger node returning the identifier of the alternate task to the switch node in response to the occurrence of the contingency event.

24. The computer-readable storage medium of claim 17 , wherein aerial robot of the one or more aerial robots, the apparatus is caused to:

dynamically replan the mission based on changes to the mission being made in real-time or near real-time as the mission is executed by the one or more aerial robots.

Assignments (2)

Continuity (2)

References Cited (27)