IP Library Granted Patent US 11,660,756
Granted Patent B2
US 11,660,756 · App. 16/379,976 · Granted May 30, 2023

Control system with task manager

Inventors: Huan Tan (Niskayuna, NY); John Michael Lizzi (Wilton, NY); Charles Burton Theurer (Alplaus, NY); Balajee Kannan (Niskayuna, NY); Romano Patrick (Atlanta, GA)
Assignee: Transportation IP Holdings, LLC
B25J9/1682B25J9/16B25J9/1666B61G7/04B61J99/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,660,756
App. No.
16/379,976
Granted
May 30, 2023
Kind
B2
Abstract

A system includes a first robotic machine having a first set of capabilities for interacting with a target object on stationary equipment; a second robotic machine having a second set of capabilities for interacting with the target object; and a task manager that can determine capability requirements to perform a task on the target object. The task has an associated series of sub-tasks. The task manager can assign a first sequence of sub-tasks for performance by the first robotic machine based on the first set of capabilities and a second sequence of sub-tasks for performance by the second robotic machine based on the second set of capabilities. The first and second robotic machines can coordinate performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine to accomplish the task.

Claims (45)

1. A system, comprising:

a first robotic machine having a first set of capabilities for interacting with a target object on stationary equipment;

a second robotic machine having a second set of capabilities for interacting with the target object; and

a task manager having one or more processors and that is configured to determine capability requirements to perform a task on the target object, the task having an associated series of sub-tasks, with the sub-tasks having one or more capability requirements,

the task manager being configured to assign a first sequence of sub-tasks within the associated series of sub-tasks to the first robotic machine for performance by the first robotic machine based at least in part on the first set of capabilities, and to assign a second sequence of sub-tasks within the associated series of sub-tasks to the second robotic machine for performance by the second robotic machine based at least in part on the second set of capabilities,

at least three of the sub-tasks of the first sequence of sub-tasks assigned to the first robotic machine include the first robotic machine identifying the target object on the stationary equipment, generating a signal, for communication to the second robotic machine, that includes information about a location of the target object on the stationary equipment, and moving the second robotic machine from a first location to a second location such that the second robotic machine in the second location is positioned closer to the target object than in the first location, at least two of the sub-tasks of the second sequence of sub-tasks assigned to the second robotic machine include the second robotic machine moving to the target object based on the signal generated by the first robotic machine and manipulating the target object,

the first and second robotic machines being configured to coordinate performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine, and thereby to accomplish the task.

2. The system of claim 1 , wherein the stationary equipment is a railroad track, a road, a bridge, a building, a stack, or a stationary machine.

3. The system of claim 1 , wherein the first and second sets of capabilities of the first and second robotic machines each include at least one of flying, driving, diving, lifting, imaging, grasping, rotating, tilting, extending, retracting, pushing, and pulling.

4. The system of claim 1 , wherein the second set of capabilities of the second robotic machine includes at least one capability that differs from the first set of capabilities of the first robotic machine.

5. The system of claim 1 , wherein the first and second robotic machines coordinate performance of the first sequence of sub-tasks by the first robotic machine with the performance of the second sequence of sub-tasks by the second robotic machine by communicating directly with each other.

6. The system of claim 1 , wherein the first robotic machine notifies the second robotic machine, directly or indirectly, that one of the corresponding sub-tasks is complete, and the second robotic machine is configured to perform a corresponding sub-task in the second sequence responsive to being notified.

7. The system of claim 1 , wherein the task manager is configured to decide whether the second robotic machine proceeds with a sub-task of the second sequence based at least in part on the signal.

8. The system of claim 1 , wherein at least some of the sub-tasks are sequential such that the second robotic machine begins performance of a dependent sub-task in the second sequence responsive to receiving a notification from the first robotic machine that the first robotic machine has completed a specific sub-task in the first sequence.

9. The system of claim 1 , wherein the first robotic machine concurrently performs at least one of the sub-tasks in the first sequence with performance of at least one of the sub-tasks in the second sequence by the second robotic machine.

10. The system of claim 1 , wherein the task manager is configured to access a database that stores capability descriptions corresponding to each robotic machine in a group of robotic machines, and the task manager is further configured to select the first and second robotic machines to perform the task instead of other robotic machines in the group based on a suitability of the capability descriptions of the first and second robotic machines to capability needs for the task.

11. The system of claim 1 , wherein the first sequence of sub-tasks assign the first robotic machine to determine at least two of: a position of the target object, a position of the first robotic machine, and a position of the second robotic machine.

12. The system of claim 1 , wherein the first robotic machine, having been assigned the first sequence of sub-tasks by the task manager is configured to:

determine to travel a determined path from a first location to a second location, determine to act using a capability of the first set of capabilities, or both determine to travel the determined path and act using the capability, and

signal to the second robotic machine, to the task manager, or both to the second robotic machine and the task manager information including at least one of the determined path, the act using the capability, or both the determined path and the act using the capability.

13. The system of claim 1 , wherein the first robotic machine and the second robotic machine each are configured to generate one or more of:

time indexing signals associated one or both of the first sequence of sub-tasks or the second sequence of sub-tasks,

position indexing signals for locations of one or both of the first robotic machine or the second robotic machine, and

orientation indexing signals for one or more tools configured to implement one or both of the first set of capabilities of the first robotic machine or the second set of capabilities of the second robotic machine.

14. The system of claim 1 , wherein at least one of the first robotic machine or the second robotic machine has a first mode of operation that is a fast, gross movement mode and a second mode of operation that is a slow, fine movement mode.

15. The system of claim 14 , further comprising one or more of a stabilizer, an outrigger, or a clamp, and wherein a transition in operation from the first mode to the second mode comprises deploying and setting said one or more of the stabilizer, the outrigger, or the clamp.

16. The system of claim 14 , wherein the first mode of operation comprises moving at least one of the first robotic machine or the second robotic machine to a determined location relative to the target object; and

the second mode of operation comprises actuating one or more tools of at least one of the first robotic machine or the second robotic machine to accomplish the task or a sub-task.

17. A system, comprising:

a first robotic machine having a first set of capabilities for interacting with stationary equipment, the first robotic machine being configured to receive a first sequence of sub-tasks related to the first set of capabilities of the first robotic machine; and

a second robotic machine having a second set of capabilities for interacting with the stationary equipment, the second robotic machine being configured to receive a second sequence of sub-tasks related to the second set of capabilities of the second robotic machine, and

the first and second robotic machines are configured to coordinate performance of the first and second sequences of sub-tasks, respectively, to accomplish a task that involves manipulating a target object that is distinct from the first and second robotic machines, the target object being on the stationary equipment, and

the first robotic machine is configured to provide to the second robotic machine, directly or indirectly, a sensor signal having information about the target object, and

the first robotic machine is configured to perform the first sequence of sub-tasks by identifying the target object and moving the second robotic machine from a first location to a second location such that the second robotic machine at the second location is positioned relative to the target object to complete the second sequence of sub-tasks, the second robotic machine being closer to the target object at the second location than at the first location, and

the second robotic machine is configured to perform one or more sub-tasks of the second sequence of sub-tasks at the second location by manipulating the target object based at least in part on the sensor signal.

18. The system of claim 17 , wherein at least some of the sub-tasks are sequential such that the second robotic machine begins performance of a dependent sub-task in the second sequence responsive to receiving a notification from the first robotic machine that the first robotic machine has completed a specific sub-task in the first sequence.

19. A method for a first robotic machine having a first set of capabilities for interacting with stationary equipment and a second robotic machine having a second set of capabilities for interacting with the stationary equipment, the first robotic machine being configured to receive a first sequence of sub-tasks related to the first set of capabilities of the first robotic machine, the second robotic machine being configured to receive a second sequence of sub-tasks related to the second set of capabilities of the second robotic machine, the method comprising:

coordinating performance of the first sequence of sub-tasks by the first robotic machine with performance of the second sequence of sub-tasks by the second robotic machine; and

performing the first and second sequences of sub-tasks to accomplish a task comprising manipulating a target object on the stationary equipment;

wherein the first robotic machine performs the first sequence of sub-tasks by:

identifying the target object on the stationary equipment;

determining at least two of: a position of the target object, a position of the first robotic machine, and a position of the second robotic machine;

moving the second robotic machine from a first location to a second location such that the second robotic machine in the second location is positioned closer to the target object than in the first location; and

providing to the second robotic machine, directly or indirectly, a sensor signal having information about the target object, and

the second robotic machine performs one or more sub-tasks of the second sequence of sub-tasks by manipulating the target object based on the sensor signal.

Assignments (3)
CHANGE OF NAME Recorded Oct 31, 2022
From: GE GLOBAL SOURCING LLC
To: TRANSPORTATION IP HOLDINGS, LLC
Reel/Frame 062257/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2022
From: TAN, HUAN; LIZZI, JOHN MICHAEL; THEURER, CHARLES BURTON; PATRICK, ROMANO
To: GENERAL ELECTRIC COMPANY
Reel/Frame 059880/0186 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2022
From: GENERAL ELECTRIC COMPANY
To: GE GLOBAL SOURCING LLC
Reel/Frame 059880/0229 →
Continuity (21)
Continuation 16114318 · Aug 28, 2018
Continuation In Part 15872582 · Jan 16, 2018
Continuation In Part 15809515 · Nov 10, 2017
Continuation In Part 15804767 · Nov 6, 2017
Continuation In Part 15587950 · May 5, 2017
Continuation In Part 15585502 · May 3, 2017
Continuation In Part 15584995 · May 2, 2017
Continuation In Part 15473384 · Mar 29, 2017
Continuation In Part 15473345 · Mar 29, 2017
Continuation In Part 15399313 · Jan 5, 2017
Continuation In Part 15198673 · Jun 30, 2016
Continuation In Part 15183850 · Jun 16, 2016
Continuation In Part 15058494 · Mar 2, 2016
Continuation In Part 14541370 · Nov 14, 2014
Provisional Application 62343615 · May 31, 2016
Provisional Application 62336332 · May 13, 2016
Provisional Application 62269377 · Dec 18, 2015
Provisional Application 62269425 · Dec 18, 2015
Provisional Application 62269523 · Dec 18, 2015
Provisional Application 62269481 · Dec 18, 2015
Related Publication 20190232498A1 · Aug 1, 2019