Multi-purpose robots and computer program products, and methods for operating the same
Robots, systems, methods, and computer program products for training and operating (semi-)autonomous robots to complete work objectives are described. A robot accesses a library of reusable work primitives from a catalog of libraries of reusable work primitives, each reusable work primitive corresponding to a respective basic sub-action that the robot is trained to autonomously perform. A work objective is analyzed to determine a sequence of reusable work primitives that complete the work objective, and the robot executes the sequence to complete the work objective. A robot can be deployed with access to an appropriate library of reusable work primitives, based on expectations for the robot. The robot is trained to perform reusable work primitives in multiple libraries, by generating control instructions which cause the robot to perform each reusable work primitive. Training is performed by real-world robots performing reusable work primitives, or simulated robot instances performing the reusable work primitives.
1 . A computer-implemented method of training a robot to complete a plurality of work objectives including at least one first work objective in a first service category and at least one second work objective in a second service category, the method comprising:
defining a first library of reusable work primitives each performable by the robot, wherein at least one respective combination and permutation of reusable work primitives from the first library of reusable work primitives are initiable and executable by the robot in order to complete the at least one first work objective in the first service category; and
defining a second library of reusable work primitives each performable by the robot, the second library of reusable work primitives being at least partially different from the first library of reusable work primitives, wherein at least one respective combination and permutation of reusable work primitives from the second library of reusable work primitives are initiable and executable by the robot in order to complete the at least one second work objective in the second service category;
training the robot to autonomously perform each reusable work primitive in the first library of reusable work primitives;
training the robot to autonomously perform each reusable work primitive in the second library of reusable work primitives which is not included in the first library of reusable work primitives; and
retrieving training data for each reusable work primitive in the second library of reusable work primitives which is included in the first library of reusable work primitives, wherein the training data is generated while training the robot to autonomously perform each reusable work primitive in the first library of reusable work primitives.
2 . The method of claim 1 , wherein:
the first library of reusable work primitives and the second library of reusable work primitives are included in a catalog of libraries of reusable work primitives;
the method further comprises training the robot to autonomously perform each reusable work primitive in the catalog of libraries of reusable work primitives;
training the robot to autonomously perform each reusable work primitive in the first library of reusable work primitives is included in training the robot to autonomously perform each reusable work primitive in the catalog of libraries of reusable work primitives; and
training the robot to autonomously perform each reusable work primitive in the second library of reusable work primitives is included in training the robot to autonomously perform each reusable work primitive in the catalog of libraries of reusable work primitives.
3 . The method of claim 1 wherein training the robot to autonomously perform each reusable work primitive in the first library of reusable work primitives and training the robot to autonomously perform each reusable work primitive in the second library of reusable work primitives includes training the robot to autonomously perform each reusable work primitive in the first library of reusable work primitives and the second library of reusable work primitives in a simulated environment.
4 . The method of claim 3 wherein training the robot to autonomously perform each reusable work primitive in the first library of reusable work primitives and the second library of reusable work primitives in a simulated environment includes:
generating a first simulated instance of the robot in the simulated environment;
repeatedly executing processor-executable instructions to cause the first simulated instance of the robot to perform a first reusable work primitive in the first library of reusable work primitives or the second library of reusable work primitives; and
refining the processor-executable instructions that cause the first simulated instance of the robot to perform the first reusable work primitive based on at least one result of repeatedly executing the processor-executable instructions to cause the first simulated instance of the robot to perform the first reusable work primitive.
5 . The method of claim 4 wherein training the robot to autonomously perform each reusable work primitive in the first library of reusable work primitives and the second library of reusable work primitives of reusable work primitives in a simulated environment further includes:
generating at least one additional simulated instance of the robot in the simulated environment;
repeatedly executing processor-executable instructions to cause the at least one additional simulated instance of the robot to perform the first reusable work primitive; and
refining the processor-executable instructions that cause both the first simulated instance of the robot and the at least one additional simulated instance of the robot to perform the first reusable work primitive based on at least one result of repeatedly executing the processor-executable instructions to cause the first simulated instance of the robot and the at least one additional simulated instance of the robot to perform the first reusable work primitive.
6 . The method of claim 4 wherein training the robot to autonomously perform each reusable work primitive in the first library of reusable work primitives and the second library of reusable work primitives of reusable work primitives in a simulated environment further includes:
repeatedly executing processor-executable instructions to cause the first simulated instance of the robot to perform at least one additional reusable work primitive in the first library of reusable work primitives or in the second library of reusable work primitives; and
refining the processor-executable instructions that cause the first simulated instance of the robot to perform the at least one additional reusable work primitive based on at least one result of repeatedly executing the processor-executable instructions to cause the first simulated instance of the robot to perform the at least one additional reusable work primitive.
7 . The method of claim 1 wherein training the robot to autonomously perform each reusable work primitive in the first library of reusable work primitives and the second library of reusable work primitives of reusable work primitives includes:
receiving teleoperation instructions that cause the robot to perform a first reusable work primitive in the first library of reusable work primitives or the second library of reusable work primitives of reusable work primitives;
executing the teleoperation instructions to cause the robot to perform the first reusable work primitive; and
generating processor-executable instructions that cause the robot to execute the teleoperation instructions that cause the robot to perform the first reusable work primitive.
8 . The method of claim 7 wherein receiving teleoperation instructions that cause the robot to perform a first reusable work primitive includes receiving low-level teleoperation instructions that cause the robot to emulate physical actions performed by a physical teleoperation pilot.
9 . The method of claim 7 wherein receiving teleoperation instructions that cause the robot to perform a first reusable work primitive includes receiving high-level teleoperation instructions that cause the robot to perform actions selected from a graphical user interface.
10 . The method of claim 7 wherein training the robot to autonomously perform each reusable work primitive in the first library of reusable work primitives and the second library of reusable work primitives of reusable work primitives further includes generating a simulated instance of the robot in a simulated environment, and wherein:
receiving teleoperation instructions that cause the robot to perform a first reusable work primitive includes receiving teleoperation instructions that cause the simulated instance of the robot to perform the first reusable work primitive in the simulated environment;
executing the teleoperation instructions to cause the robot to perform the first reusable work primitive includes executing the teleoperation instructions to cause the simulated instance of the robot to perform the first reusable work primitive in the simulated environment; and
generating processor-executable instructions that cause the robot to execute the teleoperation instructions that cause the robot to perform the first reusable work primitive includes generating processor-executable instructions that cause the simulated instance of the robot to execute the teleoperation instructions that cause the simulated instance of the robot to perform the first reusable work primitive in the simulated environment.
11 . The method of claim 10 wherein receiving teleoperation instructions that cause the simulated instance of the robot to perform the first reusable work primitive in the simulated environment includes receiving low-level teleoperation instructions that cause the simulated instance of the robot to emulate physical actions performed by a physical teleoperation pilot.
12 . The method of claim 10 wherein receiving teleoperation instructions that cause the simulated instance of the robot to perform the first reusable work primitive in the simulated environment includes receiving high-level teleoperation instructions that cause the simulated instance of the robot to perform actions selected from a graphical user interface.
13 . The method of claim 7 wherein:
receiving teleoperation instructions that cause the robot to perform a first reusable work primitive includes receiving a first set of teleoperation instructions that cause the robot to perform a first instance of the first reusable work primitive and receiving a second set of teleoperation instructions that cause the robot to perform a second instance of the first reusable work primitive; and
executing the teleoperation instructions to cause the robot to perform the first reusable work primitive includes executing the first set of teleoperation instructions to cause the robot to perform the first instance of the first reusable work primitive and executing the second set of teleoperation instructions to cause the robot to perform the second instance of the first reusable work primitive.
14 . The method of claim 13 wherein generating processor-executable instructions that cause the robot to execute the teleoperation instructions that cause the robot to perform the first reusable work primitive includes:
evaluating respective results of executing the first set of teleoperation instructions to cause the robot to perform the first instance of the first reusable work primitive and executing the second set of teleoperation instructions to cause the robot to perform the second instance of the first reusable work primitive to determine which of the first set of teleoperation instructions and the second set of teleoperation instructions produces a better result; and
generating processor-executable instructions that cause the robot to execute whichever of the first set of teleoperation instructions and the second set of teleoperation instructions that produces the better result, wherein a better result includes at least one result selected from a group consisting of: a result that has fewer errors, a result that is more accurate, a result that is more precise, a result that uses less power, a result that is performed more quickly, a result that is performed with greater aesthetic appeal, and a result that is advantageous according to any measure of success.
15 . The method of claim 13 wherein generating processor-executable instructions that cause the robot to execute the teleoperation instructions that cause the robot to perform the first reusable work primitive includes combining at least one element of the first set of teleoperation instructions and at least one element of the second set of teleoperation instructions in the processor-executable instructions that cause the robot to execute the teleoperation instructions that cause the robot to perform the first reusable work primitive.
16 . The method of claim 1 wherein training the robot to autonomously perform each reusable work primitive in the first library of reusable work primitives and the second library of reusable work primitives includes generating processor-executable instructions that, when executed by at least one processor of the robot, cause the robot to autonomously perform each respective reusable work primitive in the first library of reusable work primitives and the second library of reusable work primitives, and the method further comprising:
delivering the processor-executable instructions to a non-transitory processor-readable storage medium of the robot.
17 . The method of claim 1 , further comprising:
defining at least one additional library of reusable work primitives each performable by the robot, the at least one additional library of reusable work primitives being at least partially different from the first library of reusable work primitives and the second library of reusable work primitives, wherein at least one respective combination and permutation of reusable work primitives from the at least one additional library of reusable work primitives are initiable and executable by the robot in order to complete the at least one additional work objective in at least one additional service category; and
training the robot to autonomously perform each reusable work primitive in the at least one additional library of reusable work primitives.
18 . The method of claim 1 , wherein the first service category and the second service category respectively include a service category selected from a group of service categories consisting of:
medical service;
cleaning service;
housekeeping service;
warehouse service;
fetch service;
delivery service;
repair service;
painting service; and
retail service.