Robotic control via a virtual world simulation
A system has a virtual-world (VW) controller and a physical-world (PW) controller. The pairing of a PW element with a VW element establishes them as corresponding physical and virtual twins. The VW controller and/or the PW controller receives measurements from one or more sensors characterizing aspects of the physical world, the VW controller generates the virtual twin, and the VW controller and/or the PW controller generates commands for one or more actuators affecting aspects of the physical world. To coordinate the corresponding virtual and physical twins, (i) the VW controller controls the virtual twin based on the physical twin or (ii) the PW controller controls the physical twin based on the virtual twin. Depending on the operating mode, one of the VW and PW controllers is a master controller, and the other is a slave controller, where the virtual and physical twins are both controlled based on one of VW or PW forces.
1. A system comprising:
a master controller that controls motion of a master twin in a master world; and
a slave controller that communicates with the master controller and controls motion of a slave twin in a slave world, wherein:
slave-world force data corresponding to a force applied to the slave twin in the slave world is provided to the master controller;
the master controller controls the motion of the master twin based on the slave-world force data;
master-world motion data corresponding to the motion of the master twin in the master world is provided to the slave controller; and
the slave controller uses the master-world motion data to control the motion of the slave twin in the slave world to match the motion of the master twin in the master world, wherein:
the master world is a virtual world (VW);
the master controller is a VW controller;
the master twin is a virtual twin;
the slave world is a physical world (PW);
the slave controller is a PW controller; and
the slave twin is a physical twin.
2. The system of claim 1 , wherein:
the PW controller receives other VW motion data corresponding to other motion of the virtual twin that is not based on a PW force applied to the physical twin in the physical world; and
the PW controller uses the other VW motion data to control the motion of the physical twin to match the motion of the virtual twin.
3. The system of claim 1 , wherein the PW controller controls motion of the physical twin such that collisions involving the physical twin are avoided in the physical world.
4. The system of claim 1 , further comprising one or more sensors configured to generate sensor measurements corresponding to the physical world.
5. The system of claim 4 , further comprising one or more actuators configured to move the physical twin.
6. The system of claim 1 , further comprising one or more actuators configured to move the physical twin.
7. The system of claim 1 , wherein the physical twin is a robot.
8. A computer-implemented method for controlling (i) motion of a master twin in a master world and (ii) motion of a slave twin in a slave world, the method comprising:
providing slave-world force data corresponding to a force applied to the slave twin in the slave world;
controlling the motion of the master twin based on the slave-world force data;
providing master-world motion data corresponding to the motion of the master twin in the master world; and
using the master-world motion data to control the motion of the slave twin in the slave world to match the motion of the master twin in the master world, wherein:
the master world is a virtual world (VW);
the master twin is a virtual twin;
the slave world is a physical world (PW); and
the slave twin is a physical twin.
9. The method of claim 8 , further comprising:
providing other VW motion data corresponding to other motion of the virtual twin that is not based on a PW force applied to the physical twin in the physical world; and
using the other VW motion data to control the motion of the physical twin to match the motion of the virtual twin.
10. The method of claim 8 , wherein motion of the physical twin is controlled such that collisions involving the physical twin are avoided in the physical world.
11. The method of claim 8 , wherein the physical twin is a robot.