Systems and methods for naïve physics for contact and contact-awareness in robotic teleoperation
A method includes detecting an object in a real environment of a robot. The method further includes inferring an expected property of the object based upon a representation of the object within a representation of the real environment of the robot. The method also includes sensing, via a sensor of the robot, a presently-detected property of the object in the real environment corresponding to the expected property. The method still further includes detecting a conflict between the expected property of the object and the presently-detected property of the object.
1. A method comprising:
detecting an object in a real environment of a robot;
inferring an expected amount of force needed for an effectuator of the robot to interact with the object based upon a representation of the object within a representation of the real environment of the robot;
receiving user input directing the effectuator of the robot to interact with the representation of the object within the representation of the real environment of the robot;
sensing, via a sensor of the robot, a detected amount of force utilized for interaction of the effectuator of the robot with;
detecting a conflict between the expected amount of force for interaction with the object and the detected amount of force utilized for the effectuator of the robot to interact with the object, wherein the detected amount of force utilized differs from the expected amount of force;
updating, based on the conflict, an expected amount of force value based on the detected amount of force utilized; and
adjusting an amount of force to apply to the object based on the conflict.
2. The method of claim 1 further comprising recalibrating a part of the robot based upon the conflict.
3. The method of claim 2 further comprising recalibrating the sensor based upon the conflict.
4. The method of claim 1 further comprising altering manipulation by the robot based on the conflict being detected through touch.
5. The method of claim 1 further comprising altering movement of the robot or manipulation by the robot based on the conflict being detected through touch.
6. The method of claim 1 further comprising scanning, via the robot, the real environment to update representation data pertaining to the representation of the object.
7. The method of claim 1 further comprising:
determining a threshold amount of force that can be exerted by the robot; and
displaying a warning that an amount of force to interact with the object exceeds the threshold amount.
8. A system comprising:
a robot comprising:
an effectuator; and
a sensor configured to output a signal; and
a processor configured to:
detect an object in a real environment of a robot based on the signal output by the sensor;
infer an expected amount of force needed for the effectuator of the robot to interact with the object based upon a representation of the object within a representation of the real environment of the robot;
receive user input directing the effectuator of the robot to interact with the representation of the object within the representation of the real environment of the robot;
sense, via the signal output by the sensor, a detected amount of force utilized for interaction of the effectuator of the robot with the object in the real environment;
detect a conflict between the expected amount of force for interaction with the object and the detected amount of force utilized for the effectuator of the robot to interact with the object, wherein the detected amount of force utilized differs from the expected amount of force;
update, based on the conflict, an expected amount of force value based on the detected amount of force utilized; and
adjust an amount of force to apply to the object based on the conflict.
9. The system of claim 8 wherein the processor is further configured to recalibrate a part of the robot based upon the conflict.
10. The system of claim 9 wherein the processor is further configured to recalibrate the sensor based upon the conflict.
11. The system of claim 8 wherein the processor is further configured to alter manipulation by the robot based on the conflict being detected through touch.
12. The system of claim 8 wherein the processor is further configured to alter movement by the robot based on the conflict being detected through touch.
13. The system of claim 8 wherein the robot is further configured to scan the environment to scan the real environment to update representation data pertaining to the representation of the object.
14. The system of claim 8 wherein the processor is further configured to:
determine a threshold amount of force that can be exerted by the robot; and
display a warning that an amount of force to interact with the object exceeds the threshold amount.