Visuo-haptic sensor
The present disclosure presents a visuo-haptic sensor, which is based on a passive, deformable element whose deformation is observed by a camera. In particular, the improved simplified sensor may determine the force and/or torque applied to a point of the sensor in multiple spatial dimensions.
1. An apparatus, comprising:
a haptic element comprising at least one optically opaque passive elastically deformable element deformable in multiple dimensions, the haptic element having a first end firmly attached to a movable robot arm and an opposite second end firmly attached to a robot tool;
at least one camera external to the haptic element and operable to capture images of an outside of the elastically deformable element; and
a processor operable to
determine a change of pose of the elastically deformable element by visual tracking and
determine a measurement of force and torque applied to the elastically deformable element based on the captured images and the determined change of pose, wherein the measurement includes at least three components comprising forces and/or torques,
wherein the measurement comprises a 6-axis force and torque vector comprising forces along all three spatial dimensions and torques along all three spatial dimensions.
2. The apparatus of claim 1 ,
wherein the haptic element further comprises a rigid base element and a rigid front element coupled via the elastically deformable element; and
wherein the processor is further operable to determine the change of pose of the rigid front element with respect to the base element.
3. The apparatus of claim 2 , wherein the deformable element comprises a beam and/or a tool which is mounted to the front element.
4. The apparatus of claim 2 , wherein the rigid base element and rigid front element comprise planar structures.
5. The apparatus of claim 1 , wherein the change of pose is determined by observing at least two points on the haptic element.
6. The apparatus of claim 1 , wherein the change of pose is determined by observing three or more points on the haptic element.
7. The apparatus of claim 1 , further comprising a visual tracker to determine the change of pose.
8. The apparatus of claim 1 , wherein the haptic element is mechanically attached to a movable robotic element and the movable robotic element is arranged in a field of view of the camera.
9. A method, comprising:
providing a haptic element comprising at least one optically opaque passive elastically deformable element deformable in multiple dimensions,
firmly attaching a first end of the haptic element to a movable robot arm and firmly attaching an opposite second end of the haptic element to a robot tool;
capturing images of an outside of the elastically deformable element with at least one camera;
determining a change of pose of the elastically deformable element by visual tracking; and
determining a measurement of force applied to the elastically deformable element based on the captured images and the determined change of pose, wherein the measurement of force includes at least three dimensions including both force and torque components,
wherein the measurement comprises a 6-axis force and/or torque vector comprising forces along all three spatial dimensions and torques along all three spatial dimensions.
10. The method of claim 9 , wherein the step of determining the change of pose comprises observing at least two points on the haptic element.
11. The method of claim 9 , wherein the step of determining the change of pose comprises observing three or more points on the haptic element.