Systems and methods for sensing objects
Disclosed is a tactile sensing and integrated vision system that surmounts problems of existing systems. The tactile sensing skin can be formed into any shape, size, or form factor, including large areas. Computer-implemented algorithms can detect position-orientation and force-torque at landmark points for a given object set. The result is a modular sensing system that is highly scalable in terms of price, quantity, size and applications. Such skin technology and associated software can comprise a sensing package that integrates tactile and visual data with accompanying software for state estimation, situational awareness, and automatic control of machinery. The addition of tactile data can serve to constrain and/or augment visual pose estimation methods as well as provide pose estimation to visually occluded objects.
1. A system for gripping an object, comprising:
a robotic gripper comprising a substrate wrapped around at least a portion thereof, wherein said substrate comprises a polymer, wherein said substrate comprises a plurality of non-metallic sensing electrodes embedded therein, wherein said non-metallic sensing electrodes are flexible, and wherein said plurality of non-metallic sensing electrodes embedded in said substrate is adapted to generate signals indicative of a change in electrical impedance in said substrate when disposed at or in proximity to said object; and
a controller electrically coupled to said plurality of non-metallic sensing electrodes and said robotic gripper, wherein said controller is programmed to (i) detect said signals indicative of said change in electrical impedance in said substrate of at least a subset of said plurality of non-metallic sensing electrodes, (ii) use said signals to determine a profile indicative of one or more forces applied to said substrate, which profile is indicative of one or more characteristics of said object, and (iii) based on said one or more characteristics, instruct said robotic gripper to grip said object.
2. The system of claim 1 , further comprising an imaging unit communicatively coupled to said controller, wherein said imaging unit is configured to image said object and transmit visual data of said object to said controller.
3. The system of claim 2 , wherein said controller is programmed to, with aid of said visual data, determine the one or more characteristics of said object.
4. The system of claim 3 , wherein said one or more characteristics includes an orientation or position of said object.
5. The system of claim 2 , further comprising a light source communicatively coupled to said controller, wherein said light source is configured to provide lighting to said object being imaged by said imaging unit.
6. The system of claim 5 , wherein said controller is programmed to adjust said lighting from said light source.
7. The system of claim 6 , wherein said controller is programmed to adjust an angle, intensity, or type of said lighting.
8. The system of claim 1 , wherein said one or more characteristics are indicative of a presence of said object, shape of said object, or proximity of said object to said substrate.
9. The system of claim 1 , wherein said robotic gripper is configured to apply a magnetic field to grip said object.
10. A system for sensing an object, comprising:
at least one substrate comprising (i) a plurality of non-metallic sensing electrodes embedded therein and (ii) two or more layers with different material properties, wherein said substrate comprises a polymer, wherein said non-metallic sensing electrodes are flexible, and wherein said plurality of non-metallic sensing electrodes embedded in said at least one substrate is adapted to generate signals indicative of a change in electrical impedance in said at least one substrate when disposed at or in proximity to said object; and
a controller electrically coupled to said plurality of non-metallic sensing electrodes, wherein said controller is programmed to (i) detect said signals indicative of said change in electrical impedance in said at least one substrate of at least a subset of said plurality of non-metallic sensing electrodes, and (ii) use said signals to determine a profile indicative of one or more forces applied to said substrate, which profile is indicative of one or more characteristics of said object.
11. The system of claim 10 , wherein said two or more layers have different densities.
12. The system of claim 10 , wherein said two or more layers have different electrical conductivities.
13. The system of claim 12 , wherein said two or more layers comprise a first layer and a second layer, wherein said first layer comprises said plurality of non-metallic sensing electrodes and said second layer comprises a plurality of conductive pathways for said plurality of non-metallic sensing electrodes, wherein said first layer has lower electrical conductivity than said second layer.
14. The system of claim 10 , wherein said two or more layers are stacked layers.
15. The system of claim 14 , wherein said two or more layers are arranged concentrically.
16. The system of claim 14 , wherein said two or more layers include a first layer and a second layer, wherein said first layer is configured to be adjacent to said object, and wherein said second layer includes a flexible filament with a tensile strength greater than said first layer.
17. The system of claim 14 , wherein said two or more layers include a first layer and a second layer, wherein said first layer has lower electrical conductivity than said second layer, and wherein said first layer is configured to be adjacent to said object.
18. The system of claim 10 , wherein said two or more layers include a surface that is textured.
19. The system of claim 10 , wherein said two or more layers include a layer that comprises a blend of a polymeric material, a foaming agent, and an electrically conductive agent.
20. The system of claim 19 , wherein said two or more layers include an additional layer that comprises an additional blend of a polymeric material, a foaming agent, and an electrically conductive agent.