Autonomous crop harvester
Systems and methods capable of selecting and positively grasping objects of interest within a cluttered environment are described. Some aspects of the present disclosure provide for real-time control of a robot that uses various sensors and reacts to sensor input in real time to adjust the robots path. In some embodiments, a robotic item picker includes an end effector having a shaft extending along a longitudinal axis between a proximal end and a distal end, a carriage configured to rotate about and translate along an intermediate portion of the shaft between a proximal position and a distal position, a suction device coupled to the distal end of the shaft, and a plurality of fingers spaced radially about the carriage. The robot may be a t-bot including a longitudinal member rotatable about a lengthwise axis of the longitudinal member, a carriage translatable along the lengthwise axis, and a radial member slidably mounted to the carriage. The end effector may be rotatably coupled at a distal end of the radial member.
1. An end effector for a picking robot, the end effector comprising:
a shaft extending along a longitudinal axis between a proximal end and a distal end;
a carriage configured to rotate about and translate along an intermediate portion of the shaft between a proximal position and a distal position;
a suction device coupled to the distal end of the shaft; and
a plurality of fingers spaced radially about the carriage, each finger coupled to the carriage by a hinge and extending distally from the carriage, the plurality of fingers configured to envelop the intermediate portion of the shaft when the carriage is in the proximal position, the plurality of fingers further configured to envelop a target object space comprising the distal end of the shaft and the suction device when the carriage is in the distal position;
wherein the suction device comprises at least one sensor configured to detect the presence of an object within the target space, wherein the at least one sensor comprises a linear position sensor or a 3D force sensor, wherein the object within the target object space is tethered to a stationary object, and wherein the at least one sensor is configured to detect a direction at which the object is tethered to the stationary object.
2. The end effector of claim 1 , wherein the suction device is configured to apply a vacuum to the target object space when the carriage is in the proximal position and in the distal position.
3. The end effector of claim 1 , wherein the suction device is a distal-most portion of the end effector when the carriage is in the proximal position, and wherein the plurality of fingers are the distal-most portion of the end effector when the carriage is in the distal position.
4. The end effector of claim 1 , wherein the plurality of fingers do not envelop the distal end of the shaft when the carriage is in the proximal position.
5. The end effector of claim 1 , wherein the plurality of fingers are configured to envelop an object within the target object space when the carriage is in the distal position.
6. The end effector of claim 1 , wherein each of the plurality of fingers is configured to rotate about the hinge toward the longitudinal axis of the shaft.
7. The end effector of claim 6 , wherein a volume of the target object space decreases when each of the plurality of fingers rotates toward the longitudinal axis of the shaft.
8. The end effector of claim 1 , wherein the carriage is rotationally fixed about the shaft, and wherein the shaft is rotatably mounted within the end effector such that the carriage is rotatable by rotating the shaft about the longitudinal axis.
9. The end effector of claim 1 , wherein the shaft comprises a collar extending radially outward about the distal end of the shaft, wherein each finger comprises a finger extension extending radially inward toward the longitudinal axis at a proximal end of the finger, and wherein, as the carriage moves from the proximal position towards the distal position, the finger extension is configured to contact the collar before the carriage reaches the distal position.
10. The end effector of claim 9 , wherein movement of the carriage to the distal position following contact of each finger extension with the collar causes each finger to rotate about the hinge toward the longitudinal axis.
11. The end effector of claim 9 , wherein movement of the carriage to the distal position following contact of each finger extension with the collar causes the volume of the target object space to decrease.
12. The end effector of claim 1 , wherein each finger comprises a force sensor configured to detect a force exerted between the finger and an object within the target object space.
13. The end effector of claim 12 , wherein the force exerted between the finger and the object comprises at least one of a normal force and a shear force.
14. The end effector of claim 1 , wherein the suction device further comprises a vacuum sensor.
15. The end effector of claim 1 , further comprising a camera coupled to the end effector and processing circuitry configured to detect target objects based at least in part on images obtained from the camera.
16. The end effector of claim 15 , wherein the processing circuitry is further configured to determine target object locations with respect to a coordinate system based at least in part on the images obtained from the camera.
17. The end effector of claim 16 , wherein the processing circuitry is further configured to share at least one of image data and target object location data with processing circuitry associated with a second end effector.
18. The end effector of claim 1 , wherein the suction device is a suction cup comprising a collapsible bellows.
19. The end effector of claim 1 , wherein the end effector is coupled to a picking robot of a movable harvester.
20. The end effector of claim 19 , wherein the harvester further comprises a LIDAR system configured to guide the harvester along a path parallel to a furrow of an agricultural field based on detection of at least a portion of a profile of the furrow.
21. An end effector for a picking robot, the end effector comprising:
a shaft extending along a longitudinal axis between a proximal end and a distal end, the shaft comprising a collar extending radially outward about the distal end of the shaft;
a carriage configured to rotate about and translate along an intermediate portion of the shaft between a proximal position and a distal position;
a suction device coupled to the distal end of the shaft; and
a plurality of fingers spaced radially about the carriage, each finger coupled to the carriage by a hinge and extending distally from the carriage, the plurality of fingers configured to envelop the intermediate portion of the shaft when the carriage is in the proximal position, the plurality of fingers further configured to envelop a target object space comprising the distal end of the shaft and the suction device when the carriage is in the distal position, each finger comprising a finger extension extending radially inward toward the longitudinal axis at a proximal end of the finger;
wherein, as the carriage moves from the proximal position towards the distal position, the finger extension is configured to contact the collar before the carriage reaches the distal position.
22. The end effector of claim 21 , wherein movement of the carriage to the distal position following contact of each finger extension with the collar causes each finger to rotate about the hinge toward the longitudinal axis.
23. The end effector of claim 21 , wherein movement of the carriage to the distal position following contact of each finger extension with the collar causes the volume of the target object space to decrease.
24. The end effector of claim 21 , wherein the suction device is configured to apply a vacuum to the target object space when the carriage is in the proximal position and in the distal position.
25. The end effector of claim 21 , wherein the suction device is a distal-most portion of the end effector when the carriage is in the proximal position, and wherein the plurality of fingers are the distal-most portion of the end effector when the carriage is in the distal position.