Robotic kitting system
A kitting system is disclosed. In various embodiments, the kitting system includes a conveyance structure configured to impart to an item a first net resultant force substantially in a first direction, wherein the first direction is associated with a direction of flow from a source end of the conveyance structure to a destination end opposite the source end and associated with a pick-up zone from which the item is to be retrieved; a sensor configured to provide a sensor output associated with the pick-up zone; and a processor configured to provide a control input to one or both of the conveyance structure and a disrupter device associated with the conveyance structure based at least in part on the sensor output.
1 . A kitting system, comprising:
a conveyance structure configured to impart to an item a first net resultant force substantially in a first direction, wherein the first direction is associated with a direction of flow from a source end of the conveyance structure to a destination end opposite the source end and associated with a pick-up zone from which the item is to be retrieved;
a sensor configured to provide a sensor output associated with the pick-up zone;
a disrupter device configured to disrupt the flow of items on the conveyance structure by applying a repositioning force to items carried by the conveyance structure while the items are flowing on the conveyance structure; and
a processor configured to (i) provide a control input to one or both of the conveyance structure and the disrupter device associated with the conveyance structure based at least in part on the sensor output, and (ii) determine a plan for controlling a robot to retrieve a required item from the pick-up zone;
wherein:
the processor uses the sensor output to determine a density, distribution, or orientation of a plurality of items in the pick-up zone;
determining the plan for controlling the robot to retrieve the required item from the pickup zone comprises:
determining whether any strategies exist for using the robot to retrieve the required item; and
in response to determining, based on the sensor output, that no strategies exist for using the robot to retrieve the item, determining to adjust the plurality of items in the pick-up zone; and
adjusting the plurality of items in the pick-up zone comprises using the processor to provide the control input to control the disrupter device to disrupt the flow of the item from the source end to the destination end based at least in part on (i) context data pertaining to a set of requirements indicating one or more types of items to be retrieved from the pickup zone and a quantity corresponding to the one or more types of items, and (ii) the density, distribution, or orientation of the plurality of items in the pick-up zone;
the processor iteratively determines whether any strategies exist for retrieving the item and performs an iteration of adjusting the plurality of items in the pick-up zone until an earlier of (i) the processor identifies a strategy to retrieve the required item, and (ii) a predetermined number of iterations for attempting to determine a strategy and adjust the plurality of items has been performed; and
the processor is configured to initiate human intervention by teleoperation based at least in part on a determination that the predetermined number of iterations for attempting to determine a strategy and adjust the plurality of items has been performed.
2 . The system of claim 1 , wherein the conveyance structure comprises an inclined conveyance surface that is higher at the source end than at the destination end.
3 . The system of claim 2 , wherein the conveyance surface comprises a ramp.
4 . The system of claim 2 , wherein the conveyance surface comprises a conveyor belt.
5 . The system of claim 4 , wherein the control input controls a speed with which the conveyor belt advances the item.
6 . The system of claim 4 , wherein the control input controls a time at which the conveyor belt advances the item.
7 . The system of claim 1 , wherein the sensor comprises a camera.
8 . The system of claim 1 , wherein the sensor comprises one or more of the following: a laser; a trip wire; a bar code, QR, or other optical code scanner; an ultrasound sensor; a LIDAR sensor; a thermal sensor; a weight sensor; and a force sensor.
9 . The system of claim 1 , wherein the conveyance structure comprises a first conveyor belt and the disrupter device comprises a second conveyor belt.
10 . The system of claim 9 , wherein the second conveyor belt advances in a second direction at least partly orthogonal to the first direction.
11 . The system of claim 9 , wherein the second conveyor belt advances in a second direction at least partly opposite the first direction.
12 . The system of claim 9 , wherein the control input includes one or both of a first command to operate the first conveyor belt at a first speed and a second command to operate the second conveyor belt at a second speed.
13 . The system of claim 1 , wherein disrupter device comprises a baffle, paddle, or other rigid structure.
14 . The system of claim 1 , wherein the disrupter device applies a second force to the item.
15 . The system of claim 1 , wherein the disrupter device generates and applies to the item a blast of air.
16 . The system of claim 1 , wherein the disrupter device generates and applies a second force to the item by shaking or vibrating one or both of the item and the pick-up zone.
17 . The system of claim 1 , further comprising the disrupter device.
18 . The system of claim 1 , wherein the processor is configured to provide the control input based at least in part on a selected strategy to autonomously retrieve the item from the pick-up zone with a robotic arm and gripper.
19 . The system of claim 18 , wherein the processor is configured to learn through autonomous machine learning said selected strategy to autonomously retrieve the item from the pick-up zone with a robotic arm and gripper.
20 . The system of claim 18 , wherein the selected strategy is included in a plurality of strategies to pick the required item up from the pick-up zone and the processor is configured to determine the control input at least in part by evaluating at least available ones of the plurality of strategies and determining based at least in part on the sensor output that providing the control input will increase the likelihood that the strategy will be available to pick up the item from the pick-up zone.
21 . The kitting system of claim 1 , wherein the processor controls the disrupter device to change a configuration of the disrupted device based on a determined strategy to achieve a threshold density, distribution, or orientation of a plurality of items in the pick-up zone.
22 . The kitting system of claim 1 , wherein:
the conveyance structure comprises a conveyor belt; and
the processor controls the disrupter device to disrupt the flow of the item while the conveyor belt is operated to move items in the first direction.
23 . The kitting system of claim 1 , wherein the processor determines to control the disrupter device in response to a determination that a strategy of using the disrupter device to disrupt the flow of the item is expected to increase a likelihood of successful kitting of at least a subset of the plurality of items in the pick-up zone.
24 . The kitting system of claim 1 , wherein the processor controls the disrupter device to disrupt the flow of the item in response to a determination that a density of the plurality of items in the pick-up zone exceeds a threshold density.
25 . The kitting system of claim 1 , wherein the disrupter device disrupts the flow of the item by causing the item to flow in a direction opposite to a direction to the pickup zone, or in a direction that is perpendicular to the direction to the pickup zone.
26 . The kitting system of claim 1 , wherein the required item is determined based at least in part on an order or a pick list.
27 . The kitting system of claim 1 , wherein the disrupter device is controlled to engage the item to (i) direct the item to a more centered position on the conveyance structure, or (ii) rotate or alter a position of the item.
28 . A method, comprising:
using a conveyance structure configured to impart to an item a first net resultant force substantially in a first direction, wherein the first direction is associated with a direction of flow from a source end of the conveyance structure to a destination end opposite the source end and associated with a pick-up zone from which the item is to be retrieved; and
using a processor to (i) provide a control input to one or both of the conveyance structure and a disrupter device associated with the conveyance structure based at least in part on output of a sensor associated with the pick-up zone, and (ii) determine a plan for controlling a robot to retrieve a required item from the pick-up zone;
wherein:
the disrupter device is configured to disrupt the flow of items on the conveyance structure by applying a repositioning force to items carried by the conveyance structure while the items are flowing on the conveyance structure;
the processor uses the sensor output to determine a density, distribution, or orientation of a plurality of items in the pick-up zone;
determining the plan for controlling the robot to retrieve the required item from the pickup zone comprises:
determining whether any strategies exist for using the robot to retrieve the required item; and
in response to determining, based on the sensor output, that no strategies exist for using the robot to retrieve the item, determining to adjust the plurality of items in the pick-up zone; and
adjusting the plurality of items in the pick-up zone comprises using the processor to provide the control input to control the disrupter device to disrupt the flow of the item from the source end to the destination end based at least in part on (i) context data pertaining to a set of requirements indicating one or more types of items to be retrieved from the pickup zone and a quantity corresponding to the one or more types of items, and (ii) the density, distribution, or orientation of the plurality of items in the pick-up zone;
the processor iteratively determines whether any strategies exist for retrieving the item and performs an iteration of adjusting the plurality of items in the pick-up zone until an earlier of (i) the processor identifies a strategy to retrieve the required item, and (ii) a predetermined number of iterations for attempting to determine a strategy and adjust the plurality of items has been performed; and
the processor is configured to initiate human intervention by teleoperation based at least in part on a determination that the predetermined number of iterations for attempting to determine a strategy and adjust the plurality of items has been performed.
29 . A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions that, when executed by one or more processors, cause the one or more processors to:
control a conveyance structure configured to impart to an item a first net resultant force substantially in a first direction, wherein the first direction is associated with a direction of flow from a source end of the conveyance structure to a destination end opposite the source end and associated with a pick-up zone from which the item is to be retrieved;
use the sensor output to determine a density, distribution, or orientation of a plurality of items in the pick-up zone;
determine a plan for controlling a robot to retrieve a required item from the pick-up zone; and
provide a control input to one or both of the conveyance structure and a disrupter device associated with the conveyance structure based at least in part on output of a sensor associated with the pick-up zone; and
wherein:
the disrupter device is configured to disrupt the flow of items on the conveyance structure by applying a repositioning force to items carried by the conveyance structure while the items are flowing on the conveyance structure;
determining the plan for controlling the robot to retrieve the required item from the pickup zone comprises:
determining whether any strategies exist for using the robot to retrieve the required item; and
in response to determining, based on the sensor output, that no strategies exist for using the robot to retrieve the item, determining to adjust the plurality of items in the pick-up zone; and adjusting the plurality of items in the pick-up zone comprises providing the control input to control the disrupter device to disrupt the flow of the item from the source end to the destination end based at least in part on (i) context data pertaining to a set of requirements indicating one or more types of items to be retrieved from the pickup zone and a quantity corresponding to the one or more types of items, and (ii) the density, distribution, or orientation of the plurality of items in the pick-up zone;
the processor iteratively determines whether any strategies exist for retrieving the item and performs an iteration of adjusting the plurality of items in the pick-up zone until an earlier of (i) the processor identifies a strategy to retrieve the required item, and (ii) a predetermined number of iterations for attempting to determine a strategy and adjust the plurality of items has been performed; and
the processor is configured to initiate human intervention by teleoperation based at least in part on a determination that the predetermined number of iterations for attempting to determine a strategy and adjust the plurality of items has been performed.