Apparatus and method for determining work to be picked

1. A processing apparatus for determining a work to be picked by a robot from a plurality of works, using an image, captured by an image capture device, of an area on which the plurality of works are placed, wherein

each of a plurality of partial areas of the area is assigned with a priority for a picking sequence, and

wherein, when the robot picks a work positioned in one partial area, the priority for picking sequence is based on an area value of other partial areas shielded by the robot with respect to the image capture device, and

the processing apparatus is configured to

obtain information of positions and orientations of the plurality of works based on the image,

select a pickable candidate work among the plurality of works based on the information,

determine, if there exist a plurality of candidate works, as a picking target work, a candidate work positioned in the partial area assigned with a highest priority among the partial areas where the plurality of candidate works are respectively positioned,

select, as a next pickable candidate work, a candidate work whose position and orientation have changed within allowable ranges before and after picking, based on a result of comparison between an image of the area captured again by the image capture device after picking the target work and a preceding image captured by the image capture device before picking the target work, and

determine, if there exist a plurality of next pickable candidate works, as a next picking target work, a next pickable candidate work positioned in the partial area assigned with the highest priority among the partial areas where the plurality of next pickable candidate works are respectively positioned.

2. The apparatus according to claim 1 , wherein the processing apparatus is configured to assign the priorities before the image capture device captures the preceding image.

3. The apparatus according to claim 1 , wherein if there exist a plurality of candidate works in one partial area, the processing apparatus is configured to determine the target work based on a distance between each of the plurality of candidate works and a gripping portion of the robot before performing picking.

4. The apparatus according to claim 3 , wherein the distance is a distance between a gripped portion of each of the plurality of candidate works and the gripping portion of the robot positioned at one of a retreat position and a conveyance destination.

5. The apparatus according to claim 1 , wherein if there exists one candidate work, the processing apparatus is configured to determine the candidate work as the target work.

6. The apparatus according to claim 1 , wherein the area includes a plurality of rectangular partial areas.

7. The apparatus according to claim 1 , wherein the area includes a plurality of band-like partial areas having different distances from an arm of the robot.

8. A method of determining a work to be picked by a robot from a plurality of works, using an image, captured by an image capture device, of an area on which the plurality of works are placed, comprising:

assigning a priority for a picking sequence to each of a plurality of partial areas of the area,

wherein, when the robot picks a work positioned in one partial area, the priority for picking sequence is based on an area value of other partial areas shielded by the robot with respect to the image capture device;

obtaining information of positions and orientations of the plurality of works based on the image;

selecting a pickable candidate work among the plurality of works based on the information;

determining, if there exist a plurality of candidate works, as a picking target work, a candidate work positioned in the partial area assigned with a highest priority among the partial areas where the plurality of candidate works are respectively positioned;

selecting, as a next pickable candidate work, a candidate work whose position and orientation have changed within allowable ranges before and after picking, based on a result of comparison between an image of the area captured again by the image capture device after picking the target work and a preceding image captured by the image capture device before picking the target work; and

determining, if there exist a plurality of next pickable candidate works, as a next picking target work, a next pickable candidate work positioned in the partial area assigned with the highest priority among the partial areas where the plurality of next pickable candidate works are respectively positioned.

9. A non-transitory computer-readable storage medium storing a program for causing a computer to execute a method of determining a work to be picked by a robot from a plurality of works, using an image, captured by an image capture device, of an area on which the plurality of works are placed, the method comprising:

assigning a priority for a picking sequence to each of a plurality of partial areas of the area,

wherein, when the robot picks a work positioned in one partial area, the priority for picking sequence is based on an area value of other partial areas shielded by the robot with respect to the image capture device;

obtaining information of positions and orientations of the plurality of works based on the image;

selecting a pickable candidate work among the plurality of works based on the information;

determining, if there exist a plurality of candidate works, as a picking target work, a candidate work positioned in the partial area assigned with a highest priority among the partial areas where the plurality of candidate works are respectively positioned;

selecting, as a next pickable candidate work, a candidate work whose position and orientation have changed within allowable ranges before and after picking, based on a result of comparison between an image of the area captured again by the image capture device after picking the target work and a preceding image captured by the image capture device before picking the target work; and

determining, if there exist a plurality of next pickable candidate works, as a next picking target work, a next pickable candidate work positioned in the partial area assigned with the highest priority among the partial areas where the plurality of next pickable candidate works are respectively positioned.

10. A picking system for picking a work from an area on which a plurality of works are placed, and conveying the work to a conveyance destination, comprising:

an image capture device configured to capture the area on which the plurality of works are placed;

a processing apparatus configured to determine a work to be picked from the plurality of works, using an image, captured by the image capture device, of the area on which the plurality of works are placed, and

a robot configured to pick the work determined by the processing apparatus, and convey the work to the conveyance destination,

wherein

each of a plurality of partial areas of the area is assigned with a priority for a picking sequence, and

wherein, when the robot picks a work positioned in one partial area, the priority for picking sequence is based on an area value of other partial areas shielded by the robot with respect to the image capture device, and

the processing apparatus is configure to

obtain information of positions and orientations of the plurality of works based on the image,

select a pickable candidate work among the plurality of works based on the information,

determine, if there exist a plurality of candidate works, as a picking target work, a candidate work positioned in the partial area assigned with the highest priority among the partial areas where a plurality of candidate works are respectively positioned,

select, as a next pickable candidate work, a candidate work whose position and orientation have changed within allowable ranges before and after picking, based on a result of comparison between an image of the area captured again by the image capture device after picking the target work and a preceding image captured by the image capture device before picking the target work, and

determine, if there exist a plurality of next pickable candidate works, as a next picking target work, a next pickable candidate work positioned in the partial area assigned with the highest priority among the partial areas where the plurality of next pickable candidate works are respectively positioned.