Commodity transfer apparatus and control method for same
According to one embodiment of the present disclosure, a product transfer apparatus is provided. The product transfer apparatus includes an arm unit having a holder unit for holding a product, an image capture unit for obtaining image data including at least a portion of the product held by the holder unit for placing the product on a shelf plate of the product display shelf and placed above the front side of the shelf plate by the arm unit, and at least a portion of the shelf plate. The control unit is configured to identify, based on the image data, the relationship between the height of a reference position of the product from an upper surface of the shelf plate and the height of a reference position of the shelf plate, and correct, based on the identified relationship, the height of the reference position of the product relative to the reference position of the shelf plate by operating the arm unit for moving the product.
1 . A product transfer apparatus configured to move a product placed on a stock shelf to a product display shelf which is different from the stock shelf,
the product transfer apparatus comprising:
an arm unit having a holder unit configured to hold the product;
an image capture unit configured to obtain image data including at least a portion of the product held by the holder unit for placing the product on a shelf plate of the product display shelf and placed above the front side of the shelf plate by the arm unit, and at least a portion of the shelf plate; and
a control unit configured to control operation of the holder unit, the arm unit, and the image capture unit,
wherein the control unit is configured to perform:
identifying, based on the image data, the relationship between the height of a reference position of the product from an upper surface of the shelf plate and the height of a reference position of the shelf plate; and
correcting, based on the identified relationship, the height of the reference position of the product relative to the reference position of the shelf plate by operating the arm unit for moving the product.
2 . The product transfer apparatus according to claim 1 , wherein the correcting the height of the reference position of the product includes moving the product in a manner that the height of the reference position of the product becomes the height within a predetermined range from the height of the reference position of the shelf plate.
3 . The product transfer apparatus according to claim 1 , wherein the reference position of the product is an intermediate position of the overall height of the product, and the reference position of the shelf plate is a position of a predetermined height from an upper surface of the shelf plate.
4 . The product transfer apparatus according to claim 1 , wherein the identifying the height of the reference position of the product includes identifying the relationship using a learned model generated by machine learning beforehand using teaching data and learning data,
wherein the teaching data comprises various types of image data and annotation information regarding the relationship between a reference position of the product from an upper surface of the shelf plate and the height of a refence position of the shelf plate associated respectively with the various types of image data, and the learning data comprises various types of image data which are different from the various types of image data of the teaching data.
5 . The product transfer apparatus according to claim 4 , wherein the correcting the height of the reference position of the product includes moving the product by a distance associated beforehand in correspondence with a probability value regarding the height of the reference position of the product identified by the learned model.
6 . The product transfer apparatus according to claim 1 , wherein the product transfer apparatus further comprises a contact detection sensor configured to detect contact of the product with the shelf plate at the time of placing the product on the shelf plate; and
the control unit is configured to operate the arm unit to further perform:
moving the product having the corrected height of the reference position to a position above the placement position of the shelf plate;
moving the product moved to the position above the placement position toward the shelf plate until the contact detection sensor detects contact of the product with the shelf plate; and
releasing holding of the product by the holder unit after detection of the contact of the product with the shelf plate by the contact detection sensor.
7 . A method of controlling a product transfer apparatus for moving a product placed on a stock shelf to a product display shelf which is different from the stock shelf,
the product transfer apparatus comprising:
an arm unit having a holder unit configured to hold the product;
an image capture unit configured to obtain image data including at least a portion of the product held by the holder unit for placing the product on a shelf plate of the product display shelf and placed above the front side of the shelf plate by the arm unit, and at least a portion of the shelf plate; and
a control unit configured to control operation of the holder unit, the arm unit, and the image capture unit, and
wherein the method is performed by the control unit and including:
identifying, based on the image data, the relationship between the height of a reference position of the product from an upper surface of the shelf plate and the height of a reference position of the shelf plate; and
correcting, based on the identified relationship, the height of the reference position of the product relative to the reference position of the shelf plate by operating the arm unit for moving the product.
8 . A non-transitory computer-readable storage medium storing a computer program, the computer program when executed by one or more processors, configures the one or more processors to control a product transfer apparatus to move a product placed on a stock shelf to a product display shelf which is different from the stock shelf,
the product transfer apparatus comprising:
an arm unit having a holder unit configured to hold the product;
an image capture unit configured to obtain image data including at least a portion of the product held by the holder unit for placing the product on a shelf plate of the product display shelf and placed above the front side of the shelf plate by the arm unit, and at least a portion of the shelf plate; and
a control unit configured to control operation of the holder unit, the arm unit, and the image capture unit,
wherein the program allows the control unit to perform:
identifying, based on the image data, the relationship between the height of a reference position of the product from an upper surface of the shelf plate and the height of a reference position of the shelf plate; and
correcting, based on the identified relationship, the height of the reference position of the product relative to the reference position of the shelf plate by operating the arm unit for moving the product.