Image recognition device for detecting a change of an object, image recognition method for detecting a change of an object, and image recognition system for detecting a change of an object

1. An image processing device comprising:

at least one memory configured to store instructions; and

at least one processor configured to execute the instructions to:

detect a change in display status of a product, based on a captured image including the product;

when the change is detected, associate the change in the display status of the product in which the change is detected with a person included in the captured image, and generate association information representing a relation between the change in the display status of the product and the person;

integrate pieces of the association information including the person determined to be a same person, based on information representing the person included in the association information; and

determine that the product is returned to a different place from a place where the product has been picked up based on the place where the product has been picked up by the person and the place where the product is returned according to a result of integration.

2. The image processing device according to claim 1 tracking wherein the at least one processor is configured to:

generate tracking data of the person based on the captured image,

detect that the product is returned to the different place based on the detected change and the generated tracking data.

3. The image processing device according to claim 2 , wherein the tracking data includes a person identifier and an identifier corresponding to a location of the product.

4. The image processing device according to claim 1 , wherein the at least one processor is configured to:

detect the change product by comparing the captured image with a second image captured earlier than the captured image.

5. The image processing device according to claim 4 , wherein the at least one processor is configured to:

update the second image; and

in a case where a predetermined condition is satisfied, update a portion of the second image, the portion corresponding to a non-change region.

6. The image processing device according to claim 1 , wherein the at least one processor is configured to:

transmit a notification based on a result of the detecting; and

control timing of the notification in accordance with urgency of the notification.

7. The image processing device according to claim 6 , wherein the at least one processor is configured to:

suspend the notification in a case where a given condition is satisfied; and

execute the notification without suspending in a case where the given condition is satisfied and there is urgency.

8. The image processing device according to claim 6 , wherein the at least one processor is configured to:

determine the urgency of the notification based on a type of the product and a place where the product has been picked up.

9. The image processing device according to claim 6 , wherein the at least one processor is configured to:

determine the urgency of the notification based on a number of the customer in the store.

10. The image processing device according to claim 6 , wherein the at least one processor is configured to:

determine the urgency of the notification based on a location of the customer in the store.

11. The image processing device according to claim 1 , wherein the at least one processor is configured to:

transmit a notification, to a terminal of worker in the store, based on a result of detecting.

12. An image processing method executed by an image processing device, the image processing method comprising:

detecting a change in display status of a product, based on a captured image including the product;

when the change is detected, associating the change in the display status of the product in which the change is detected with a person included in the captured image, and generating association information representing a relation between the change in the display status of the product and the person;

integrating pieces of the association information including the person determined to be a same person, based on information representing the person included in the association information; and

determining that the product is returned to a different place from a place where the product has been picked up based on the place where the product has been picked up by the person and the place where the product is returned according to a result of integration.

13. A non-transitory computer-readable medium storing a instructions to cause a computer to execute operations comprising:

detecting a change in display status of a product, based on a captured image including the product;

when the change is detected, associating the change in the display status of the product in which the change is detected with a person included in the captured image, and generating association information representing a relation between the change in the display status of the product and the person;

integrating pieces of the association information including the person determined to be a same person, based on information representing the person included in the association information; and

determining that the product is returned to a different place from a place where the product has been picked up based on the place where the product has been picked up by the person and the place where the product is returned according to a result of integration.