COUPLING PRODUCTS AND LABELS BASED ON SIMILAR TEMPORAL TRANSFORMATIONS

1 - 81 . (canceled)

82 . A system for processing images captured in a retail store and automatically determining relationships between products and shelf labels, the system comprising:

at least one processor configured to:

receive images of at least one store shelf captured over a period of time by one or more image sensors, wherein the images depict a plurality of shelf labels and groups of products associated with different product types placed on the at least one store shelf;

analyze the images to identify temporal changes in an arrangement of the groups of products over the period of time, wherein at a first point in time the groups of products are arranged on the least one store shelf in a first manner and at a second point in time the groups of products are arranged on the least one store shelf in a second manner;

analyze the images to identify temporal changes in display of the plurality of shelf labels over the period of time, wherein at the first point in time the plurality of shelf labels are displayed on the least one store shelf in a first manner and at the second point in time the plurality of shelf labels are displayed on the least one store shelf in a second manner;

determine a relationship between a specific group of products and a specific shelf label based on the identified temporal changes in the arrangement of the groups of products and the identified temporal changes in the display of the plurality of shelf labels; and

initiate an action based on the determined relationship.

83 . The system of claim 82 , wherein the at least one processor is further configured to identify a specific product type for the specific group of products placed on the at least one store shelf based on information depicted on the specific shelf label.

84 . The system of claim 82 , wherein the at least one processor is further configured to record the determined relationship between the specific group of products placed on the at least one store shelf and the specific shelf label for future use.

85 . The system of claim 82 , wherein the at least one processor is further configured to forgo initiating the action when the temporal changes in the display of the plurality of shelf labels includes repositioning of the specific shelf label, and the temporal changes in the arrangement of the groups of products do not include a repositioning of the specific group of products to a different location on the at least one store shelf.

86 . A computer program product for processing images captured in a retail store and automatically determining relationships between products and shelf labels, the computer program product embodied in a non-transitory computer-readable medium and including instructions for causing at least one processor to execute a method comprising:

receiving images of at least one store shelf captured over a period of time by one or more image sensors, wherein the images depict a plurality of shelf labels and groups of products associated with different product types placed on the at least one store shelf;

analyzing the images to identify temporal changes in arrangement of the groups of products over the period of time, wherein at a first point in time the groups of products are arranged on the least one store shelf in a first manner and at a second point in time the groups of products are arranged on the least one store shelf in a second manner;

analyzing the images to identify temporal changes in display of the plurality of shelf labels over the period of time, wherein at the first point in time the plurality of shelf labels are displayed on the least one store shelf in a first manner and at the second point in time the plurality of shelf labels are displayed on the least one store shelf in a second manner;

determining a relationship between a specific group of products placed on the at least one store shelf and a specific shelf label based on the identified temporal changes in the arrangement of the groups of products and the identified temporal changes in the display of the plurality of shelf labels; and

initiating an action based on the determined relationship.

87 . The computer program product of claim 86 , wherein the images of the at least one store shelf are captured over a period of time greater than a day.

88 . The computer program product of claim 86 , wherein the images of the at least one store shelf are captured by at least one image sensor fixedly mounted to a retail shelving unit opposing the at least one store shelf.

89 . The computer program product of claim 86 , wherein the action includes updating a machine learning model for product recognition based on the determined relationship between the specific group of products placed on the at least one store shelf and the specific shelf label.

90 . The computer program product of claim 86 , wherein the action includes issuing a user-notification about a misplaced shelf label.

91 . The computer program product of claim 86 , wherein the temporal changes in the arrangement of the groups of products include an addition of the specific group of products to the at least one store shelf, and the temporal changes in the display of the plurality of shelf labels include an addition of the specific shelf label to the at least one store shelf.

92 . The computer program product of claim 86 , wherein the temporal changes in the arrangement of the groups of products include a removal of the specific group of products from the at least one store shelf, and the temporal changes in the display of the plurality of shelf labels include a removal of the specific shelf label from the at least one store shelf.

93 . The computer program product of claim 86 , wherein the temporal changes in the arrangement of the groups of products includes a depletion of products from the specific group of products from the at least one store shelf, and the temporal changes in the display of the plurality of shelf labels include a removal of the specific shelf label from the at least one store shelf.

94 . The computer program product of claim 86 , wherein the temporal changes in the arrangement of the groups of products include a reposition of the specific group of products to a different location on the at least one store shelf, and the temporal changes in the display of the plurality of shelf labels include a reposition of the specific shelf label.

95 . The computer program product of claim 86 , wherein the method further includes:

determining at least one value associated with the determined relationship between the specific shelf label and the specific group of products placed on the at least one store shelf; and

initiating the action when the at least one value is greater than a threshold.

96 . The computer program product of claim 86 , wherein the method further includes:

determining a confidence level associated with the determined relationship between the specific shelf label and the specific group of products placed on the at least one store shelf;

when the confidence level is lower than a first threshold, forgoing initiation of the action;

after forgoing initiating the action, receiving additional images captured at a time later than the time period;

analyzing the additional images to determine an updated confidence level associated with the determined relationship between the specific group of products and the specific shelf label; and

initiating the action when the updated confidence level is greater than a second threshold.

97 . The computer program product of claim 86 , wherein determining the relationship between the specific group of products and the specific shelf label includes recognizing products from the specific group of products as products of a specific product type identified in the specific shelf label.

98 . The computer program product of claim 97 , wherein the method further includes:

receiving additional images captured at a time later than the time period, wherein the images depict additional products placed on the at least one store shelf;

analyzing the additional images to identify an existence of the specific shelf label attached to the at least one store shelf; and

recognizing a group of the additional products as products from the specific product type based on the existence of the specific shelf label.

99 . The computer program product of claim 98 , wherein the group of the additional products are recognized as products from the specific product type irrespective of a location of the specific shelf label relative to a location of the group of the additional products.

100 . The computer program product of claim 86 , wherein the method further includes:

analyzing the images to identify temporal changes in placements of a plurality of promotions associated with the at least one store shelf over the period of time;

determining a second relationship between the specific product type and a specific promotion based on the identified temporal changes in the placements of the plurality of promotions; and

initiating a second action based on the second relationship.

101 . A method for processing images captured in a retail store and automatically determining relationships between products and shelf labels, the method comprising:

receiving images of at least one store shelf captured over a period of time by one or more image sensors, wherein the images depict a plurality of shelf labels and groups of products associated with different product types placed on the at least one store shelf;

analyzing the images to identify temporal changes in arrangement of the groups of products over the period of time, wherein at a first point in time the groups of products are arranged on the least one store shelf in a first manner and at a second point in time the groups of products are arranged on the least one store shelf in a second manner;

analyzing the images to identify temporal changes in display of the plurality of shelf labels over the period of time, wherein at the first point in time the plurality of shelf labels are displayed on the least one store shelf in a first manner and at the second point in time the plurality of shelf labels are displayed on the least one store shelf in a second manner;

determining a relationship between a specific group of products placed on the at least one store shelf and a specific shelf label based on the identified temporal changes in the arrangement of the groups of products and the identified temporal changes in the display of the plurality of shelf labels; and

initiating an action based on the determined relationship.

102 - 221 . (canceled)