OPTIMIZATION OF PRODUCT PRESENTATION
Systems and methods for automated management of product presentation using remote sensing systems that can include collecting image data and generating a presentation characterization of detected products. The systems and methods can additionally include variations including detecting interaction data and training a presentation classification model using the interaction data and image data. The systems and methods can additionally include updating state of one or more computing device based on the presentation characterization.
1 . A method for automating interpretation of product presentation state comprising:
collecting a first set of image data within an environment of monitored products during a first time period;
determining product presentation image data for a set of product identifiers from the first set of image data;
determining interaction events associated with the set of product identifiers;
training a presentation classification neural network using the first set of image data labeled based on the interaction events;
collecting a second set of image data during a second time period; and
generating a presentation characterization of a product by processing the second set of image data using the presentation classification neural network.
2 . The method of claim 1 , further comprising updating state of a computing device based on the presentation characterization.
3 . The method of claim 2 , further comprising detecting a state of the presentation characterization satisfying a condition for a stocking task; and wherein updating state of the computing device based on the presentation characterization comprises directing a mobile stocking robot to perform a stocking task of the product based on the state of the presentation characterization.
4 . The method of claim 2 , further comprising generating a map of presentation characterizations of a set of products that associates location of different products and presentation characterization.
5 . The method of claim 4 , further comprising tracking location of a worker mobile device, and transmitting a communication to the worker mobile device based on location of the worker mobile device in relation to a product.
6 . The method of claim 2 , wherein updating state of the computing device based on the presentation characterization comprises updating user interface in an administrative console with the presentation characterization of at least one product.
7 . The method of claim 1 , wherein determining interaction events associated with the set of product identifiers comprises detecting user-product interactions, each user-product interaction associated with at least one product identifier.
8 . The method of claim 7 , wherein detecting user-product interactions comprises detecting user attention directed at a product associated with a product identifier.
9 . The method of claim 7 , wherein detecting user-product interactions comprises detecting user picking up a displayed product associated with a product identifier.
10 . The method of claim 1 , wherein determining interaction events associated with the set of product identifiers comprises collecting product purchase event data from a checkout system. ii. A non-transitory computer-readable medium storing instructions that, when executed by one or more computer processors of a computing platform, cause the computing platform to perform operations including:
collecting a first set of image data within an environment of monitored products during a first time period;
determining product presentation image data for a set of product identifiers from the first set of image data;
determining interaction events associated with the set of product identifiers;
training a presentation classification neural network using the first set of image data labeled based on the interaction events;
collecting a second set of image data during a second time period; and
generating a presentation characterization of a product by processing the second set of image data using the presentation classification neural network.
12 . The non-transitory computer-readable medium of claim 11 , further comprising detecting a state of the presentation characterization satisfying a condition for a stocking task; and directing a mobile stocking robot to perform a stocking task of the product based on the state of the presentation characterization.
13 . The non-transitory computer-readable medium of claim 11 , further comprising detecting a state of the presentation characterization satisfying a condition for a stocking task; tracking location of a worker mobile device; and transmitting a communication to the worker mobile device based on location of the worker mobile device in relation to a product and the state of the presentation characterization.
14 . The non-transitory computer-readable medium of claim 11 , wherein determining interaction events associated with the set of product identifiers comprises detecting user-product interactions, each user-product interaction associated with at least one product identifier.
15 . The non-transitory computer-readable medium of claim 11 , wherein determining interaction events associated with the set of product identifiers comprises collecting product purchase event data from a checkout system.
16 . A system comprising of:
one or more computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause a computing platform to perform operations comprising:
collecting a first set of image data within an environment of monitored products during a first time period,
determining product presentation image data for a set of product identifiers from the first set of image data,
determining interaction events associated with the set of product identifiers;
training a presentation classification neural network using the first set of image data labeled based on the interaction events,
collecting a second set of image data during a second time period, and
generating a presentation characterization of a product by processing the second set of image data using the presentation classification neural network.
17 . The system of claim 16 , further comprising detecting a state of the presentation characterization satisfying a condition for a stocking task; and directing a mobile stocking robot to perform a stocking task of the product based on the state of the presentation characterization.
18 . The system of claim 16 , further comprising detecting a state of the presentation characterization satisfying a condition for a stocking task; tracking location of a worker mobile device, and transmitting a communication to the worker mobile device based on location of the worker mobile device in relation to a product and the state of the presentation characterization.
19 . The system of claim 16 , wherein determining interaction events associated with the set of product identifiers comprises detecting user-product interactions, each user-product interaction associated with at least one product identifier.
20 . The system of claim 16 , wherein determining interaction events associated with the set of product identifiers comprises collecting product purchase event data from a checkout system.