Smart movable closure system for cooling cabinet
A smart, movable closure system that allows access to the interior from the exterior of the cabinet, is disclosed. In some embodiments, the movable structure may be coupled with a cabinet interior that is adapted to be kept at a temperature cooler than the exterior cabinet ambient temperature, for example, to store perishable consumer goods in a retail setting. In particular, the smart, movable closure system may include electronic components that display graphical renderings corresponding to one or more products stored in the retail product container. In addition, the smart, movable closure system may include a controller that that determines an inventory status of products in the closure system, and based on the determined inventory status, controls the graphical renderings.
1. A smart, movable closure system configured for installation in a retail environment requiring a cabinet adapted to be kept at a temperature cooler than an exterior cabinet ambient temperature, the system comprising:
an internal storage volume of a retail product container storing perishable items for purchase in the retail environment;
a movable door prohibiting viewing of the internal storage volume;
a display device affixed to the movable door, wherein the display device is configured to display at least a planogram of the internal storage volume, wherein the planogram comprises an out-of-stock indicator;
an optical sensor installed on the movable door to capture one or more images of the internal storage volume of the retail product container;
a controller communicatively coupled to the display device;
a data store comprising an inputted planogram mapping of the internal storage volume and a description of a plurality of products, wherein the description comprises shape, color, and dimension of each of the plurality of products;
one or more processors in a proximity of the retail product container, and
a memory storing computer readable instructions that, when executed by the one or more processors, causes the one or more processors to:
post-process the one or more images captured by the optical sensor into a composite image;
determine, based on the composite image, the inputted planogram mapping, and the description of the plurality of products, an inventory status of a product, among the plurality of products, in the retail product container;
calculate a confidence score based on the composite image and the description of the plurality of products;
reevaluate, using a machine learning mode, the confidence score based on feedback providing a degree of correctness on the confidence score;
determine that the product is out-of-stock in the internal storage volume when the confidence score is below a threshold value;
determine, based on the determined inventory status, an advertisement to be displayed on the display device, wherein the advertisement comprises the out-of-stock indicator when the inventory status of the product is out of stock; and
send, to the controller, the advertisement for display on the display device.
2. The smart, movable closure system of claim 1 , wherein the inputted planogram mapping comprises:
an indication of the product; and
an indication of a specified location of the product.
3. The smart, movable closure system of claim 2 , wherein the determining the inventory status of the product comprises determining, based on the composite image, that no product is detected at the specified location.
4. The smart, movable closure system of claim 3 , wherein the optical sensor is configured to capture a plurality of images during operation of the movable door, wherein the operation comprises opening of the movable door and closing of the movable door.
5. The smart, movable closure system of claim 3 , wherein the advertisement comprises an artwork associated with a different product.
6. The smart, movable closure system of claim 3 , wherein the instructions, when executed by the one or more processors, causes the one or more processors to transmit, to a computing device, a message indicating that the product is not in the retail product container.
7. The smart, movable closure system of claim 2 , wherein the determining the inventory status of the product comprises identifying, based on the composite image, the stored product in the retail product container, and further determining at least one selected from:
a location of the stored product;
a shape of the stored product;
a color of the stored product;
dimensions of the stored product; and combination thereof.
8. The smart, movable closure system of claim 7 , wherein the determining the inventory status of the product comprises determining that the product is present in the retail product container based on at least one selected from:
determining that the location of the stored product corresponds to the specified location;
determining that the shape of the stored product corresponds to a shape of the product in the description;
determining that the color of the stored product corresponds to a color of the product in the description; and
determining that the dimensions of the stored product corresponds to dimensions of the product in the description; and combination thereof.
9. The smart, movable closure system of claim 7 , wherein the advertisement comprises artwork associated with the product.
10. The smart, movable closure system of claim 2 , wherein the determining the inventory status of the product comprises determining that another product is present at the specified location in the retail product container based on at least one selected from:
determining that a shape of the another product does not correspond to a shape of the product in the description;
determining that a color of the another product does not correspond to a color of the product in the description;
determining that dimensions of the another product does not correspond to dimensions of the product in the description; and combination thereof.
11. The smart, movable closure system of claim 2 , wherein the determining the inventory status of the product comprises:
comparing one or more attributes of a stored product in the composite image with the description of the product in the inputted planogram mapping.
12. The smart, movable closure system of claim 1 , wherein the determining the inventory status of the product comprises determining a quantity of the product in the retail product container.
13. The smart, movable closure system of claim 1 , wherein the advertisement comprises a planogram comprising artworks associated with the plurality of products.
14. The smart, movable closure system of claim 1 , further comprising, receiving, from a computing device, the inputted planogram mapping.
15. The smart, movable closure system of claim 1 , wherein the data store is located in the retail environment, and wherein the one or more images are captured based on operation of the movable door.
16. A method for generating advertisement content on a display screen affixed to a movable door attached to a retail product container comprising an internal storage volume, the method comprising:
determining an inputted planogram mapping of the internal storage volume and a description of a plurality of products, wherein the description comprises shape, color, and dimension of each of the plurality of products;
post-processing one or more images captured by an optical sensor, installed on the movable door, into a composite image;
determining, based on the composite image, the inputted planogram mapping, and the description of the plurality of products, an inventory status of a product, among the plurality of products, in the retail product container;
calculating a confidence score based on the composite image and the description of the plurality of products;
reevaluating, using a machine learning mode, the confidence score based on feedback providing a degree of correctness on the confidence score;
determining that the product is out-of-stock in the internal storage volume when the confidence score is below a threshold value; determining, based on the determined inventory status, an advertisement to be displayed on the display screen, wherein the advertisement to be displayed comprises an out-of-stock indicator indicating that the product is out of stock; and
sending the advertisement for display on the display screen.
17. The method of claim 16 , wherein the inputted planogram mapping comprises:
an indication of the product; and
an indication of a specified location of the product.
18. The method of claim 17 , wherein:
the determining the inventory status of the product comprises determining, based on the composite image, that no product is detected at the specified location, and
the advertisement comprises an out-of-stock indicator indicating that the product is out of stock.
19. A computer platform of a cooling system comprising a retail product container with an internal storage volume, a movable door blocking a view of the internal storage volume, a display affixed to the movable door, wherein the display is configured to display at least a planogram of the internal storage volume, and an optical sensor affixed on the movable door, the computing platform comprising:
one or more processors; and
a memory storing computer-executable instructions that, when executed by the one or more processors, causes the one or more processors to:
determine an inputted planogram mapping of the internal storage volume and a description of a plurality of products, wherein the description comprises shape, color, and dimension of each of the plurality of products;
post-process one or more images captured by the optical sensor, installed on the movable door, into a composite image;
determine, based on the composite image, the inputted planogram mapping, and the description of the plurality of products, an inventory status of a product, among the plurality of products, in the retail product container;
calculate a confidence score based on the composite image and the description of the plurality of products;
reevaluate, using a machine learning mode, the confidence score based on feedback providing a degree of correctness on the confidence score;
determine that the product is out-of-stock in the internal storage volume when the confidence score is below a threshold value;
determine, based on the determined inventory status, an advertisement to be displayed on the display, wherein the advertisement to be displayed comprises an out-of-stock indicator indicating that the product is out of stock; and
sending the advertisement for display on the display.
20. The computing platform of claim 19 , wherein the planogram mapping comprises:
an indication of the product; and
an indication of a specified location of the product.