Systems and methods for assessing items for sale

1 . A system for assessing items for sale at a retail facility, the system comprising:

an imaging device configured to capture an image of an item for sale at the retail facility;

a database storing data corresponding to the item for sale at the retail facility, wherein the data comprises item dimensions for the item for sale and surface dimensions of surfaces that support and display the item for sale at the retail facility; and

a control circuit coupled to the database and configured to:

receive a captured image of the item for sale, the item for sale positioned on a surface at a location in the retail facility accessible by customers where the customers can collect the items for purchase, wherein the captured image includes a bounding box indicating the item for sale;

receive, for the item in the captured image, an identification of the item for sale associated with each bounding box;

determine, using a reference object with fixed dimensions visible in the captured image, a pixel-to-dimension mapping ratio;

map the item dimensions for the item for sale to pixels associated with each bounding box in the captured image using the pixel-to-dimension mapping ratio;

determine, using at least a pixel count associated with each bounding box and corresponding surface dimensions of the surface, a volume estimate corresponding to the item for sale supported on the surface, wherein determining the volume estimate comprises:

determining an area of aggregated bounding boxes in the captured image based on the pixel-to-dimension mapping ratio of the item dimensions to the pixels;

determining an orientation of the surface based on the area of the aggregated bounding boxes; and

calculating the volume estimate based on the area of the aggregated bounding boxes, the orientation of the surface, and the corresponding surface dimensions of the surface; and

determine, based on at least the volume estimate and the item dimensions, a quantity of the item for sale supported on the surface.

2 . The system of claim 1 , wherein the volume estimate comprises an estimate of a total volume of the items for sale supported on the surface.

3 . The system of claim 1 , wherein the control circuit is further configured to:

determine an area of aggregated bounding boxes in the captured image based on the pixel-to-dimension mapping ratio of the item dimensions for each identified item for sale to the pixels associated with each bounding box; and

determine an orientation of the surface based on the area of the aggregated bounding boxes, wherein a determination of the volume estimate is based on the area of the aggregated bounding boxes, the orientation of the surface, and the corresponding surface dimensions of the surface.

4 . The system of claim 1 , wherein the imaging device comprises a motorized robotic image capture device.

5 . The system of claim 1 , wherein the surface comprises at least one of a pallet or a shelf.

6 . The system of claim 1 , wherein the item dimensions comprises a width, a height, and a length.

7 . The system of claim 1 , wherein the control circuit is further configured to determine the items the item for sale comprises a stack of products having a number of layers, wherein the number of layers of the stack of products is based on the area of aggregated bounding boxes in the captured image and the item dimensions of the item.

8 . The system of claim 1 , wherein the control circuit is further configured to determine a fill value associated with the surface based at least on the quantity of the item for sale supported on the surface.

9 . The system of claim 1 , further comprising a user interface operable on an electronic device associated with a worker at the retail facility, the user interface configured to display a message comprising at least one of an instruction to the worker to restock the surface and an estimated run out time of the item based on the determined quantity of the item for sale supported on the surface.

10 . The system of claim 9 , wherein the control circuit is further configured to determine the estimated run out time of the item; and prioritize transmission of the message based on a plurality of estimated run out time determined for the items for sale at the retail facility.

11 . A method for assessing items for sale at a retail facility, the method comprising:

receiving, by a control circuit coupled to a database storing data corresponding to an item for sale at a retail facility, a captured image of the item for sale, the captured image captured by an imaging device, the item for sale positioned on a surface at a location in the retail facility accessible by customers and where the customers can collect the items for purchase, wherein the captured image includes a bounding box indicating the item for sale;

receiving by the control circuit for the item in the captured image, an identification of the item for sale associated with each bounding box;

determining, using a reference object with fixed dimensions visible in the captured image, a pixel-to-dimension mapping ratio;

mapping, by the control circuit, item dimensions for the item for sale to pixels associated with each bounding box in the captured image using the pixel-to-dimension mapping ratio;

determining, by the control circuit and using at least a pixel count associated with each bounding box and corresponding surface dimensions of the surface, a volume estimate corresponding to the items the item for sale supported on the surface, wherein determining the volume estimate comprises:

determining an area of aggregated bounding boxes in the captured image based on the pixel-to-dimension mapping ratio of the item dimensions to the pixels;

determining an orientation of the surface based on the area of the aggregated bounding boxes; and

calculating the volume estimate based on the area of the aggregated bounding boxes, the orientation of the surface, and the corresponding surface dimensions of the surface; and

determining, by the control circuit and based on at least the volume estimate and the item dimensions, a quantity of the item for sale supported on the surface.

12 . The method of claim 11 , wherein the volume estimate comprises an estimate of a total volume of the items for sale supported on the surface.

13 . The method of claim 11 , further comprising:

determining, by the control circuit, the area of aggregated bounding boxes in the captured image based on the pixel-to-dimension mapping ratio of the item dimensions for each identified item for sale to the pixels associated with each bounding box; and

determining, by the control circuit, an orientation of the surface based on the area of the aggregated bounding boxes, wherein a determination of the volume estimate is based on the area of the aggregated bounding boxes, the orientation of the surface, and the corresponding surface dimensions of the surface.

14 . The method of claim 11 , wherein the imaging device comprises a motorized robotic image capture device.

15 . The method of claim 11 , wherein the surface comprises at least one of a pallet or a shelf.

16 . The method of claim 11 , wherein the item dimensions comprises a width, a height, and a length.

17 . The method of claim 11 , further comprising determining, by the control circuit, the item for sale comprising a stack of products having a number of layers, wherein the number of layers of the stack of products is based the area of aggregated bounding boxes in the captured image and the item dimensions of the item.

18 . The method of claim 11 , further comprising determining, by the control circuit, a fill value associated with the surface based at least on the quantity of the item for sale supported on the surface.

19 . The method of claim 11 , further comprising displaying, by a user interface operable on an electronic device associated with a worker at the retail facility, a message comprising at least one of an instruction to the worker to restock the surface and an estimated run out time of the item based on the determined quantity of the item for sale supported on the surface.

20 . The method of claim 19 , further comprising determining, by the control circuit, the estimated run out time of the item; and prioritizing transmission of the message based on a plurality of estimated run out time determined for the items for sale at the retail facility.