REFRIGERATION SYSTEM WITH IMAGING
In examples, a refrigeration system includes one or more cameras that are positioned to capture images of items before the items are positioned inside the cabinet. The refrigeration system can include one or more moveable racks on which items can be placed. When the rack is moved out, items can be placed on the rack, and the set of cameras can image the rack to determine information about the items placed on the rack.
1 . A method for operating a refrigeration system, the method comprising:
detecting a given rack of multiple racks of the refrigeration system being moved from an extended position to a seated position within an interior of the refrigeration system; and
capturing one or more images of the rack, and initiating performance of image analysis of the one or more images to determine information about one or more items that are placed on the rack.
2 . The method of claim 16 , wherein initiating performance of the image analysis includes determining, for each of the one or more items, information that identifies a type of the item.
3 . The method of claim 2 , wherein determining the type of the item includes determining the item is a bottle or a can.
4 . The method of claim 1 , wherein initiating performance of the image analysis includes determining a position of each of one or more items with respect to the rack.
5 . The method of claim 1 , wherein initiating performance of the image analysis includes detecting a label of each of the one or more items, and performing image recognition on the label to determine information about a content of the bottle.
6 . The method of claim 5 , wherein the determined information about the content of item includes at least one of a vintage, manufacturer, or type of the content.
7 . The method of claim 6 , wherein the item is a wine bottle.
8 . The method of claim 1 , further comprising performing the image analysis on the refrigeration system.
9 . The method of claim 1 , further comprising:
selecting one of multiple sets of cameras of a camera array to capture the one or more images based on a vertical distance or position of the moving rack with respect to the camera array.
10 . The method of claim 9 , wherein selecting one of multiple sets of cameras includes selecting a first set of cameras that include one or more wide angle lenses in response to detecting that the vertical distance is less than a first threshold.
11 . The method of claim 9 , wherein the first set of cameras include at least a first wide angle lens positioned in proximity to at least a first lateral side of the interior space, and a second wide angle lens positioned in proximity to at least a second lateral side of the interior space.
12 . The method of claim 11 , wherein initiating performance of the image analysis includes stitching an image captured using the first wide angle lens with an image captured using the second wide angle lens.
13 . The method of claim 1 , further comprising transmitting information about the item to another device.
14 . The method of claim 13 , wherein transmitting information about the item includes transmitting the information to a network service, using one or more networks.
15 . The method of claim 13 , wherein transmitting information about the item includes transmitting the information to a mobile device of a user, using a local wireless connection.
16 . The method of claim 1 , wherein initiating performance of the image analysis includes determining a type of the item, a position of the item with respect to the rack, and information about a content of the item.
17 . The method of claim 1 , wherein determining the type of information includes estimating an amount of the content relative or a volume of the item.
18 . A refrigeration system comprising:
a cabinet having an interior space;
a cooling sub-assembly to cool the interior space;
a door connected to a front side of the refrigeration cabinet to seal the interior space when in a closed position, and to provide access to the interior space when in an opened position;
a rack sub-assembly mounted to an interior of the cabinet, the rack sub-assembly including a set of racks, each rack being moveable from a seated position that is fully contained within the interior space, to an extended position where at least a segment of the rack extends outside of the interior space to receive one or more items;
a camera array including one or more cameras, each of the one or more cameras being oriented such that a corresponding viewing angle includes a vertical space that is in front of the interior space; and
one or more processors, wherein the one or more processors execute instructions to perform operations that include:
detecting a rack of the rack sub-assembly in the extended position;
capturing one or more images of the rack; and
initiating performance of image analysis of the one or more images to determine information about one or more items that are placed on the rack.
19 . The refrigeration system of claim 18 , wherein the one or more processors execute instructions to perform the image analysis.
20 . A camera module for a refrigeration system, the camera module comprising:
a camera array including one or more cameras;
a housing;
wherein the housing is structured to secure to a refrigeration system, to position the camera array such that a corresponding viewing angle of one or more cameras of the camera array a vertical space that coincides with a thickness that occupies a door of the refrigeration system when the door is in a closed position; and
one or more processors, wherein the one or more processors execute instructions to perform operations that include:
capturing one or more images of a rack of the refrigeration system when the rack is extended from an interior cabinet; and
initiating performance of image analysis of the one or more images to determine information about one or more items that are placed on the rack.