Refrigeration system with imaging
In examples, a refrigeration system includes one or more cameras that are positioned to capture images of items before the items are positioned inside the cabinet. The refrigeration system can include one or more moveable racks on which items can be placed. When the rack is moved out, items can be placed on the rack, and the set of cameras can image the rack to determine information about the items placed on the rack.
1 . A refrigeration system comprising:
a cabinet having an interior space;
a cooling sub-assembly to cool the interior space;
a door connected to a front side of the cabinet to seal the interior space when in a closed position, and to provide access to the interior space when in an opened position;
a rack sub-assembly mounted to an interior of the cabinet, the rack sub-assembly including a set of racks, each rack being moveable from a seated position that is fully contained within the interior space, to an extended position where at least a segment of the rack extends outside of the interior space to receive one or more items;
a camera array including one or more cameras, each of the one or more cameras being connected to a top segment of the cabinet and above a top edge of the door, wherein each of the one or more cameras is oriented such that a corresponding viewing angle of each of the one or more cameras includes a vertical space that is in front of the interior space, wherein the top edge of the door differs from the top segment of the cabinet and the top edge of the door is configured to move relative to a location of the top segment of the cabinet, and wherein the camera array includes at least one camera positioned outside of the interior space of the cabinet and oriented vertically down such that a field of view of the at least one camera is directed at a surface on which the refrigeration system is placed, and wherein the vertical space of the corresponding viewing angle includes a portion that overlaps with at least a portion of a space occupied by a thickness of the door in a closed position.
2 . The refrigeration system of claim 1 , wherein:
the one or more cameras of the camera array are integrated into a structure of the cabinet;
at least one of the one or more cameras are connected to an underside of a top surface of the top segment; and
the underside of the top surface to which the at least one of the one or more cameras is connected is vertically aligned with the door in the closed position.
3 . The refrigeration system of claim 1 , wherein the one or more cameras are attached to the cabinet as a retrofit.
4 . The refrigeration system of claim 1 , wherein the camera array includes one or more wide angle lenses.
5 . The refrigeration system of claim 4 , wherein the camera array includes at least a first wide angle lens positioned in proximity to at least a first lateral side of the interior space, and a second wide angle lens positioned in proximity to at least a second lateral side of the interior space.
6 . The refrigeration system of claim 5 , wherein the camera array includes at least a third lens positioned in between the first wide angle lens and the second wide angle lens.
7 . The refrigeration system of claim 6 , wherein the set of racks includes a first rack that is positioned in proximity to a top side of the interior space, and a second rack positioned underneath the first rack; and
wherein the camera array is operable to capture recognizable images of objects placed on the first rack using either or both of the first wide angle lens and/or the second wide angle lens.
8 . The refrigeration system of claim 7 , wherein the camera array is operable to capture images of objects placed on the second rack using the third lens.
9 . The refrigeration system of claim 1 , wherein the camera array is triggerable by movement to capture and process images.
10 . The refrigeration system of claim 1 , wherein the camera array is stationary as the door is moved between an open state and a closed state.
11 . A method for operating a refrigeration system comprising a cabinet having an interior space and a door connected to a front side of the cabinet, the method comprising:
performing a first image scan of a first rack using a first set of cameras that are connected to a top segment of the cabinet and above a top edge of the door, the first image scan being performed when the first rack is outside of the interior space of the refrigeration system;
performing a second image scan of a second rack using a second set of cameras that are positioned at the top segment of the cabinet, the second image scan being performed when the second rack is outside of the interior space of the refrigeration system, wherein the top edge of the door differs from the top segment of the cabinet and the top edge of the door is configured to move relative to a location of the top segment of the cabinet, and wherein the first set of cameras includes at least one camera positioned outside of the interior space of the cabinet and oriented vertically down such that a field of view of the at least one camera is directed at a surface on which the refrigeration system is placed, and wherein a vertical space of the field of view includes a portion that overlaps with at least a portion of a space occupied by a thickness of the door in a closed position.
12 . The method of claim 11 , wherein the first set of cameras each have a first type of lens with a first viewing angle, and the second set of cameras each have a second type of lens with a second viewing angle, the second viewing angle being less than the first.
13 . The method of claim 12 , wherein the first set of cameras includes a first wide angle camera and a second wide angle camera, and the method further comprising stitching a first image captured by the first wide angle camera with a second image captured by the second wide angle camera.
14 . The method of claim 13 , wherein the second set of cameras includes a single camera that captures an image of a portion of the second rack.
15 . The method of claim 11 , wherein:
the first set of cameras and the second set of cameras are both integrated into a structure of the cabinet;
at least one of the first set of cameras or the second set of cameras is connected to an underside of a top surface of the top segment; and
the underside of the top surface to which the first set of cameras or the second set of cameras is connected is vertically aligned with the door in the closed position.
16 . The method of claim 11 , wherein at least one of the first set of cameras or the second set of cameras is attached to the cabinet as a retrofit.