Object recognition for bottom of basket detection
A checkout lane management system is described that uses object recognition to detect whether one or more items is under a shopping cart during a customer checkout process. The checkout lane management system may comprise one or more of cameras for collecting a stream of images focused on a checkout lane. The checkout lane management system may also comprise one or more of a display device and a speaker device as part of a checkout lane device for displaying a BOB indicator or sounding the BOB indicator.
1. A method of object recognition for a cart in a checkout lane at a retail store location, the method comprising:
collecting a stream of images from a checkout lane;
evaluating the stream of images to identify a cart tracking module;
selecting a detection image when identifying the cart tracking module;
analyzing recognition data from the detection image to determine a lower tray status for the checkout lane, where the recognition data includes color data and coordinate data and analyzing recognition data includes calculating a set of delta color values between a plurality of pixels from sampling the recognition data and a plurality of pixels from baseline data,
transforming the set of delta color values to a delta checksum,
comparing the delta checksum against a delta threshold, and
setting the lower tray status when the delta checksum is equal to or greater than the delta threshold;
translating the lower tray status to a lower tray indicator; and
communicating the lower tray indicator to a checkout lane device.
2. The method of claim 1 further comprising:
displaying the lower tray indicator on a display device of the checkout lane device.
3. The method of claim 2 further comprising:
presenting a lower tray accounting input on the display device of the checkout lane device that requires a response prior to permitting any further checkout activity.
4. The method of claim 1 further comprising:
sounding the lower tray indicator on a speaker device of the checkout lane device.
5. An object recognition system for a cart in a checkout lane at a retail store location, the system comprising:
at least one camera that collects a stream of images from a checkout lane and captures a detection image when a cart tracking module is identified;
a computing device that receives the stream of images from the checkout lane, the computing device including
an evaluation component that evaluates the stream of images to identify a cart tracking module and selects the detection image,
a collection component that collects recognition data from the detection image, where the recognition data includes color data and coordinate data,
an analyzing component that analyzes the recognition data to determine a lower tray status for the checkout lane, where analysis of recognition data includes
calculation of set of delta color values between a plurality of pixels from sampling the recognition data and a plurality of pixels from baseline data,
transformation of the set of delta color values to a delta checksum,
comparison of the delta checksum against a delta threshold, and
setting the lower tray status when the delta checksum is equal to or greater than the delta threshold,
a translation component that translates the lower tray status to a lower tray indicator, and
a communication component that communicates the lower tray indicator to a checkout lane device.
6. The system of claim 5 , wherein the checkout lane device comprises a display device to display the lower tray indicator.
7. The system of claim 6 , wherein the checkout lane device displays a lower tray accounting input on the display device of the checkout lane device that requires a response prior to permitting any further checkout activity.
8. The system of claim 5 , wherein the checkout lane device comprises a speaker device to sound the lower tray indicator.
9. A computer program product for object recognition for a cart in a checkout lane at a retail store location, the computer program product stored on a non-transitory computer-readable medium and including instructions adapted to cause a computer to execute steps comprising:
collecting a stream of images from a checkout lane;
evaluating the stream of images to identify a cart tracking module; selecting a detection image when identifying the cart tracking module;
analyzing recognition data to determine a lower tray status for the checkout lane, where the recognition data includes color data and coordinate data and analyzing recognition data includes
calculating a set of delta color values between a plurality of pixels from sampling the recognition data and a plurality of pixels from baseline data,
transforming the set of delta color values to a delta checksum,
comparing the delta checksum against a delta threshold, and
setting the lower tray status when the delta checksum is equal to or greater than the delta threshold;
translating the lower tray status to a lower tray indicator; and
communicating the lower tray indicator to a checkout lane device.
10. The computer program product of claim 9 further comprising:
displaying the lower tray indicator on a display device of the checkout lane device.
11. The computer program product of claim 10 further comprising:
presenting a lower tray accounting input on the display device of the checkout lane device that requires a response prior to permitting any further checkout activity.