IP Library Granted Patent US 11,210,549
Granted Patent B2
US 11,210,549 · App. 16/824,038 · Granted Dec 28, 2021

Automated chute fullness detection

Inventors: Bin Sun (Vernon Hills, IL); Yan Zhang (Buffalo Grove, IL); Kevin J. O'Connell (Palatine, IL); Yun Fu (Lincolnshire, MA)
Assignee: Zebra Technologies Corporation
G06K9/4661B65G11/20G06K9/3233G06N3/08G06T7/0002
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,210,549
App. No.
16/824,038
Granted
Dec 28, 2021
Kind
B2
Abstract

A method includes: storing (i) a reference image of a chute for receiving objects, and (ii) a region of interest mask corresponding to a location of the chute in a field of view of an image sensor; at a processor, controlling the image sensor to capture an image of the chute; applying an illumination adjustment to the image; selecting, at the processor, a portion of the image according to the region of interest mask; generating a detection image based on a comparison of the selected portion and the reference image; determining, based on the detection image, a fullness indicator for the chute; and providing the fullness indicator to notification system.

Claims (50)

1. A method, comprising:

storing (i) a reference image of a chute for receiving objects, and (ii) a region of interest mask corresponding to a location of the chute in a field of view of an image sensor;

at a processor, controlling the image sensor to capture an image of the chute;

applying an illumination adjustment to the image;

selecting, at the processor, a portion of the image according to the region of interest mask;

generating a detection image based on a comparison of the selected portion and the reference image;

determining, based on the detection image, a fullness indicator for the chute; and

providing the fullness indicator to a notification system,

wherein applying the illumination adjustment includes, for each pixel of the selected portion:

determining a difference between the pixel and a corresponding pixel of the reference image;

when the difference exceeds a threshold, determining whether a brightness of the pixel exceeds a brightness threshold; and

when the brightness does not exceed the brightness threshold, adjusting the brightness of the pixel.

2. The method of claim 1 , wherein generating the detection image includes, for each pixel defining the detection image: determining a difference between a first value of a corresponding pixel of the reference image and a second value of a corresponding pixel of the selected portion.

3. The method of claim 2 , wherein determining the fullness indicator includes converting the detection image to a binary image.

4. The method of claim 3 , wherein determining the fullness indicator includes determining a ratio of high-value pixels to low-value pixels in the binary image.

5. The method of claim 3 , wherein determining the fullness indicator includes determining whether the binary image contains any high-value pixels.

6. The method of claim 3 , further comprising:

prior to determining the fullness indicator, detecting regions of high-value pixels; and

discarding a subset of the regions that do not meet a size threshold.

7. The method of claim 1 , further comprising storing an ambient illumination mask;

wherein applying the illumination adjustment includes determining an ambient light level based on a region of the image corresponding to the ambient light mask; and

subtracting the ambient light level from the image.

8. The method of claim 1 , wherein adjusting the brightness includes increasing the brightness of the pixel.

9. A computing device, comprising:

a memory storing (i) a reference image of a chute for receiving objects, and (ii) a region of interest mask corresponding to a location of the chute in a field of view of an image sensor; and

a processor configured to:

control the image sensor to capture an image of the chute;

apply an illumination adjustment to the image;

select a portion of the image according to the region of interest mask;

generate a detection image based on a comparison of the selected portion and the reference image;

determine, based on the detection image, a fullness indicator for the chute; and

providing the fullness indicator to notification system,

wherein the processor is further configured, in order to apply the illumination adjustment, to:

for each pixel of the selected portion:

determine a difference between the pixel and a corresponding pixel of the reference image;

when the difference exceeds a threshold, determine whether a brightness of the pixel exceeds a brightness threshold; and

when the brightness does not exceed the brightness threshold, adjust the brightness of the pixel.

10. The computing device of claim 9 , wherein the processor is configured, in order to generate the detection image, to:

for each pixel defining the detection image:

determine a difference between a first value of a corresponding pixel of the reference image and a second value of a corresponding pixel of the selected portion.

11. The computing device of claim 10 , wherein the processor is configured, in order to determine the fullness indicator, to convert the detection image to a binary image.

12. The computing device of claim 11 , wherein the processor is configured, in order to determine the fullness indicator, to determine a ratio of high-value pixels to low-value pixels in the binary image.

13. The computing device of claim 11 , wherein the processor is configured, in order to determine the fullness indicator, to determine whether the binary image contains any high-value pixels.

14. The computing device of claim 11 , wherein the processor is further configured to:

prior to determining the fullness indicator, detect regions of high-value pixels; and

discard a subset of the regions that do not meet a size threshold.

15. The computing device of claim 9 , wherein the memory stores an ambient illumination mask; and wherein the processor is configured, in order to apply the illumination adjustment, to:

determine an ambient light level based on a region of the image corresponding to the ambient light mask; and

subtract the ambient light level from the image.

16. The computing device of claim 9 , wherein the processor is configured, in order to adjust the brightness, to increase the brightness of the pixel.

Assignments (4)
SECURITY INTEREST Recorded Apr 12, 2021
From: ZEBRA TECHNOLOGIES CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 056472/0063 →
RELEASE OF SECURITY INTEREST - 364 - DAY Recorded Mar 5, 2021
From: JPMORGAN CHASE BANK, N.A.
To: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
Reel/Frame 056036/0590 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2020
From: SUN, BIN; ZHANG, YAN; O'CONNELL, KEVIN J.; FU, YUN
To: ZEBRA TECHNOLOGIES CORPORATION
Reel/Frame 053669/0301 →
SECURITY INTEREST Recorded Sep 1, 2020
From: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 053841/0212 →
Continuity (1)
Related Publication 20210295087A1 · Sep 23, 2021