IP Library Granted Patent US 11,009,604
Granted Patent B1
US 11,009,604 · App. 16/779,477 · Granted May 18, 2021

Methods for detecting if a time of flight (ToF) sensor is looking into a container

Inventors: Justin F. Barish (Kings Park, NY); Adithya H. Krishnamurthy (Hicksville, NY)
Assignee: Zebra Technologies Corporation
G01S17/04G06Q10/08G06Q50/28H04N13/204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,009,604
App. No.
16/779,477
Granted
May 18, 2021
Kind
B1
Abstract

Methods for detecting if a Time of Flight (ToF) sensor is looking into a container are disclosed herein. An example method includes capturing a three-dimensional image. The three-dimensional image may comprise three-dimensional point data having a plurality of points. The example method may further include analyzing the plurality of points to determine a plurality of image components. Each image component may be representative of the plurality of points. The example method may further include comparing each image component of the plurality of image components to a threshold value. Each image component may correspond to a respective threshold value. The example method may further include determining that a number of image components N of the plurality of image components satisfy the respective threshold values, and determining the presence or absence of the container by comparing the number of image components N to an agreement threshold X.

Claims (68)

1. A method for detecting a presence or an absence of a container, comprising:

capturing a three-dimensional image, the three-dimensional image comprising three-dimensional point data having a plurality of points;

analyzing the plurality of points to determine a plurality of image components, each image component being representative of the plurality of points;

comparing each image component of the plurality of image components to a threshold value, wherein each image component corresponds to a respective threshold value;

determining that a number of image components N of the plurality of image components satisfy the respective threshold values; and

determining the presence or absence of the container by comparing the number of image components N to an agreement threshold X,

wherein analyzing the plurality of points to determine the plurality of image components further comprises performing planar segmentation on the plurality of points to determine a height of a ground plane, and

wherein comparing each image component of the plurality of image components to the threshold value further comprises comparing the height of the ground plane to a height threshold.

2. The method of claim 1 , wherein analyzing the plurality of points to determine the plurality of image components further comprises iterating over the plurality of points to determine a number of points that are external to a boundary of the container; and

wherein comparing each image component of the plurality of image components to the threshold value further comprises comparing the number of points that are external to the boundary of the container to an external boundary threshold.

3. The method of claim 2 , wherein determining that the number of image components N of the plurality of image components satisfy the respective threshold values further comprises determining that the number of points that are external to the boundary of the container is greater than or equal to the external boundary threshold.

4. The method of claim 1 , wherein determining that the number of image components N of the plurality of image components satisfy the respective threshold values further comprises determining that the height of the ground plane is substantially similar to the height threshold.

5. The method of claim 1 , wherein analyzing the plurality of points to determine the plurality of image components further comprises determining an amplitude for each point in the plurality of points to calculate an average amplitude of the plurality of points; and

wherein comparing each image component of the plurality of image components to the threshold value further comprises comparing the average amplitude to an amplitude threshold.

6. The method of claim 5 , wherein determining that the number of image components N of the plurality of image components satisfy the respective threshold values further comprises determining that the average amplitude is less than the amplitude threshold.

7. The method of claim 1 , wherein analyzing the plurality of points to determine the plurality of image components further comprises determining an ambient value for each point in the plurality of points to calculate an average ambient value of the plurality of points; and

wherein comparing each image component of the plurality of image components to the threshold value further comprises comparing the average ambient value to an ambient value threshold.

8. The method of claim 7 , wherein determining that the number of image components N of the plurality of image components satisfy the respective threshold values further comprises determining that the average ambient value is less than the ambient value threshold.

9. The method of claim 1 , further comprising:

determining either (i) that the number of image components Nis greater than or equal to the agreement threshold X or (ii) that the number of image components Nis less than the agreement threshold X;

in response to determining that the number of image components Nis greater than or equal to the agreement threshold X, determining the absence of the container; and

in response to determining that the number of image components Nis less than the agreement threshold X, determining the presence of the container.

10. The method of claim 1 , further comprising:

generating a load status signal including an indication of either (i) the presence of the container, or (ii) the absence of the container;

responsive to determining the presence of the container:

calculating a load status of the container, and

incorporating the load status of the container into the load status signal; and

transmitting the load status signal to an external device for display to a user in accordance with a timeline segmentation routine.

11. A system for determining a presence or an absence of a container, comprising:

a user interface; and

a trailer monitoring unit (TMU) mounted proximate a loading bay and communicatively connected with the user interface, the TMU including:

a housing; and

an imaging assembly at least partially within the housing and configured to capture a three-dimensional image, the three-dimensional image comprising three-dimensional point data having a plurality of points;

wherein the TMU is configured to:

analyze the plurality of points to determine a plurality of image components by performing planar segmentation on the plurality of points, each image component being representative of the plurality of points;

determine a height of a ground plane resulting from the planar segmentation;

compare each image component of the plurality of image components to a threshold value by comparing the height of the ground plane to a height threshold, wherein each image component corresponds to a respective threshold value;

determine that a number of image components N of the plurality of image components satisfy the respective threshold values; and

determine the presence or absence of the container by comparing the number of image components N to an agreement threshold X.

12. The system of claim 11 , wherein the TMU is further configured to:

analyze the plurality of points to determine the plurality of image components by iterating over the plurality of points to determine a number of points that are external to a boundary of the container; and

compare each image component of the plurality of image components to the threshold value by comparing the number of points that are external to the boundary of the container to an external boundary threshold.

13. The system of claim 12 , wherein the TMU is further configured to:

determine that the number of image components N of the plurality of image components satisfy the respective threshold values by determining that the number of points that are external to the boundary of the container is greater than or equal to the external boundary threshold.

14. The system of claim 11 , wherein the TMU is further configured to:

determining that the number of image components N of the plurality of image components satisfy the respective threshold values further comprises determining that the height of the ground plane is substantially similar to the height threshold.

15. The system of claim 11 , wherein the TMU is further configured to:

analyze the plurality of points to determine the plurality of image components by determining an amplitude for each point in the plurality of points;

calculate an average amplitude of the plurality of points; and

compare each image component of the plurality of image components to the respective threshold value by comparing the average amplitude to an amplitude threshold.

16. The system of claim 15 , wherein the TMU is further configured to:

determine that the number of image components N of the plurality of image components satisfy the respective threshold values by determining that the average amplitude is less than the amplitude threshold.

17. The system of claim 11 , wherein the TMU is further configured to:

analyze the plurality of points to determine the plurality of image components by determining an ambient value for each point in the plurality of points;

calculate an average ambient value of the plurality of points; and

compare each image component of the plurality of image components to the respective threshold value by comparing the average ambient value to an ambient value threshold.

18. The system of claim 17 , wherein the TMU is further configured to:

determine that the number of image components N of the plurality of image components satisfy the respective threshold values by determining that the average ambient value is less than the ambient value threshold.

19. The system of claim 11 , wherein the TMU is further configured to:

determine either (i) that the number of image components N is greater than or equal to the agreement threshold X or (ii) that the number of image components N is less than the agreement threshold X;

in response to determining that the number of image components Nis greater than or equal to the agreement threshold X, determine the absence of the container; and

in response to determining that the number of image components Nis less than the agreement threshold X, determine the presence of the container.

20. The system of claim 11 , wherein the TMU is further configured to:

generate a load status signal including an indication of either (i) the presence of the container, or (ii) the absence of the container;

responsive to determining the presence of the container:

calculate a load status of the container, and

incorporate the load status of the container into the load status signal; and

transmit the load status signal to an external device for display to a user in accordance with a timeline segmentation routine.

Assignments (4)
SECURITY INTEREST Recorded Apr 12, 2021
From: ZEBRA TECHNOLOGIES CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 056472/0063 →
RELEASE OF SECURITY INTEREST - 364 - DAY Recorded Mar 5, 2021
From: JPMORGAN CHASE BANK, N.A.
To: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
Reel/Frame 056036/0590 →
SECURITY INTEREST Recorded Sep 1, 2020
From: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 053841/0212 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 2, 2020
From: BARISH, JUSTIN F.; KRISHNAMURTHY, ADITHYA H.
To: ZEBRA TECHNOLOGIES CORPORATION
Reel/Frame 051981/0359 →