IP Library Granted Patent US 11,443,449
Granted Patent B2
US 11,443,449 · App. 16/801,792 · Granted Sep 13, 2022

Three-dimensional (3D) imaging systems and methods for virtual grading of package walls in commercial trailer loading

Inventors: Adithya H. Krishnamurthy (Hicksville, NY); Justin F. Barish (Kings Park, NY); Miroslav Trajkovic (Setauket, NY)
Assignee: Zebra Technologies Corporation
G06T7/593G06T7/62G06T7/73G06T2207/10028G06T2207/30108
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,443,449
App. No.
16/801,792
Granted
Sep 13, 2022
Kind
B2
Abstract

Three-dimensional (3D) imaging systems and methods are described for implementing virtual grading of package walls in commercial trailer loading. The 3D imaging systems and methods comprise capturing, by a 3D-depth camera, 3D image data of a vehicle storage area. A package wall is determined, based on the set of 3D image data and by a 3D data analytics application (app) executing on one or more processors communicatively coupled to the 3D-depth camera, a package wall within the vehicle storage area. A wall grade is assigned to the package wall, where the package wall is defined within the set of 3D image data by a plurality of packages each having a similar depth dimension, and wherein the package wall has a wall height.

Claims (46)

1. A three-dimensional (3D) imaging system configured to implement virtual grading of package walls in commercial trailer loading, the 3D imaging system comprising:

a 3D-depth camera configured to capture 3D image data, the 3D-depth camera oriented in a direction to capture a set of 3D image data of a vehicle storage area,

a 3D data analytics application (app) executing on one or more processors communicatively coupled to the 3D-depth camera, the 3D data analytics app configured to:

determine, based on the set of 3D image data, a package wall within the vehicle storage area, and

assign a wall grade to the package wall, wherein the package wall is defined within the set of 3D image data by a plurality of packages each having a similar depth dimension, and wherein the package wall has a wall height,

wherein the 3D data analytics app determines the wall grade by comparing the similar depth dimension to a wall depth threshold value and by comparing the wall height to a wall height threshold value.

2. The 3D imaging system of claim 1 , wherein the 3D data analytics app determines image wall portions within the set of 3D image data of the package wall,

wherein the 3D data analytics app determines a package density value for each image wall portion of the package wall, and

wherein the 3D data analytics app determines the wall grade based on each package density value of each image wall portion.

3. The 3D imaging system of claim 1 , wherein the package wall comprises a first image wall portion and a second image wall portion, the first wall portion having a greater package density value than the second wall portion,

wherein the 3D data analytics app determines a first packing location of the first image wall portion and a second packing location of the second image wall portion, and

wherein the wall grade is increased based on relative packing locations of the first image wall portion and the second image wall portion, the first packing location of the first image wall portion being below or approximately below the second packing location of the second image wall portion.

4. The 3D imaging system of claim 1 , wherein the 3D-depth camera is further configured to capture a second set of 3D image data of the vehicle storage area,

wherein the 3D data analytics app is further configured to:

determine, based on the second set of 3D image data, a second package wall within the vehicle storage area, and

assign a second wall grade to the second package wall, wherein the second package wall is defined within the second set of 3D image data by a second plurality of packages each having a second similar depth dimension, and wherein the second package wall has a second wall height,

determine an overall wall grade of the vehicle storage area based on at least the wall grade and the second wall grade.

5. The 3D imaging system of claim 4 , wherein the at least the second similar depth dimension is different from the similar depth dimension, or

wherein the second wall height is different from the wall height.

6. The 3D imaging system of claim 1 , further comprising a dashboard app, the dashboard app configured to execute on a client device, and wherein the dashboard app is configured to receive the wall grade of the package wall and render the wall grade on a display of the client device.

7. The 3D imaging system of claim 6 , wherein the dashboard app is further configured to display a graphical representation of the package wall, the similar depth dimension, and the wall height of the package wall on the display of the client device.

8. The 3D imaging system of claim 6 further comprising a server, the server communicatively coupled to the one or more processors, wherein the server receives the wall grade from the one or more processors, and wherein the server transmits the wall grade to the dashboard app.

9. The 3D imaging system of claim 1 , wherein the 3D-depth camera and the one or more processors are housed in a mountable device.

10. A three-dimensional (3D) imaging method for implementing virtual grading of package walls in commercial trailer loading, the 3D imaging method comprising:

capturing, by a 3D-depth camera, 3D image data of a vehicle storage area;

determining, based on the set of 3D image data and by a 3D data analytics application (app) executing on one or more processors communicatively coupled to the 3D-depth camera, a package wall within the vehicle storage area; and

assigning a wall grade to the package wall, wherein the package wall is defined within the set of 3D image data by a plurality of packages each having a similar depth dimension, and wherein the package wall has a wall height,

wherein the 3D data analytics app determines the wall grade by comparing the similar depth dimension to a wall depth threshold value and by comparing the wall height to a wall height threshold value.

11. The 3D imaging method of claim 10 , wherein the 3D data analytics app determines image wall portions within the set of 3D image data of the package wall,

wherein the 3D data analytics app determines a package density value for each image wall portion of the package wall, and

wherein the 3D data analytics app determines the wall grade based on each package density value of each image wall portion.

12. The 3D imaging method of claim 10 , wherein the package wall comprises a first image wall portion and a second image wall portion, the first wall portion having a greater package density value than the second wall portion,

wherein the 3D data analytics app determines a first packing location of the first image wall portion and a second packing location of the second image wall portion, and

wherein the wall grade is increased based on relative packing locations of the first image wall portion and the second image wall portion, the first packing location of the first image wall portion being below or approximately below the second packing location of the second image wall portion.

13. The 3D imaging method of claim 10 , further comprising:

capturing, by the 3D-depth camera, a second set of 3D image data of the vehicle storage area;

determining, by the 3D data analytics app based on the second set of 3D image data, a second package wall within the vehicle storage area;

assigning, by the 3D data analytics app, a second wall grade to the second package wall, wherein the second package wall is defined within the second set of 3D image data by a second plurality of packages each having a second similar depth dimension, and wherein the second package wall has a second wall height; and

determining, by the 3D data analytics app, an overall wall grade of the vehicle storage area based on at least the wall grade and the second wall grade.

14. The 3D imaging method of claim 13 , wherein the at least the second similar depth dimension is different from the similar depth dimension, or

wherein the second wall height is different from the wall height.

15. The 3D imaging method of claim 10 , further comprising:

transmitting, to a dashboard app executing on a client device, the wall grade of the package wall, wherein the dashboard app renders the wall grade on a display of the client device.

16. The 3D imaging method of claim 15 , wherein the dashboard app is further configured to display a graphical representation of the package wall, the similar depth dimension, and the wall height of the package wall on the display of the client device.

17. The 3D imaging method of claim 15 further comprising:

receiving, at a server communicatively coupled to the one or more processors, the wall grade from the one or more processors, and wherein the server transmits the wall grade to the dashboard app.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 17, 2021
From: KRISHNAMURTHY, ADITHYA H.; BARISH, JUSTIN F.; TRAJKOVIC, MIROSLAV
To: ZEBRA TECHNOLOGIES CORPORATION
Reel/Frame 058174/0896 →
SECURITY INTEREST Recorded Apr 12, 2021
From: ZEBRA TECHNOLOGIES CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 056472/0063 →
RELEASE OF SECURITY INTEREST - 364 - DAY Recorded Mar 5, 2021
From: JPMORGAN CHASE BANK, N.A.
To: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
Reel/Frame 056036/0590 →
SECURITY INTEREST Recorded Sep 1, 2020
From: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 053841/0212 →