IP Library › Granted Patent US 10,657,666
Granted Patent B2
US 10,657,666 · App. 15/853,293 · Granted May 19, 2020

Systems and methods for determining commercial trailer fullness

Inventors: Miroslav Trajkovic (Setauket, NY); Justin F. Barish (Kings Park, NY); Adithya H. Krishnamurthy (Hicksville, NY)
Assignee: Symbol Technologies, LLC
G06T7/593G06F3/048G06K9/00832G06Q10/04G06Q10/08H04N13/128
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,657,666
App. No.
15/853,293
Granted
May 19, 2020
Kind
B2
Abstract

A three-dimensional (3D) depth imaging system is provided for use in commercial trailer loading applications. A 3D-depth camera may be configured and oriented to capture 3D image data of a vehicle storage area. A depth-detection application executing on one or more processors may determine, based on the 3D image data, at least a wall data region and a non-wall data region. Based on the determination of the wall data and the non-wall data region, the depth-detection application generates a wall indicator that indicates a wall is situated at a discrete depth within the vehicle storage area.

Claims (38)

1. A three-dimensional (3D) depth imaging system for use in commercial trailer loading, the 3D depth imaging system comprising:

a 3D-depth camera configured to capture 3D image data, the 3D-depth camera oriented in a direction to capture 3D image data of an interior of a vehicle storage area; and

a depth-detection application executing on one or more processors, the depth-detection application determining, based on the 3D image data, at least a wall data region and a non-wall data region,

wherein the determination of the wall data region and the non-wall data region causes the depth-detection application to generate a wall indicator, the wall indicator indicating that a wall is situated at a discrete depth within the interior of the vehicle storage area, and

wherein the determination of the wall data region and the non-wall data region comprises:

calculating a histogram of a depths of the 3D image data;

identifying a plurality of histogram peaks;

identifying a highest peak from the plurality of histogram peaks and filtering the plurality of histogram peaks having a height that falls outside of a threshold percentage of the highest peak; and

identifying a peak from the plurality of histogram peaks having a furthest distance from the 3D-depth camera and filtering the remaining plurality of histogram peaks located at a distance from the peak having the furthest distance from the 3D-depth camera.

2. The 3D depth imaging system of claim 1 , wherein the 3D-depth camera and the one or more processors are housed in a mountable device.

3. The 3D depth imaging system of claim 1 , wherein the wall may be any one of: a package wall or a wall of the vehicle storage area.

4. The 3D depth imaging system of claim 1 , wherein the non-wall data region is associated with any one of: a loader or a staging region of the vehicle storage area.

5. The 3D depth imaging system of claim 1 , wherein the non-wall data region is determined by comparing historical 3D image data to identify at least one peak region.

6. The 3D depth imaging system of claim 1 , wherein the depth-detection application is configured to disregard non-wall data regions when generating the wall indicator.

7. The 3D depth imaging system of claim 1 , further comprising a dashboard application, the dashboard application executing on a client device, and wherein the determination of the wall data region and the non-wall data region further causes the dashboard app to receive the wall indicator.

8. The 3D depth imaging system of claim 7 , wherein the dashboard application includes a vehicle storage area capacity value, the vehicle storage area capacity value indicating a filled capacity of the vehicle storage area.

9. The 3D depth imaging system of claim 7 , wherein the dashboard application includes a vehicle storage area capacity value, the vehicle storage area capacity value indicating a remaining capacity of the vehicle storage area.

10. The 3D depth imaging system of claim 1 , wherein the 3D image data is 3D point cloud data.

11. The 3D depth imaging system of claim 1 , wherein the 3D image data is captured periodically.

12. The 3D depth imaging system of claim 11 , wherein the 3D image data is captured at any of: approximately every 15 seconds, approximately every 30 seconds, approximately every minute, or approximately every two minutes.

13. A three-dimensional (3D) depth imaging method for use in commercial trailer loading, the 3D depth imaging method comprising:

capturing, via a 3D-depth camera, 3D image data of an interior of a vehicle storage area, the 3D-depth camera oriented in a direction to capture the 3D image data of the interior of the vehicle storage area;

analyzing, via one or more processors, the 3D image data with a depth-detection application, the depth-detection application determining, based on the 3D image data, at least a wall data region and a non-wall data region; and

generating, via the depth-detection application, a wall indicator, the wall indicator indicating that a wall situated at a discrete depth within the interior of the vehicle storage area is detected,

wherein analyzing the 3D image data comprises:

calculating a histogram of a depths of the 3D image data;

identifying a plurality of histogram peaks;

identifying a highest peak from the plurality of histogram peaks and filtering the plurality of histogram peaks having a height that falls outside of a threshold percentage of the highest peak; and

identifying a peak from the plurality of histogram peaks having a furthest distance from the 3D-depth camera and filtering the remaining plurality of histogram peaks located at a distance from the peak having the furthest distance from the 3D-depth camera.

14. The 3D depth imaging method of claim 13 , further comprising determining whether the peak having the furthest distance from the 3D-depth camera is the current wall.

15. The 3D depth imaging method of claim 13 , wherein analyzing the 3D image data further comprises identifying a highest remaining peak from the remaining plurality of histogram peaks and generating a wall indicator.

16. The 3D depth imaging method of claim 13 , further comprising calculating an average wall disposed between the wall indicator and a total depth of the vehicle storage area.

17. The 3D depth imaging method of claim 13 , wherein the non-wall data region is associated with any one of: a loader or a staging region of the vehicle storage area.

18. The 3D depth imaging method of claim 13 , wherein the non-wall data region is determined by comparing historical 3D image data to identify at least one peak region.

19. The 3D depth imaging method of claim 13 , wherein the depth-detection application is configured to disregard non-wall data regions when generating the wall indicator.

20. The 3D depth imaging method of claim 13 , further comprising receiving, via a dashboard application executing on a client device, the wall indicator.

21. The 3D depth imaging method of claim 20 , wherein the dashboard application includes a vehicle storage area capacity value, the vehicle storage area capacity value indicating a filled capacity of the vehicle storage area.

22. The 3D depth imaging method of claim 13 , wherein the 3D image data is captured at any of: approximately every 15 seconds, approximately every 30 seconds, approximately every minute, or approximately every two minutes.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2018
From: TRAJKOVIC, MIROSLAV; BARISH, JUSTIN F.; KRISHNAMURTHY, ADITHYA H.
To: SYMBOL TECHNOLOGIES, LLC
Reel/Frame 045105/0646 →
Continuity (1)
Related Publication 20190197716A1 · Jun 27, 2019