IP Library Granted Patent US 11,125,598
Granted Patent B1
US 11,125,598 · App. 16/856,993 · Granted Sep 21, 2021

Three-dimensional (3D) imaging systems and methods for determining vehicle storage areas and vehicle door statuses

Inventors: Justin F. Barish (Kings Park, NY); Adithya H. Krishnamurthy (Hicksville, NY)
Assignee: Zebra Technologies Corporation
G01F17/00G06Q50/28H04N13/128H04N13/239
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,125,598
App. No.
16/856,993
Granted
Sep 21, 2021
Kind
B1
Abstract

Three-dimensional (3D) imaging systems and methods are disclosed for determining vehicle storage areas and vehicle door statuses. A 3D-depth camera captures 3D image data of one or more vehicle storage areas. A 3D data analytics application (app) analyzes a first 3D image dataset of the 3D image data to determine a first depth measurement corresponding to a first vehicle storage area. The 3D data analytics app further analyzes a second 3D image dataset of the 3D image data to determine a second depth measurement. The 3D data analytics app detects a depth-change event based on the second depth measurement differing from the first depth measurement by more than a predefined depth-change threshold value. The 3D analytics app assigns, based on the depth-change event, an open door status to a new second vehicle storage area and a closed door status to the previous first vehicle storage area.

Claims (52)

1. A three-dimensional (3D) imaging system configured to determine vehicle storage areas and vehicle door statuses, the 3D imaging system comprising:

a 3D-depth camera configured to capture 3D image data, the 3D-depth camera oriented in a direction to capture 3D image data of one or more vehicle storage areas;

a 3D data analytics application (app) executing on one or more processors communicatively coupled to the 3D-depth camera, the 3D data analytics app configured to determine, based on analysis of a first 3D image dataset of the 3D image data, a first depth measurement corresponding to a first vehicle storage area; and

a memory communicatively coupled to the one or more processors, the memory configured to store the first depth measurement,

wherein the 3D data analytics app is further configured to implement a vehicle storage area imaging algorithm comprising:

(i) analyzing a second 3D image dataset of the 3D image data,

(ii) determining, based on analysis of the second 3D image dataset, a second depth measurement,

(iii) detecting a depth-change event based on the second depth measurement differing from the first depth measurement by more than a predefined depth-change threshold value, the depth-change event indicating a presence of a second vehicle storage area, and

(iv) assigning, based on the depth-change event, an open door status to the second vehicle storage area and a closed door status to the first vehicle storage area,

wherein the second 3D image dataset comprises a series of 3D image frames as captured by the 3D-depth camera, and

wherein the vehicle storage area imaging algorithm is at least one of (i) an inbound loading algorithm comprising detecting, across a number of the 3D image frames, that the second depth measurement is less than the first depth measurement by more than the predefined depth-change threshold value, or (ii) an outbound loading algorithm comprising detecting, across the number of the 3D image frames, that the second depth measurement is greater than the first depth measurement by more than the predefined depth-change threshold value.

2. The 3D imaging system of claim 1 , wherein the number of the 3D image frames is a configurable value.

3. The 3D imaging system of claim 1 , wherein the number of the 3D image frames is a configurable value.

4. The 3D imaging system of claim 1 further comprising a memory configured to store a configurable state parameter defining a loading state of the first vehicle storage area or the second vehicle storage area.

5. The 3D imaging system of claim 4 , wherein the configurable state parameter indicates that a vehicle corresponding to the first vehicle storage area is inbound and the loading state of the first vehicle storage area is full or partially full.

6. The 3D imaging system of claim 4 , wherein the configurable state parameter indicates that a vehicle corresponding to the first vehicle storage area is outbound and the loading state of the first vehicle storage area is empty or partially empty.

7. The 3D imaging system of claim 1 , wherein the 3D data analytics app is further configured to determine, based on analysis of a third 3D image dataset of the 3D image data, a third depth measurement corresponding to an outside area,

wherein upon detection of the third depth measurement corresponding to the outside area, the 3D data analytics app is configured to reassign a door status of the second vehicle storage area to a closed door status.

8. The 3D imaging system of claim 1 , wherein based upon occurrence of the depth-change event, and wherein the 3D-depth camera did not capture an image of a rolling door of at least one of the first vehicle storage area or the second vehicle storage area, assign a side-operating door type to at least one of the first vehicle storage area or the second vehicle storage area.

9. The 3D imaging system of claim 1 , wherein the second 3D image dataset comprises a series of 3D image frames as captured by the 3D-depth camera, and

wherein the 3D data analytics app is configured to:

determine a change frame selected from the series of 3D image frames, the change frame occurring before the depth-change event, and

assign a timestamp to at least one of the open door status of the second vehicle storage area or the closed door status of the first vehicle storage area, the timestamp corresponding to a time of capture, by the 3D-depth camera, of the change frame.

10. The 3D imaging system of claim 9 , further comprising a dashboard app, the dashboard app executing on a client device, and wherein the dashboard app indicates, on a display of the client device, at least one of the open door status of the second vehicle storage area, the closed door status of the first vehicle storage area, or the timestamp.

11. The 3D imaging system of claim 1 , wherein the 3D-depth camera and the one or more processors are housed in a mountable device.

12. The 3D imaging system of claim 1 , wherein the one or more processors are remote to the 3D-depth camera, the one or more processors comprising a server commutatively coupled to the 3D-depth camera through a computer network.

13. A three-dimensional (3D) imaging method for determining vehicle storage areas and vehicle door statuses, the 3D imaging method comprising:

capturing 3D image data with a 3D-depth camera oriented in a direction of one or more vehicle storage areas;

analyzing, by a 3D data analytics application (app) executing on one or more processors communicatively coupled to the 3D-depth camera, a first 3D image dataset of the 3D image data;

determining, by the 3D data analytics app based on the first 3D image dataset, a first depth measurement corresponding to a first vehicle storage area;

storing, in a memory communicatively coupled to the one or more processors, the first depth measurement;

analyzing a second 3D image dataset of the 3D image data;

determining, based on analysis of the second 3D image dataset, a second depth measurement;

detecting a depth-change event based on the second depth measurement differing from the first depth measurement by more than a predefined depth-change threshold value, the depth-change event indicating a presence of a second vehicle storage area; and

assigning, based on the depth-change event, an open door status to the second vehicle storage area and a closed door status to the first vehicle storage area,

wherein the second 3D image dataset comprises a series of 3D image frames as captured by the 3D-depth camera, and

wherein the imaging method further comprises at least one of (i) detecting, across a number of the 3D image frames and as part of an inbound loading algorithm implemented by the 3D data analytics app, that the second depth measurement is less than the first depth measurement by more than the predefined depth-change threshold value, or (ii) detecting, across the number of the 3D image frames and as part of an outbound loading algorithm, that the second depth measurement is greater than the first depth measurement by more than the predefined depth-change threshold value.

14. The 3D imaging method of claim 13 , wherein the number of the 3D image frames is a configurable value.

15. The 3D imaging method of claim 13 , wherein the number of the 3D image frames is a configurable value.

16. A three-dimensional (3D) imaging system configured to determine vehicle storage areas and vehicle door statuses, the 3D imaging system comprising:

a 3D-depth camera configured to capture 3D image data, the 3D-depth camera oriented in a direction to capture 3D image data of one or more vehicle storage areas;

a 3D data analytics application (app) executing on one or more processors communicatively coupled to the 3D-depth camera, the 3D data analytics app configured to determine, based on analysis of a first 3D image dataset of the 3D image data, a first depth measurement corresponding to a first vehicle storage area; and

a memory communicatively coupled to the one or more processors, the memory configured to store the first depth measurement, and the memory further configured to store a configurable state parameter corresponding to a loading state of the first vehicle storage area,

wherein the 3D data analytics app is further configured to implement an vehicle storage area imaging algorithm based on the configurable state parameter,

wherein the vehicle storage area imaging algorithm comprises:

(i) analyzing a second 3D image dataset of the 3D image data,

(ii) determining, based on analysis of the second 3D image dataset, a second depth measurement,

(iii) detecting a depth-change event based on the second depth measurement differing from the first depth measurement by more than a predefined depth-change threshold value, the depth-change event indicating a presence of a second vehicle storage area, and

(a) wherein when the configurable state parameter indicates that the first vehicle storage area is inbound, and the vehicle storage area imaging algorithm, based on the configurable state parameter, further comprises detecting, across a number of 3D image frames of the second 3D image dataset, that the second depth measurement is less than the first depth measurement by more than the predefined depth-change threshold value, or

(b) wherein when the configurable state parameter indicates that the first vehicle storage area is outbound, and the vehicle storage area imaging algorithm, based on the configurable state parameter, further comprises detecting, across a number of 3D image frames of the second 3D image dataset, that the second depth measurement is greater than the first depth measurement by more than the predefined depth-change threshold value,

and

(iv) assigning, based on the depth-change event, an open door status to the second vehicle storage area and a closed door status to the first vehicle storage area.

Assignments (4)
SECURITY INTEREST Recorded Apr 12, 2021
From: ZEBRA TECHNOLOGIES CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 056472/0063 →
RELEASE OF SECURITY INTEREST - 364 - DAY Recorded Mar 5, 2021
From: JPMORGAN CHASE BANK, N.A.
To: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
Reel/Frame 056036/0590 →
SECURITY INTEREST Recorded Sep 1, 2020
From: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 053841/0212 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 17, 2020
From: BARISH, JUSTIN F.; KRISHNAMURTHY, ADITHYA H.
To: ZEBRA TECHNOLOGIES CORPORATION
Reel/Frame 053242/0844 →