IP Library Granted Patent US 10,731,970
Granted Patent B2
US 10,731,970 · App. 16/219,679 · Granted Aug 4, 2020

Method, system and apparatus for support structure detection

Inventors: Feng Cao (Burlington, CA); Harsoveet Singh (Mississauga, CA)
Assignee: Zebra Technologies Corporation
G01B11/22G01B11/254G01S17/89G06K9/3233G06T7/521
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,731,970
App. No.
16/219,679
Granted
Aug 4, 2020
Kind
B2
Abstract

A method of detecting a support structure in a navigational controller includes: controlling a depth sensor to capture a plurality of depth measurements corresponding to an area containing the support structure on a ground plane; generating, for each of the depth measurements, a projected depth measurement on the ground plane; selecting a boundary set of the projected depth measurements defining a boundary of the projection; selecting, based on angles between adjacent pairs of the boundary set of projected depth measurements, a subset of the projected depth measurements; generating a region of interest based on the subset of the projected depth measurements; retrieving a candidate subset of the depth measurements corresponding to the projected depth measurements in the region of interest; and generating a support structure plane definition based on the candidate subset of depth measurements.

Claims (54)

1. A method of detecting a support structure in a navigational controller, the method comprising:

controlling a depth sensor to capture a plurality of depth measurements corresponding to an area containing the support structure on a ground plane;

generating, for each of the depth measurements, a projected depth measurement on the ground plane;

selecting a boundary set of the projected depth measurements defining a boundary of the projection;

selecting, based on angles between adjacent pairs of the boundary set of projected depth measurements, a subset of the projected depth measurements;

generating a region of interest based on the subset of the projected depth measurements;

retrieving a candidate subset of the depth measurements corresponding to the projected depth measurements in the region of interest; and

generating a support structure plane definition based on the candidate subset of depth measurements.

2. The method of claim 1 , further comprising:

prior to generating the projection, selecting a primary subset of the depth measurements based on proximity to the mobile automation apparatus.

3. The method of claim 1 , wherein selecting the subset of the projected depth measurements includes:

determining an angle for each of a plurality of adjacent pairs of the projected depth measurements; and

when the angle deviates from a straight angle beyond a threshold, discarding the adjacent pairs of projected depth measurements.

4. The method of claim 1 , wherein generating the region of interest comprises fitting a line to the subset of the projected depth measurements.

5. The method of claim 1 , wherein generating the support structure plane includes:

executing first and second plane generation operations to generate first and second candidate plane definitions; and

generating the support structure plane based on the first and second candidate plane definitions.

6. The method of claim 5 , wherein generating the support structure plane based on the first and second candidate plane definitions comprises:

determining whether an attribute of each the first and second candidate plane definitions differs by an amount greater than a threshold; and

responsive to an affirmative determination, discarding at least one of the first and second candidate plane definitions.

7. The method of claim 5 , wherein generating the support structure plane based on the first and second candidate plane definitions comprises generating an average of the first and second candidate plane definitions.

8. The method of claim 5 , further comprising:

prior to generating the support structure plane, validating each of the first and second candidate plane definitions.

9. The method of claim 8 , wherein validating each of the first and second candidate plane definitions comprises determining whether each of the first and second candidate plane definitions is substantially vertical.

10. The method of claim 5 , wherein generating the second candidate plane definition comprises:

selecting a further subset of the depth measurements from the candidate subset; and

generating the second candidate plane definition based on the further subset.

11. A mobile automation apparatus, comprising:

a depth sensor; and

a navigational controller connected to the depth sensor, the navigational controller configured to:

control the depth sensor to capture a plurality of depth measurements corresponding to an area containing the support structure on a ground plane;

generate, for each of the depth measurements, a projected depth measurement on the ground plane;

select a boundary set of the projected depth measurements defining a boundary of the projection;

select, based on angles between adjacent pairs of the boundary set of projected depth measurements, a subset of the projected depth measurements;

generate a region of interest based on the subset of the projected depth measurements;

retrieve a candidate subset of the depth measurements corresponding to the projected depth measurements in the region of interest; and

generate a support structure plane definition based on the candidate subset of depth measurements.

12. The mobile automation apparatus of claim 11 , wherein the navigational controller is further configured, prior to generation of the projection, to select a primary subset of the depth measurements based on proximity to the mobile automation apparatus.

13. The mobile automation apparatus of claim 11 , wherein the navigational controller is configured, to select the subset of the projected depth measurements, to:

determine an angle for each of a plurality of adjacent pairs of the projected depth measurements; and

when the angle deviates from a straight angle beyond a threshold, discard the adjacent pairs of projected depth measurements.

14. The mobile automation apparatus of claim 11 , wherein the navigational controller is configured, to generate the region of interest, to fit a line to the subset of the projected depth measurements.

15. The mobile automation apparatus of claim 11 , wherein the navigational controller is configured, to generate the support structure plane, to:

execute first and second plane generation operations to generate first and second candidate plane definitions; and

generate the support structure plane based on the first and second candidate plane definitions.

16. The mobile automation apparatus of claim 15 , wherein the navigational controller is configured, to generate the support structure plane based on the first and second candidate plane definitions, to:

determine whether an attribute of each the first and second candidate plane definitions differs by an amount greater than a threshold; and

responsive to an affirmative determination, discard at least one of the first and second candidate plane definitions.

17. The mobile automation apparatus of claim 15 , wherein the navigational controller is configured, to generate the support structure plane based on the first and second candidate plane definitions, to generate an average of the first and second candidate plane definitions.

18. The mobile automation apparatus of claim 15 , wherein the navigational controller is further configured, prior to generation of the support structure plane, to validate each of the first and second candidate plane definitions.

19. The mobile automation apparatus of claim 18 , wherein the navigational controller is configured, to validate each of the first and second candidate plane definitions, to determine whether each of the first and second candidate plane definitions is substantially vertical.

20. The mobile automation apparatus of claim 15 , wherein the navigational controller is configured, to generate the second candidate plane definition, to:

select a further subset of the depth measurements from the candidate subset; and

generate the second candidate plane definition based on the further subset.

Assignments (6)
SECURITY INTEREST Recorded Apr 12, 2021
From: ZEBRA TECHNOLOGIES CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 056471/0906 →
RELEASE OF SECURITY INTEREST - 364 - DAY Recorded Mar 5, 2021
From: JPMORGAN CHASE BANK, N.A.
To: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
Reel/Frame 056036/0590 →
SECURITY INTEREST Recorded Sep 1, 2020
From: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 053841/0212 →
MERGER Recorded Jul 15, 2019
From: ZIH CORP.
To: ZEBRA TECHNOLOGIES CORPORATION
Reel/Frame 049751/0631 →
SECURITY INTEREST Recorded Jul 3, 2019
From: ZEBRA TECHNOLOGIES CORPORATION
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 049674/0916 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2019
From: CAO, FENG; SINGH, HARSOVEET
To: ZIH CORP.
Reel/Frame 049093/0308 →