IP Library Granted Patent US 10,716,177
Granted Patent B2
US 10,716,177 · App. 16/219,691 · Granted Jul 14, 2020

Method and apparatus for control of mobile automation apparatus light emitters

Inventors: Feng Cao (Burlington, CA); Harsoveet Singh (Mississauga, CA); Sadegh Tajeddin (Mississauga, CA)
Assignee: Zebra Technologies Corporation
H05B45/00G01B11/22G06T7/586H04N5/2256
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,716,177
App. No.
16/219,691
Granted
Jul 14, 2020
Kind
B2
Abstract

A method of controlling light emitters of a mobile automation apparatus includes: controlling a depth sensor to capture a plurality of depth measurements corresponding to an area containing a support structure; obtaining a support structure plane definition; selecting a subset of the depth measurements; determining, based on the subset of depth measurements and the support structure plane, whether the subset of the depth measurements indicates the presence of a sensitive receptor; when the determination is affirmative, disabling the light emitters; and when the determination is negative, controlling (i) the light emitters to illuminate the support structure and (ii) a camera to capture an image of the support structure simultaneously with the illumination.

Claims (50)

1. A method of controlling light emitters of a mobile automation apparatus, the method comprising:

controlling a depth sensor to capture a plurality of depth measurements corresponding to an area containing a support structure;

obtaining a support structure plane definition;

selecting a subset of the depth measurements;

determining, based on the subset of depth measurements and the support structure plane, whether the subset of the depth measurements indicates the presence of a sensitive receptor;

when the determination is affirmative, disabling the light emitters; and

when the determination is negative, controlling (i) the light emitters to illuminate the support structure and (ii) a camera to capture an image of the support structure simultaneously with the illumination.

2. The method of claim 1 , wherein selecting the subset comprises:

selecting a primary subset of the depth measurements within a predefined radius of the depth sensor.

3. The method of claim 2 , wherein selecting the subset further comprises:

selecting, from the primary subset, a secondary subset of the depth measurements within a predefined angle of an optical axis of the depth sensor.

4. The method of claim 1 , wherein determining whether the subset of depth measurements indicates the presence of a sensitive receptor comprises:

determining whether a density of the subset exceeds a density threshold.

5. The method of claim 4 , wherein determining whether the subset of depth measurements indicates the presence of a sensitive receptor further comprises:

when the density exceeds the density threshold, generating a variability metric for an attribute of the subset, and determining whether the variability metric exceeds a variability threshold.

6. The method of claim 5 , wherein the attribute is a distance between each depth measurement of the second subset and the support structure plane.

7. The method of claim 5 , wherein the variability metric is a standard deviation.

8. The method of claim 5 , wherein determining whether the subset of depth measurements indicates the presence of a sensitive receptor further comprises:

when the variability metric exceeds the variability threshold, detecting a cluster in the secondary subset of depth measurements; and

determining whether the cluster corresponds to a sensitive receptor.

9. The method of claim 8 , further comprising:

prior to detecting the cluster, discarding a portion of the secondary subset located at distances from the depth sensor greater than a distance between the depth sensor and the support structure plane.

10. The method of claim 8 , wherein determining whether the cluster corresponds to a sensitive receptor comprises comparing a geometric attribute of the cluster to a threshold.

11. A mobile automation apparatus, comprising:

a camera configured to capture images of a support structure;

a light emitter configured to illuminate the support structure simultaneously with image capture by the camera;

a depth sensor; and

a navigational controller configured to:

control the depth sensor to capture a plurality of depth measurements corresponding to an area containing a support structure;

obtain a support structure plane definition;

select a subset of the depth measurements;

determine, based on the subset of depth measurements and the support structure plane, whether the subset of the depth measurements indicates the presence of a sensitive receptor;

when the determination is affirmative, disable the light emitter; and

when the determination is negative, control (i) the light emitter to illuminate the support structure and (ii) the camera to capture an image of the support structure simultaneously with the illumination.

12. The mobile automation apparatus of claim 11 , wherein the navigational controller is configured, to select the subset, to:

select a primary subset of the depth measurements within a predefined radius of the depth sensor.

13. The mobile automation apparatus of claim 12 , wherein the navigational controller is further configured, to select the subset, to:

select, from the primary subset, a secondary subset of the depth measurements within a predefined angle of an optical axis of the depth sensor.

14. The mobile automation apparatus of claim 11 , wherein the navigational controller is configured, to determine whether the subset of depth measurements indicates the presence of a sensitive receptor, to:

determine whether a density of the subset exceeds a density threshold.

15. The mobile automation apparatus of claim 14 , wherein the navigational controller is configured, to determine whether the subset of depth measurements indicates the presence of a sensitive receptor, to:

when the density exceeds the density threshold, generate a variability metric for an attribute of the subset, and determine whether the variability metric exceeds a variability threshold.

16. The mobile automation apparatus of claim 15 , wherein the attribute is a distance between each depth measurement of the second subset and the support structure plane.

17. The mobile automation apparatus of claim 15 , wherein the variability metric is a standard deviation.

18. The mobile automation apparatus of claim 15 , wherein the navigational controller is configured, to determine whether the subset of depth measurements indicates the presence of a sensitive receptor, to:

when the variability metric exceeds the variability threshold, detect a cluster in the secondary subset of depth measurements; and

determine whether the cluster corresponds to a sensitive receptor.

19. The mobile automation apparatus of claim 18 , wherein the navigational controller is further configured to:

prior to detecting the cluster, discard a portion of the secondary subset located at distances from the depth sensor greater than a distance between the depth sensor and the support structure plane.

20. The mobile automation apparatus of claim 18 , wherein the navigational controller is configured, to determine whether the cluster corresponds to a sensitive receptor, to compare a geometric attribute of the cluster to a threshold.

Assignments (6)
SECURITY INTEREST Recorded Apr 12, 2021
From: ZEBRA TECHNOLOGIES CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 056471/0906 →
RELEASE OF SECURITY INTEREST - 364 - DAY Recorded Mar 5, 2021
From: JPMORGAN CHASE BANK, N.A.
To: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
Reel/Frame 056036/0590 →
SECURITY INTEREST Recorded Sep 1, 2020
From: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 053841/0212 →
SECURITY INTEREST Recorded Jul 3, 2019
From: ZEBRA TECHNOLOGIES CORPORATION
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 049674/0916 →
MERGER Recorded Mar 14, 2019
From: ZIH CORP.
To: ZEBRA TECHNOLOGIES CORPORATION
Reel/Frame 048600/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2019
From: CAO, FENG; SINGH, HARSOVEET; TAJEDDIN, SADEGH
To: ZIH CORP.
Reel/Frame 047919/0555 →