IP Library Granted Patent US 11,417,020
Granted Patent B2
US 11,417,020 · App. 16/842,160 · Granted Aug 16, 2022

Detection of calibration errors

Inventors: Serguei Zolotov (Ottawa, CA); Lawrence Allen Stone (Austin, TX)
Assignee: Zebra Technologies Corporation
G06T7/85G06T7/593G06T7/97G06T2207/10012G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,417,020
App. No.
16/842,160
Granted
Aug 16, 2022
Kind
B2
Abstract

A method includes: obtaining a stereo pair of images from a stereo camera assembly of a mobile computing device, the stereo pair of images depicting a first marker and a second marker each associated with the mobile computing device; determining, from the stereo pair of images, a distance between the first and second markers; comparing a threshold to a difference between the determined distance and a reference distance corresponding to the first and second reference markers; and when the difference exceeds the threshold, generating an alert notification.

Claims (80)

1. A method, comprising:

obtaining a stereo pair of images from a stereo camera assembly of a mobile computing device, the stereo pair of images depicting a first marker and a second marker each associated with the mobile computing device;

determining, from the stereo pair of images, a distance between the first and second markers;

determining an active application executing at the mobile computing device;

selecting a threshold from a plurality of application-specific thresholds according to the active application;

comparing the threshold to a difference between the determined distance and a reference distance between the first and second markers; and

when the difference exceeds the threshold, generating an alert notification.

2. The method of claim 1 , wherein determining the distance includes:

detecting positions of the first and second markers in the pair of stereo images;

determining three-dimensional positions of the first and second markers based on the detected positions; and

determining a distance between the three-dimensional positions.

3. The method of claim 1 , further comprising:

detecting a plurality of markers from the stereo pair of images; and

selecting the first and second markers from the plurality.

4. The method of claim 3 , further comprising:

determining respective distances between each pair of the plurality of markers; and

selecting, as the first and second markers, a pair of the plurality of markers separated by a greatest one of the respective distances.

5. The method of claim 1 , further comprising:

detecting a device centerline from the stereo pair of images;

detecting a plurality of markers, including the first and second markers, in the stereo pair of images;

determining whether the stereo pair of images are mirrored based on the centerline and the plurality of markers; and

when the stereo pair of images are mirrored, mirroring an expected marker layout prior to determining the distance between the first and second markers based on the mirrored expected marker layout.

6. The method of claim 1 , wherein the first and second markers are carried on the mobile computing device, and wherein obtaining the pair of stereo images comprises capturing the pair of stereo images via a reflective surface.

7. The method of claim 1 , wherein the first and second markers are carried on a second mobile computing device, identical to the mobile computing device.

8. The method of claim 1 , further comprising:

when the difference does not exceed the threshold, capturing a further pair of stereo images;

detecting an object in the further pair of stereo images; and

dimensioning the object based on the further pair of stereo images.

9. The method of claim 1 , wherein generating the alert notification includes at least one of:

controlling an output device of the mobile computing device to present the alert notification; and

sending a message to a server via a communications interface of the mobile computing device.

10. A computing device, comprising:

a stereo camera assembly; and

a controller connected with the stereo camera assembly, the controller configured to:

obtain a stereo pair of images from the stereo camera assembly, the stereo pair of images depicting a first marker and a second marker each associated with the computing device;

determine, from the stereo pair of images, a distance between the first and second markers;

determine an active application executing at the mobile computing device;

select a threshold from a plurality of application-specific thresholds according to the active application;

compare the threshold to a difference between the determined distance and a reference distance between the first and second markers; and

when the difference exceeds the threshold, generate an alert notification.

11. The computing device of claim 10 , wherein the controller is configured, in order to determine the distance, to:

detect positions of the first and second markers in the pair of stereo images;

determine three-dimensional positions of the first and second markers based on the detected positions; and

determine a distance between the three-dimensional positions.

12. The computing device of claim 9 , wherein the controller is further configured to:

detect a plurality of markers from the stereo pair of images; and

select the first and second markers from the plurality.

13. The computing device of claim 12 , wherein the controller is further configured to:

determine respective distances between each pair of the plurality of markers; and

select, as the first and second markers, a pair of the plurality of markers separated by a greatest one of the respective distances.

14. The computing device of claim 10 , wherein the plurality of markers are disposed asymmetrically relative to a device centerline; and wherein the processor is further configured to:

detect a device centerline from the stereo pair of images;

detect a plurality of markers, including the first and second markers, in the stereo pair of images;

determine whether the stereo pair of images are mirrored based on the centerline and the plurality of markers; and

when the stereo pair of images are mirrored, mirror an expected marker layout prior to determination of the distance between the first and second markers based on the mirrored expected marker layout.

15. The computing device of claim 10 , wherein the first and second markers are carried on the computing device, and wherein obtaining the pair of stereo images comprises capturing the pair of stereo images via a reflective surface.

16. The computing device of claim 10 , wherein the first and second markers are carried on a second computing device, identical to the mobile computing device.

17. The computing device of claim 10 , wherein the controller is further configured to:

when the difference does not exceed the threshold, capture a further pair of stereo images;

detect an object in the further pair of stereo images; and

dimension the object based on the further pair of stereo images.

18. The computing device of claim 10 , wherein the processor is further configured, in order to generate the alert notification, to at least one of:

control an output device of the computing device to present the alert notification; and

send a message to a server via a communications interface of the computing device.

19. A method, comprising:

obtaining a stereo pair of images from a stereo camera assembly of a mobile computing device, the stereo pair of images depicting a first marker and a second marker each associated with the mobile computing device;

determining, from the stereo pair of images, a distance between the first and second markers;

comparing a threshold to a difference between the determined distance and a reference distance between the first and second markers;

when the difference exceeds the threshold, generating an alert notification;

detecting a device centerline from the stereo pair of images;

detecting a plurality of markers, including the first and second markers, in the stereo pair of images;

determining whether the stereo pair of images are mirrored based on the centerline and the plurality of markers; and

when the stereo pair of images are mirrored, mirroring an expected marker layout prior to determining the distance between the first and second markers based on the mirrored expected marker layout.

20. The method of claim 19 , wherein determining the distance includes:

detecting positions of the first and second markers in the pair of stereo images;

determining three-dimensional positions of the first and second markers based on the detected positions; and

determining a distance between the three-dimensional positions.

21. The method of claim 19 , further comprising, prior to comparing:

determining an active application executing at the mobile computing device; and

selecting the threshold from a plurality of application-specific thresholds according to the active application.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2022
From: ZOLOTOV, SERGUEI; STONE, LAWRENCE ALLEN
To: ZEBRA TECHNOLOGIES CORPORATION
Reel/Frame 060474/0447 →
SECURITY INTEREST Recorded Apr 12, 2021
From: ZEBRA TECHNOLOGIES CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 056472/0063 →
RELEASE OF SECURITY INTEREST - 364 - DAY Recorded Mar 5, 2021
From: JPMORGAN CHASE BANK, N.A.
To: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
Reel/Frame 056036/0590 →
SECURITY INTEREST Recorded Sep 1, 2020
From: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 053841/0212 →
Continuity (1)
Related Publication 20210312663A1 · Oct 7, 2021