IP Library Granted Patent US 12,423,846
Granted Patent B2
US 12,423,846 · App. 16/861,781 · Granted Sep 23, 2025

Reference surface detection for mobile dimensioning

Inventors: Vipula Liyanaarachchi (Battaramulla, LK); Raveen T. Thrimawithana (Pannipitiya, LK); Michael Wijayantha Medagama (Nawala, LK)
Assignee: Zebra Technologies Corporation
G06T7/593G06T7/60G06T19/20H04N13/296G06T2207/10012G06T2219/012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,423,846
App. No.
16/861,781
Granted
Sep 23, 2025
Kind
B2
Abstract

A method includes: obtaining a reference stereo image from a stereo camera assembly of a mobile computing device; detecting a reference surface from the reference stereo image; determining an inclination angle of the reference surface relative to an output vector of an auxiliary sensor of the mobile computing device; obtaining a first dimensioning stereo image from the stereo camera assembly; detecting the reference surface in the first dimensioning stereo image based on the inclination angle; detecting a first object surface in the first dimensioning stereo image; and generating dimensions of the object based on the first object surface and the reference surface.

Claims (53)

1. A method, comprising:

obtaining a reference stereo image from a stereo camera assembly of a mobile computing device;

detecting a reference object support surface from the reference stereo image;

determining, based on the reference object support surface detected from the reference stereo image and an output gravity vector from a motion sensor of the mobile computing device, an inclination angle of the reference object support surface corresponding to an angle between the output gravity vector from the motion sensor of the mobile computing device and a normal vector to the reference object support surface;

obtaining a first dimensioning stereo image from the stereo camera assembly;

detecting the reference object support surface in the first dimensioning stereo image, using the inclination angle as a constraint;

detecting a first object surface in the first dimensioning stereo image; and

generating dimensions of the object based on the first object surface and the reference object support surface.

2. The method of claim 1 , further comprising:

obtaining a second dimensioning stereo image from the stereo camera assembly;

detecting the reference object support surface in the second dimensioning stereo image based on the inclination angle;

detecting a second object surface in the second dimensioning stereo image; and

generating further dimensions of the object based on the second object surface and the reference object support surface.

3. The method of claim 2 , comprising obtaining the reference stereo image prior to obtaining the first dimensioning stereo image.

4. The method of claim 2 , comprising obtaining the reference stereo image after obtaining the second dimensioning stereo image.

5. The method of claim 2 , wherein the dimensions include a height and a width, and wherein the further dimensions include a depth.

6. The method of claim 1 , wherein using the inclination angle as a constraint includes providing the inclination angle as an input to a plane fitting operation.

7. The method of claim 1 , further comprising: rendering the dimensions on a display of the mobile computing device.

8. The method of claim 1 , wherein the reference object support surface includes at least one of a floor, a ramp, or a shelf.

9. A computing device, comprising:

a stereo camera assembly;

a motion sensor; and

a controller connected with the stereo camera assembly and the motion sensor, the controller configured to:

control the stereo camera assembly to capture a reference stereo image;

detect a reference object support surface from the reference stereo image;

determine, based on the reference object support surface detected from the reference stereo image and an output gravity vector from the motion sensor, an inclination angle of the reference object support surface corresponding to an angle between the output gravity vector from the motion sensor and a normal vector to the reference object support surface;

control the stereo camera assembly to capture a first dimensioning stereo image;

detect the reference object support surface in the first dimensioning stereo image, using the inclination angle as a constraint;

detect a first object surface in the first dimensioning stereo image; and

generate dimensions of the object based on the first object surface and the reference object support surface.

10. The computing device of claim 9 , wherein the controller is further configured to:

control the stereo camera assembly to capture a second dimensioning stereo image from the stereo camera assembly;

detect the reference object support surface in the second dimensioning stereo image based on the inclination angle;

detect a second object surface in the second dimensioning stereo image; and

generate further dimensions of the object based on the second object surface and the reference object support surface.

11. The computing device of claim 10 , wherein the controller is further configured to capture the reference stereo image prior to capturing the first dimensioning stereo image.

12. The computing device of claim 10 , wherein the controller is further configured to capture the reference stereo image after capture of the second dimensioning stereo image.

13. The computing device of claim 10 , wherein the dimensions include a height and a width, and wherein the further dimensions include a depth.

14. The computing device of claim 9 , wherein the controller is configured, in order to use the inclination angle as a constraint, to provide the inclination angle as an input to a plane fitting operation.

15. The computing device of claim 9 , further comprising a display, wherein the controller is further configured to render the dimensions on the display.

16. The computing device of claim 9 , wherein the reference object support surface includes at least one of a floor, a ramp, or a shelf.

17. A non-transitory computer-readable medium storing instructions executable by a processor of a mobile computing device, the instructions comprising:

controlling a stereo camera assembly to capture a reference stereo image;

detecting a reference object support surface from the reference stereo image;

determining, based on the reference object support surface detected from the reference stereo image and an output gravity vector from a motion sensor of the mobile computing device, an inclination angle of the reference object support surface corresponding to an angle between the output gravity vector from the motion sensor of the mobile computing device and a normal vector to the reference object support surface;

controlling the stereo camera assembly to capture a first dimensioning stereo image;

detecting the reference object support surface in the first dimensioning stereo image, using the inclination angle as a constraint;

detecting a first object surface in the first dimensioning stereo image; and

generating dimensions of the object based on the first object surface and the reference object support surface.

18. The non-transitory computer-readable medium of claim 17 , the instructions further comprising:

controlling the stereo camera assembly to capture a second dimensioning stereo image from the stereo camera assembly;

detecting the reference object support surface in the second dimensioning stereo image based on the inclination angle;

detecting a second object surface in the second dimensioning stereo image; and generating further dimensions of the object based on the second object surface and the reference surface.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2021
From: LIYANAARACHCHI, VIPULA; THRIMAWITHANA, RAVEEN T.; MEDAGAMA, MICHAEL WIJAYANTHA
To: ZEBRA TECHNOLOGIES CORPORATION
Reel/Frame 056305/0756 →
SECURITY INTEREST Recorded Apr 12, 2021
From: ZEBRA TECHNOLOGIES CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 056472/0063 →
RELEASE OF SECURITY INTEREST - 364 - DAY Recorded Mar 5, 2021
From: JPMORGAN CHASE BANK, N.A.
To: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
Reel/Frame 056036/0590 →
SECURITY INTEREST Recorded Sep 1, 2020
From: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 053841/0212 →
Continuity (1)
Related Publication 20210343035A1 · Nov 4, 2021
References Cited (13)
US 20100302378A1 · Marks · 2010 [cited by examiner]
US 20140139637A1 · Mistry · 2014 [cited by examiner]
US 20140210950A1 · Atanassov · 2014 [cited by examiner]
US 20140355820A1 · Wu · 2014 [cited by examiner]
US 20170228602A1 · Stefanovic · 2017 [cited by examiner]
US 20180286119A1 · Felip Leon · 2018 [cited by examiner]
US 20190026878A1 · Jovanovski et al. · 2019 [cited by applicant]
US 20190041190A1 · Okamura · 2019 [cited by applicant]
US 20190139310A1 · Holzer · 2019 [cited by examiner]
US 20190295286A1 · Ishida · 2019 [cited by examiner]
US 20210056720A1 · Uchida · 2021 [cited by examiner]
International Search Report and Written Opinion for International Application No. PCT/US2021/29801 mailed on May 27, 2021. [cited by applicant]
Indian Examination Report for Indian patent application No. 202217059136 mailed on Sep. 18, 2024. [cited by applicant]