IP Library › Granted Patent US 10,379,219
Granted Patent B1
US 10,379,219 · App. 14/843,866 · Granted Aug 13, 2019

Measurement system using camera

Inventor: Ara W. Nazarian (Newport Beach, CA)
Assignee: Rockley Photonics Limited
G01S17/08G01B11/26G01B17/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,379,219
App. No.
14/843,866
Granted
Aug 13, 2019
Kind
B1
Abstract

A system and method for displaying ranged measurements of objects within an image display is disclosed. Embodiments may use a range finding device to measure distances of objects from a user. Aspects of the subject technology may compensate for tilt of the object and/or of the device capturing the image.

Claims (54)

1. A computer program product for measuring an actual size (A) of objects and compensating for tilt, the computer program product comprising a non-transitory computer readable storage medium having computer readable program code embodied therewith, the computer readable program code being configured to, when executed by a processor:

identify one or more objects in one or more planes within a field of view of a camera coupled to an electronic display;

point a scanning laser source and laser beam at a plurality of points on the identified one or more objects;

measure distances from the laser source to each of the plurality of points on the identified one or more objects;

determine a tilt angle of the identified one or more objects relative to the laser source;

determine the actual size of the identified one or more objects based on the measured distances of each of the plurality of points on the identified one or more objects and the determined tilt angle of the identified one or more objects relative to the laser source;

identify perimeter points on opposite sides of a selected one of the identified one or more objects as the selected identified one or more objects appears on the electronic display;

determine a distance (AP) between the perimeter points as the selected identified one or more objects appears on the electronic display;

determine a distance (aP) between a first point, of the plurality of points, the first point being on the selected identified one or more objects, and a second point, of the plurality of points, the second point being on the selected identified one or more objects, as the selected identified one or more objects appears on the electronic display;

determine an actual size (a) of the distance between the first point, and the second point based on a distance B, a distance C, and a common angle between the first point, the second point, and the laser source, the distance B being the measured distance from the laser source to the first point, the distance C being the measured distance from the laser source to the second point; and

determine the actual size (A) of the selected identified one or more objects based on the actual size (a) of the distance between the first point and the second point, the distance (AP) between the perimeter points as the selected identified one or more objects appears on the electronic display, and the distance (aP) between the first point and the second point as the selected identified one or more objects appears on the electronic display.

2. The computer program product of claim 1 , wherein:

the scanning laser source and laser beam are pointed at the first point on a line perpendicular to an electronic device comprising the electronic display;

the scanning laser source and laser beam are pointed at the second point on a line at a known angle (α) from the laser source;

the first and second points are intermediate the identified perimeter points;

the actual size (a) of the distance between the first and the second point is determined according to the formula,

a =√{square root over ( B 2 +C 2 −2 BC *cos(α))}; and

the actual size (A) of the selected identified one or more objects is determined according to the formula,

A=a *( AP/aP ).

3. The computer program product of claim 1 , further comprising code configured to:

determine a tilt angle (ω) of the laser source relative to a gravity vector;

determine a tilt angle (ωP)=90−ω; and

determine the actual size (A) of the selected identified one or more objects according to the formula:

A=AP *( a/aP )/COS(ω P ).

4. The computer program product of claim 1 , further comprising code configured to determine a number of the one or more planes in the field of view and determine the actual size of objects in each of the planes.

5. A system for measuring an actual size (A) of an object and for compensating for tilt when displayed by a mobile electronic device including a camera, an electronic display, and a processor, comprising:

a housing configured for attachment to the mobile electronic device, the housing including a window over the camera;

a scanning laser source coupled to the housing;

a distance measuring device configured to receive a reflected laser beam from the object and calculate a distance from the scanning laser source to the object;

a bus for providing distance measurements from the distance measuring device to the processor; and

a computer program product for measuring the actual size (A) of objects and for compensating for tilt when displayed on the electronic display, the computer program product comprising a non-transitory computer readable storage medium in the mobile electronic device having computer readable program code embodied therewith, the computer readable program code being configured to, when executed by the processor:

identify one or more objects in one or more planes within a field of view of the camera;

point the scanning laser source and laser beam at a plurality of points on the identified one or more objects;

measure distances from the laser source to each of the plurality of points on the identified one or more objects;

determine a tilt angle of the identified one or more objects relative to the laser source;

determine the actual size of the identified one or more objects based on the measured distances of each of the plurality of points on the identified one or more objects and the determined tilt angle of the identified one or more objects relative to the laser source; and

identify perimeter points on opposite sides of a selected one of the identified one or more objects as the selected identified one or more objects appears on the electronic display;

determine a distance (AP) between the perimeter points as the selected identified one or more objects appears on the electronic display;

determine a distance (aP) between a first point, of the plurality of points, the first point being on the selected identified one or more objects, and a second point, of the plurality of points, the second point being on the selected identified one or more objects, as the selected identified one or more objects appears on the electronic display;

determine an actual size (a) of the distance between the first point and the second point based on a distance B, a distance C, and a common angle between the first point, the second point, and the laser source, the distance B being the measured distance from the laser source to the first point, the distance C being the measured distance from the laser source to the second point; and

determine the actual size (A) of the selected identified one or more objects based on the actual size (a) of the distance between the first point and the second point, the distance (AP) between the perimeter points as the selected identified one or more objects appears on the electronic display, and the distance (aP) between the first point and the second point as the selected identified one or more objects appears on the electronic display.

6. The system of claim 5 , wherein:

the scanning laser source and laser beam are pointed at the first point on a line perpendicular to the electronic device;

the scanning laser source and laser beam are pointed at the second point on a line at a known angle (α) from laser source;

the first and second points are intermediate the identified perimeter points;

the actual size (a) of the distance between the first point and the second point is determined according to the formula,

a =√{square root over ( B 2 +C 2 −2 BC *cos(α))}; and

the actual size (A) of the selected identified one or more objects is determined according to the formula,

A=a *( AP/aP ).

7. The system of claim 6 , further comprising code configured to:

determine a tilt angle (ω) of the laser source relative to a gravity vector;

determine a tilt angle (ωP)=90−ω; and

determine the actual size (A) of the selected identified one or more objects according to the formula:

A=AP *( a/aP )/COS(ω P ).

Assignments (6)
RELEASE OF SECURITY INTEREST - REEL/FRAME 060204/0749 Recorded Mar 19, 2023
From: WILMINGTON SAVINGS FUND SOCIETY, FSB, AS COLLATERAL AGENT
To: ROCKLEY PHOTONICS LIMITED
Reel/Frame 063264/0333 →
SECURITY INTEREST Recorded Mar 19, 2023
From: ROCKLEY PHOTONICS LIMITED
To: WILMINGTON SAVINGS FUND SOCIETY, FSB, AS COLLATERAL AGENT
Reel/Frame 063287/0879 →
RELEASE OF PATENT SECURITY INTEREST - SUPER SENIOR INDENTURE - REEL/FRAME 061768/0082 Recorded Mar 19, 2023
From: WILMINGTON SAVINGS FUND SOCIETY, FSB, AS COLLATERAL AGENT
To: ROCKLEY PHOTONICS LIMITED
Reel/Frame 063264/0416 →
SECURITY INTEREST - SUPER SENIOR INDENTURE Recorded Oct 25, 2022
From: ROCKLEY PHOTONICS LIMITED
To: WILMINGTON SAVINGS FUND SOCIETY, FSB, AS COLLATERAL AGENT
Reel/Frame 061768/0082 →
SECURITY INTEREST Recorded May 27, 2022
From: ROCKLEY PHOTONICS LIMITED
To: WILMINGTON SAVINGS FUND SOCIETY, FSB, AS COLLATERAL AGENT
Reel/Frame 060204/0749 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2019
From: NAZARIAN, ARA W.
To: ROCKLEY PHOTONICS LIMITED
Reel/Frame 048299/0474 →
Continuity (1)
Provisional Application 62059653 · Oct 3, 2014