IP Library Granted Patent US 9,691,152
Granted Patent B1
US 9,691,152 · App. 14/827,002 · Granted Jun 27, 2017

Minimizing variations in camera height to estimate distance to objects

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,691,152
App. No.
14/827,002
Granted
Jun 27, 2017
Kind
B1
Abstract

Approaches provide for minimizing variations in the height of a camera of a computing device when estimating the distance to objects represented in image data captured by the camera. For example, a front-facing camera of a computing device can be used to capture a live camera view of a user. An application can analyze the image data to locate features of the user's face for purposes of aligning the user with the computing device. As the position and/orientation of the device changes with respect to the user, the image data can be analyzed to detect whether a location of a representation of a feature of the user aligns with the alignment element. Once the feature is aligned with the alignment element, a rear-facing camera (or other camera) can capture second image data of an object. The second image data can be analyzed to determine a geometric relationship between the rear-facing camera and the object, and the geometric relationship can be used to determine a distance to the object with respect to the computing device.

Claims (76)

1. A computing device, comprising:

a display screen;

a computing device processor;

a front-facing camera;

a rear-facing camera; and

a memory device including instructions that, when executed by the computing device processor, cause the computing device to:

capture first image data by the front-facing camera, the first image data including a representation of a user of the computing device;

analyze the first image data to determine a bodily feature of the user;

display an alignment element in an overlay on the display screen, the alignment element used to assist in positioning the user with respect to the front-facing camera;

detect a change in orientation of the computing device with respect to user;

analyze the first image data to detect that a location of a representation of the bodily feature aligns with the alignment element within a threshold deviation;

capture second image data by the rear-facing camera, the second image data including a representation of an object;

analyze the second image data to determine a geometric relationship between the rear-facing camera and the object; and

determine, based at least in part on the geometric relationship, a distance to the object with respect to the computing device.

2. The computing device of claim 1 , wherein the instructions, when executed further enable the computing device to:

analyze the first image data to detect that the location of the representation of the bodily feature is outside the alignment element; and

provide an alert to assist aligning the representation of the bodily feature with the alignment element.

3. The computing device of claim 1 , wherein the instructions, when executed further enable the computing device to:

capture third image data by the rear-facing camera, the third image data including a representation of an object, the object being associated with a size that includes a height and a width; and

determine, based at least in part on the size, a distance between the object and the rear-facing camera.

4. The computing device of claim 1 , wherein the instructions when executed further cause the computing device to:

performing facial recognition to determine whether information representative of at least one bodily feature of the user matches information stored for an authorized user of the computing device.

5. A computing device, comprising:

a display screen;

a computing device processor;

a first camera;

a second camera; and

a memory device including instructions that, when executed by the computing device processor, cause the computing device to:

capture first image data by the first camera, the first image data including a representation of a user of the computing device;

analyze the first image data to determine a position of the user with respect to the computing device;

determine, based at least in part on the position of the user, that a representation of a bodily feature of the user in the first image data aligns with an alignment element within a threshold amount of deviation;

capture second image data by the second camera, the second image data including a representation of an object; and

determine a distance to the object based at least in part on the second image data.

6. The computing device of claim 5 , wherein the instructions when executed further cause the computing device to:

analyze the first image data to detect that a location of the representation of the bodily feature is outside the alignment element; and

provide an alert to assist aligning the representation of the bodily feature with the alignment element,

wherein the bodily feature includes at least one of a nose, an eye, a mouth, a head, shoulders, a chin, or a pair of ears.

7. The computing device of claim 6 , wherein the alert is one of a visual indication, audio alert, or haptic alert.

8. The computing device of claim 5 , wherein the instructions when executed further cause the computing device to:

analyze the second image data to determine a geometric relationship between the second camera and the object; and

determine, based at least in part on the geometric relationship, the distance to the object with respect to the computing device.

9. The computing device of claim 5 , wherein the instructions when executed further cause the computing device to:

obtain third image data, the third image data including a representation of a second object, the second object associated with physical dimensions;

scaling, using at least one transformation algorithm, the physical dimensions to generate scaled dimensions based at least in part upon the distance; and

provide an augmented reality view that includes the representation of the second object displayed at the distance at the scaled dimensions.

10. The computing device of claim 9 , wherein the augmented reality view is presented at least partially overlying the second image data as displayed on the display screen.

11. The computing device of claim 5 , wherein the computing device further includes an inertial determining component configured to measure at least a tilt of the computing device, and wherein the instructions when executed to capture the second image further cause the computing device to:

determine the tilt of the computing device with respect to a reference plane to generate a tilt measurement;

provide a display of the tilt measurement on the display screen; and

determine the tilt measurement meets a tilt threshold.

12. The computing device of claim 5 , wherein the instructions when executed to determine that the representation of the bodily feature aligns with the alignment element further cause the computing device to:

determine a first interest point and a second interest point of the bodily feature; and

determine that the alignment element intersects the first interest point and the second interest point.

13. The computing device of claim 5 , wherein the instructions when executed further cause the computing device to:

capture third image data by the second camera, the third image data including a representation of an object, the object being associated with a size that includes a height and width; and

determine, based at least in part on the size, a distance between the object and the second camera.

14. The computing device of claim 5 , wherein the instructions when executed further cause the computing device to:

analyze the first image data to determine whether information representative of at least one bodily feature of the user matches information stored for an authorized user of the computing device.

15. The computing device of claim 14 , wherein analyzing the first image data is performed at least in part using at least one of a feature recognition algorithm, a facial recognition algorithm, or a shape recognition algorithm.

16. The computing device of claim 5 , wherein the orientation of the computing device is determined based at least in part on one of images captured by one of the first camera or the second camera, or at least one sensor.

17. A method, comprising:

capturing first image data by a first camera of a computing device, the first image data including a representation of a user of the computing device;

analyzing the first image data to determine a position of the user with respect to the computing device;

determining, based at least in part on the position of the user, that a representation of a bodily feature of the user in the first image data aligns with an alignment element within a threshold amount of deviation;

capturing second image data by a second camera of the computing device, the second image data including a representation of an object; and

determining a distance to the object based at least in part on the second image data.

18. The method of claim 17 , further including:

analyzing the first image data to detect that a location of the representation of the bodily feature is outside the alignment element; and

providing an alert to assist aligning the representation of the bodily feature with the alignment element, wherein the bodily feature includes at least one of a nose, an eye, a mouth, a head, shoulders, a chin, or a pair of ears, and wherein the alert is one of a visual indication, audio alert, or haptic alert.

19. The method of claim 17 , further comprising:

analyzing the second image data to determine a geometric relationship between the second camera and the object; and

determining, based at least in part on the geometric relationship, the distance to the object with respect to the computing device.

20. The method of claim 17 , further comprising:

obtaining third image data, the third image data including a representation of a second object, the second object associated with physical dimensions;

scaling, using at least one transformation algorithm, the physical dimensions to generate scaled dimensions based at least in part upon the distance; and

providing an augmented reality view that includes the representation of the second object displayed at the distance at the scaled dimensions, wherein the augmented reality view is presented at least partially overlying the second image data as displayed on a display screen of the computing device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2024
From: A9.COM, INC.
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 069167/0493 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 3, 2015
From: BORENSTEIN, ERAN; DEVADOSS, ARUNKUMAR; NEHUSHTAN, ZUR
To: A9.COM, INC.
Reel/Frame 036951/0615 →