IP Library Granted Patent US 10,229,511
Granted Patent B2
US 10,229,511 · App. 14/977,288 · Granted Mar 12, 2019

Method for determining the pose of a camera and for recognizing an object of a real environment

Inventor: Peter Meier (Munich, DE)
Assignee: Apple Inc.
G06T7/73G06K9/00624G06K9/3216G06K9/46G06K9/6202G06T7/246G06T7/30G06T7/33G06T7/70G06T2207/10012G06T2207/30232G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,229,511
App. No.
14/977,288
Granted
Mar 12, 2019
Kind
B2
Abstract

A method for determining the pose of a camera relative to a real environment includes the following steps: taking at least one image of a real environment by means of a camera, the image containing at least part of a real object, performing a tracking method that evaluates information with respect to correspondences between features associated with the real object and corresponding features of the real object as it is contained in the image of the real environment, so as to obtain conclusions about the pose of the camera, determining at least one parameter of an environmental situation, and performing the tracking method in accordance with the at least one parameter. Analogously, the method can also be utilized in a method for recognizing an object of a real environment in an image taken by a camera.

Claims (36)

1. A non-transitory computer readable medium comprising computer readable code which, when executed by one or more processors, causes the one or more processors to:

obtain an image captured by a camera, the image comprising a real environment containing at least part of a real object having features;

determine one or more parameter values corresponding to one or more environmental parameters of the real environment;

capture sensor data from a plurality of sensors, wherein the sensor data are weighted based on the one or more parameter values; and

evaluate one or more correspondences between the imaged features of the real object and modeled features of the real object, wherein the evaluation is influenced by the one or more parameter values and the sensor data.

2. The non-transitory computer readable medium of claim 1 , further comprising computer code to cause the one or more processors to determine a pose of the camera based on the evaluation.

3. The non-transitory computer-readable medium of claim 2 , further comprising computer code which cause the one or more processors to calculate an uncertainty of the determined pose based on at least one of the one or more parameter values and an ideal value corresponding to each of the at least one of the one or more environmental parameters.

4. The non-transitory computer readable medium of claim 1 ,

wherein the plurality of sensors are prioritized during the evaluation based on the one or more parameter values.

5. The non-transitory computer readable medium of claim 1 , wherein the one or more parameter values are determined from sensor data from one or more sensors local to the camera.

6. The non-transitory computer readable medium of claim 1 , wherein the one or more parameter values are obtained from a remote source based on a context of the camera.

7. A system comprising:

a camera;

one or more processors; and

a memory, coupled to the one or more processors and comprising computer code which, when executed, causes the one or more processors to:

obtain an image captured by the camera, the image comprising a real environment containing at least part of a real object having features;

determine one or more parameter values corresponding to one or more environmental parameters of the real environment; and

capture sensor data from a plurality of sensors, wherein the sensor data are weighted based on the one or more parameter values; and

evaluate one or more correspondences between the imaged features of the real object and modeled features of the real object, wherein the evaluation is influenced by the one or more parameter values and the sensor data.

8. The system of claim 7 , the memory further comprising computer code to cause the one or more processors to determine a pose of the camera based on the evaluation.

9. The system of claim 8 , the memory further comprising computer code which cause the one or more processors to calculate an uncertainty of the determined pose based on at least one of the one or more parameter values and an ideal value corresponding to each of the at least one of the one or more environmental parameters.

10. The system of claim 7 ,

wherein the plurality of sensors are prioritized during the evaluation based on the one or more parameter values.

11. The system of claim 7 , wherein the one or more parameter values are determined from sensor data from one or more sensors local to the camera.

12. The system of claim 7 , wherein the one or more parameter values are obtained from a remote source based on a context of the camera.

13. A method comprising:

obtaining an image captured by a camera, the image comprising a real environment containing at least part of a real object having features;

determining one or more parameter values corresponding to one or more environmental parameters of the real environment; and

capturing sensor data from a plurality of sensors, wherein the sensor data are weighted based on the one or more parameter values; and

evaluating one or more correspondences between the imaged features of the real object and modeled features of the real object, wherein the evaluation is influenced by the one or more parameter values and the sensor data.

14. The method of claim 13 , further comprising determining a pose of the camera based on the evaluation.

15. The method of claim 14 , further comprising calculating an uncertainty of the determined pose based on at least one of the one or more parameter values and an ideal value corresponding to each of the at least one of the one or more environmental parameters.

16. The method of claim 13 ,

wherein the plurality of sensors are prioritized during the evaluation based on the one or more parameter values.

17. The method of claim 13 , wherein the one or more parameter values are determined from sensor data from one or more sensors local to the camera.

18. The method of claim 13 , wherein the one or more parameter values are obtained from a remote source based on a context of the camera.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2016
From: METAIO GMBH
To: APPLE INC.
Reel/Frame 040821/0462 →
Priority Claims (1)
DE 10 2009 049 849 · Oct 19, 2009 · national
Continuity (3)
Continuation 14329547 · Jul 11, 2014
Continuation 13502959
Related Publication 20160189384A1 · Jun 30, 2016
Cited By (1)
US 12,353,617