IP Library Granted Patent US 10,514,545
Granted Patent B2
US 10,514,545 · App. 15/835,846 · Granted Dec 24, 2019

Selective tracking of a head-mounted display

Inventor: Renzo De Nardi (Seattle, WA)
Assignee: Facebook Technologies, LLC
G02B27/0172G01B7/004G01S3/7865G02B27/017G06T7/246G02B2027/0138G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,514,545
App. No.
15/835,846
Filed
Dec 8, 2017
Granted
Dec 24, 2019
Kind
B2
Art Unit
2667
USPC
382/103
Abstract

A tracking system tracks a target object separated from a head-mounted display (HMD). The tracking system includes a first tracking device (e.g., a camera), a second tracking device (e.g., magnetic tracking system), and a selective tracking system. The first tracking device determines a position of the target object using the first type of tracking information, and determines a tracking error that is associated with the determined position. The selective tracking system compares the tracking error to a threshold value, and based on the comparison, determines a position of the target object using the second tracking device.

Claims (33)

1. A tracking system comprising:

a camera assembly configured to capture one or more images of a local area;

a magnetic field generator coupled to a target object, the magnetic field generator configured to generate a magnetic field;

a magnetic sensor assembly coupled to a head-mounted display that is separate from the target object, the magnetic sensor assembly configured to detect the magnetic field;

a selective tracking system configured to track the target object, wherein the selective tracking system is configured to:

determine whether the target object is within an effective field of view of the camera assembly using the captured images,

responsive to the target object being outside the effective field of view, determine a position of the target object using the detected magnetic field, and

responsive to the target object being inside the effective field of view, determine a position of the target object using the captured images.

2. The tracking system of claim 1 , wherein the selective tracking system is further configured to:

determine whether the captured images include at least a threshold percentage of the target object; and

responsive to determination that the captured images do not include at least a threshold percentage of the target object, determine that the target object is outside the effective field of view of the camera assembly.

3. The tracking system of claim 1 , wherein the selective tracking system is further configured to:

determine the position of the target object based on magnetic tracking information, wherein the magnetic tracking information is generated based on strength and direction of the magnetic field detected by the magnetic sensor.

4. The tracking system of claim 3 , wherein the magnetic tracking information includes spatial position vectors representing spatial coordinates in a multi-dimensional space.

5. The tracking system of claim 1 , wherein the magnetic field generator is located at a predefined location on the target object and configured to generate the magnetic field that is fixed in relation to the target object.

6. The tracking system of claim 1 , wherein the camera assembly is part of a depth camera assembly that includes an illumination source that emits structured light into the local area.

7. A method for tracking a target object comprising:

capturing, by a camera assembly, one or more images of a local area;

generating a magnetic field by a magnetic field generator coupled to a target object;

detecting the magnetic field by a magnetic sensor assembly separate from the target object;

determining whether the target object is within an effective field of view of the camera assembly using the captured images;

responsive to the target object being outside the effective field of view, determining a position of the target object using the detected magnetic field; and

responsive to the target object being inside the effective field of view of the camera assembly, determining a position of the target object using the captured images.

8. The method of claim 7 , further comprising:

determining whether the captured images include at least a threshold percentage of the target object; and

responsive to determination that the captured images do not include at least a threshold percentage of the target object, determining that the target object is outside the effective field of view of the camera assembly.

9. The method of claim 7 , further comprising:

determining the position of the target object based on magnetic tracking information, wherein the magnetic tracking information is generated based on strength and direction of the magnetic field detected by the magnetic sensor assembly.

10. The method of claim 9 , wherein the magnetic tracking information includes spatial position vectors representing spatial coordinates in a multi-dimensional space.

11. The method of claim 7 , wherein generating a magnetic field by a magnetic field generator coupled to a target object comprises:

generating the magnetic field that is fixed in relation to the target object by the magnetic field generator that is located at a predefined location on the target object.

12. The method of claim 7 , further comprising:

emitting structured light into the local area.

Assignments (3)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0224 →
CHANGE OF NAME Recorded Sep 12, 2018
From: OCULUS VR, LLC
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 047178/0616 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2017
From: DE NARDI, RENZO
To: OCULUS VR, LLC
Reel/Frame 044367/0587 →
Continuity (1)
Related Publication 20190179146A1 · Jun 13, 2019