IP Library › Granted Patent US 12,259,547
Granted Patent B2
US 12,259,547 · App. 18/441,811 · Granted Mar 25, 2025

Position tracking systems and methods for head-mounted display systems

Inventors: Evan Fletcher (Bellevue, WA); Jeffrey Walter Mucha (Bellevue, WA); Joshua Mark Hudman (Issaquah, WA); Alan Yates (Bellevue, WA); Gordon Wayne Stoll (Sammamish, WA); Jeffrey George Leinbaugh (Bellevue, WA); Charles Lohr (Bellevue, WA)
Assignee: Valve Corporation
G02B27/0093G02B27/0101G02B27/0172G02B27/0179G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,259,547
App. No.
18/441,811
Granted
Mar 25, 2025
Kind
B2
Abstract

Systems and methods for tracking the position of one or more head-mounted display (HMD) system components of an HMD system. The HMD components may carry a plurality of angle sensitive detectors or other types of detectors. The HMD system may be operative to detect corrupted position tracking samples, allowing such samples to be ignored, thereby improving the position tracking process. Control circuitry causes light sources to emit light according a specified pattern, and receives sensor data from the plurality of detectors. Control circuitry may process the sensor data, for example using machine learning or other techniques, to track a position of one or more HMD components.

Claims (48)

1. A head-mounted display system, comprising:

a first head-mounted display system component;

a plurality of optical detectors carried by the first head-mounted display system component;

a second head-mounted display system component that includes a plurality of light sources; and

control circuitry operative to:

cause one or more of the plurality of light sources to emit light;

receive sensor data from one or more of the plurality of optical detectors;

track a position of the second head-mounted display system component based at least in part on the received sensor data;

process the received sensor data, including to determine whether to disable any one of the plurality of optical detectors or any one of the plurality of light sources based on determined disabling criteria; and

disable each of the optical detectors or the light sources that satisfy the disabling criteria for a respective disabled time period during the tracking of the position of the second head-mounted display system component.

2. The head-mounted display system of claim 1 wherein the disabling criteria is based at least in part on a determined relative position between the first head-mounted display system component and the second head-mounted display system component.

3. The head-mounted display system of claim 1 wherein the respective disabled time period is based at least in part on movement of at least one of the first head-mounted display system component and the second head-mounted display system component.

4. The head-mounted display system of claim 1 wherein, for each of the plurality of light sources of the second head-mounted display system component, the disabling criteria provides a determination that light emitted by the light source is not likely to be received by any of the optical detectors of the first head-mounted display system component.

5. The head-mounted display system of claim 1 wherein, for each of the plurality of optical detectors of the first head-mounted display system component, the disabling criteria provides a determination that light emitted by any of the plurality of light sources of the second head-mounted display system component is not likely to be received by the optical detector.

6. The head-mounted display system of claim 1 wherein the respective disabled time period for each of the disabled light sources or optical detectors is determined based at least in part on at least one of:

a relative position between the first head-mounted display system component and the second head-mounted display system component; or

a relative movement between the first head-mounted display system component and the second head-mounted display system component.

7. The head-mounted display system of claim 1 wherein the respective disabled time period for each of the disabled light sources is determined based at least in part on a position of the light source on the second head-mounted display system component.

8. The head-mounted display system of claim 1 wherein the respective disabled time period for each of the disabled optical detectors is determined based at least in part on a position of the optical detector on the first head-mounted display system component.

9. The head-mounted display system of claim 1 wherein, the disabling criteria provides a determination that light emitted by each light source in a first subset of the plurality light sources is likely to be received by at least one of the optical detectors of the first head-mounted display system component, and the disabling criteria is operative to disable a second subset of light sources within the first subset of light sources for respective disabled time periods.

10. The head-mounted display system of claim 9 wherein the light sources in the second subset of light sources that are disabled are selected to provide light sources in the first subset of light sources that are not disabled that are relatively spaced apart from each other to provide relatively larger angles of separation with respect to the optical detectors that detect the light emitted by the light sources.

11. The head-mounted display system of claim 1 wherein the disabling criteria is based at least in part on previously received sensor data from one or more of the plurality of optical detectors.

12. A head-mounted display system, comprising:

a first head-mounted display system component;

a plurality of optical detectors carried by the first head-mounted display system component;

a second head-mounted display system component that includes a plurality of light sources; and

control circuitry operative to:

receive sensor data from one or more of the plurality of optical detectors;

track a position of at least one of the first head-mounted display system component and the second head-mounted display system component based at least in part on the received sensor data;

process the received sensor data, including to determine whether to disable any one of the plurality of optical detectors or any one of the plurality of light sources based on determined disabling criteria; and

disable each of the optical detectors or the light sources that satisfy the disabling criteria for a respective disabled time period.

13. A method of operating a head-mounted display system, the head-mounted display system comprising a first head-mounted display system component that includes a plurality of optical detectors, and a second head-mounted display system component that includes a plurality of light sources, the method comprising:

receiving sensor data from one or more of the plurality of optical detectors;

tracking a position of at least one of the first head-mounted display system component and the second head-mounted display system component based at least in part on the received sensor data;

processing the received sensor data, including determining whether to disable any one of the plurality of optical detectors or any one of the plurality of light sources based on determined disabling criteria; and

disabling each of the optical detectors or the light sources that satisfy the disabling criteria for a respective disabled time period.

14. The method of claim 13 wherein the disabling criteria is based at least in part on a determined relative position between the first head-mounted display system component and the second head-mounted display system component.

15. The method of claim 13 wherein the respective disabled time period is based at least in part on movement of at least one of the first head-mounted display system component and the second head-mounted display system component.

16. The method of claim 13 wherein, for each of the plurality of light sources of the second head-mounted display system component, the disabling criteria provides a determination that light emitted by the light source is not likely to be received by any of the optical detectors of the first head-mounted display system component.

17. The method of claim 13 wherein, for each of the plurality of optical detectors of the first head-mounted display system component, the disabling criteria provides a determination that light emitted by any of the plurality of light sources of the second head-mounted display system component is not likely to be received by the optical detector.

18. The method of claim 13 wherein the respective disabled time period for each of the disabled light sources or optical detectors is determined based at least in part on at least one of:

a relative position between the first head-mounted display system component and the second head-mounted display system component; or

a relative movement between the first head-mounted display system component and the second head-mounted display system component.

19. The method of claim 13 wherein the respective disabled time period for each of the disabled light sources is determined based at least in part on a position of the light source on the second head-mounted display system component.

20. The method of claim 13 wherein the respective disabled time period for each of the disabled optical detectors is determined based at least in part on a position of the optical detector on the first head-mounted display system component.

21. The method of claim 13 wherein, the disabling criteria provides a determination that light emitted by each light source in a first subset of the plurality light sources is likely to be received by at least one of the optical detectors of the first head-mounted display system component, and the disabling criteria is operative to disable a second subset of light sources within the first subset of light sources for respective disabled time periods.

22. The method of claim 21 wherein the light sources in the second subset of light sources that are disabled are selected to provide light sources in the first subset of light sources that are not disabled that are relatively spaced apart from each other to provide relatively larger angles of separation with respect to the optical detectors that detect the light emitted by the light sources.

23. The method of claim 13 wherein the disabling criteria is based at least in part on previously received sensor data from one or more of the plurality of optical detectors.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 1, 2024
From: FLETCHER, EVAN; MUCHA, JEFFREY WALTER; HUDMAN, JOSHUA MARK; YATES, ALAN; STOLL, GORDON WAYNE; LEINBAUGH, JEFFREY GEORGE; LOHR, CHARLES
To: VALVE CORPORATION
Reel/Frame 067287/0154 →
Continuity (3)
Continuation 17954076 · Sep 27, 2022
Provisional Application 63249348 · Sep 28, 2021
Related Publication 20240184105A1 · Jun 6, 2024
References Cited (25)
US 7920919B1 · Nabutovsky · 2011 [cited by applicant]
US 8223024B1 · Petrou · 2012 [cited by examiner]
US 8970571B1 · Wong et al. · 2015 [cited by applicant]
US 10554886B2 · Rydberg · 2020 [cited by applicant]
US 11042028B1 · Welch · 2021 [cited by examiner]
US 20050224706A1 · von Rosenberg, Jr. · 2005 [cited by applicant]
US 20050285129A1 · Jackson et al. · 2005 [cited by applicant]
US 20070029949A1 · Null et al. · 2007 [cited by applicant]
US 20070035706A1 · Margulis · 2007 [cited by applicant]
US 20090095885A1 · Hager · 2009 [cited by applicant]
US 20120140231A1 · Knox et al. · 2012 [cited by applicant]
US 20130113973A1 · Miao · 2013 [cited by applicant]
US 20150370333A1 · Ataee et al. · 2015 [cited by applicant]
US 20160131761A1 · Yates et al. · 2016 [cited by applicant]
US 20160341959A1 · Gibbs · 2016 [cited by examiner]
US 20170282062A1 · Black · 2017 [cited by applicant]
US 20180361232A1 · Mallinson · 2018 [cited by applicant]
US 20190046873A1 · Black · 2019 [cited by examiner]
US 20210231962A1 · Hudman et al. · 2021 [cited by applicant]
CN 106255916A · 2016 [cited by applicant]
CN 109477966A · 2019 [cited by applicant]
WO 2021150423A1 · 2021 [cited by applicant]
WO 2021158804A1 · 2021 [cited by applicant]
International Search Report and Written Opinion, Feb. 22, 2023, for PCT/US2022/044890, 20 pages. [cited by applicant]
Xu, et al., “Pointing and Selection Methods for Text Entry in Augmented Reality Head-Mounted Displays,” 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Oct. 18, 2019, 10 pages. [cited by applicant]