IP Library Granted Patent US 12,681,306
Granted Patent B2
US 12,681,306 · App. 18/131,575 · Granted Jul 14, 2026

Combined eye and environment sensing for a head-mounted device

Inventors: Yatong An (Redmond, WA); Zhaoyu Nie (Kenmore, WA); Youmin Wang (Bellevue, WA)
Assignee: Meta Platforms Technologies, LLC
G02B27/0172G02B2027/0138G02B2027/0178G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,681,306
App. No.
18/131,575
Filed
Apr 6, 2023
Granted
Jul 14, 2026
Kind
B2
Art Unit
2872
USPC
359/630
Abstract

An eye and environment sensing system for a head-mounted device may be configured to determine changes in an eye orientation and range objects in the environment by sharing a common light source. The eye and environment sensing system includes a light source, a first photodetector, and a second photodetector. The light source is coupled to a frame of a head-mounted device and configured to provide a light beam to illuminate a portion of an eyebox region. The first photodetector is coupled to the frame and is oriented towards the eyebox region to receive reflections of the light beam from the eyebox region. The second photodetector is coupled to the frame and is oriented towards a scene side of the head-mounted device to receive reflections of the light beam from an environment of the head-mounted device. With a shared light source, battery consumption in the head-mounted device may be reduced.

Claims (19)

1 . An eye and environment sensing system for a head-mounted device comprising:

a light source coupled to a frame of a head-mounted device and configured to provide a light beam to illuminate a portion of an eyebox region;

a first photodetector coupled to the frame and oriented towards the eyebox region to receive reflections of the light beam from the eyebox region; and

a second photodetector coupled to the frame and oriented towards a scene side of the head-mounted device to receive reflections of the light beam, after reflection of the light beam from the eyebox region, from an environment of the head-mounted device.

2 . The eye and environment sensing system of claim 1 , wherein the second photodetector is configured to detect the light beam along a light path,

wherein the light path includes propagation from the eyebox region to an object in the environment and propagation from the object to the second photodetector.

3 . The eye and environment sensing system of claim 1 further comprising:

a micro-electromechanical systems (MEMS) mirror coupled to the frame and configured to direct the light beam from the light source to the portion of the eyebox region.

4 . The eye and environment sensing system of claim 3 , wherein the MEMS mirror is configured to scan the portion of the eyebox region.

5 . The eye and environment sensing system of claim 4 further comprising:

processing logic coupled to the first photodetector and configured to at least partially generate a three-dimensional (3D) model of the portion of the eyebox region.

6 . The eye and environment sensing system of claim 1 further comprising:

a plurality of first photodetectors coupled to the frame and oriented towards the eyebox region, wherein the first photodetector is one of the plurality of first photodetectors.

7 . The eye and environment sensing system of claim 1 further comprising:

a plurality of second photodetectors coupled to the frame and oriented towards the environment, wherein the second photodetector is one of a plurality of second photodetectors.

8 . The eye and environment sensing system of claim 1 further comprising:

processing logic coupled to the first and second photodetectors, wherein the processing logic is configured to determine eye orientation and range to an object using time-of-flight (ToF) of the light beam.

9 . The eye and environment sensing system of claim 8 , wherein the processing logic is configured to determine the orientation and the range using direct ToF or indirect ToF.

10 . The eye and environment sensing system of claim 1 , wherein the first photodetector is configured to capture reflections from the eyebox region within a first shutter window, wherein the second photodetector is configured to capture reflections from the environment within a second shutter window, wherein the first and second shutter windows are separated by a time delay.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2023
From: AN, YATONG; NIE, ZHAOYU; WANG, YOUMIN
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 063638/0591 →
Continuity (1)
Related Publication 20240337840A1 · Oct 10, 2024
References Cited (13)
US 9568603B2 · Yahav et al. · 2017 [cited by applicant]
US 11190748B1 · LeVake et al. · 2021 [cited by applicant]
US 11263455B2 · Yi et al. · 2022 [cited by applicant]
US 11307656B2 · Li et al. · 2022 [cited by applicant]
US 20130050432A1 · Perez et al. · 2013 [cited by applicant]
US 20160370605A1 · Ain-Kedem · 2016 [cited by examiner]
US 20190317597A1 · Aleem · 2019 [cited by examiner]
US 20220276351A1 · Ferreira et al. · 2022 [cited by applicant]
US 20230043439A1 · Amirsolaimani · 2023 [cited by applicant]
US 20230067343A1 · Zhang · 2023 [cited by examiner]
US 20240151966A1 · Meyer · 2024 [cited by examiner]
International Preliminary Report on Patentability for International Application No. PCT/US2024/018270, mailed Oct. 16, 2025, 11 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2024/018270, mailed Jul. 3, 2024, 14 pages. [cited by applicant]