IP Library › Granted Patent US 12,730,509
Granted Patent B2
US 12,730,509 · App. 18/887,042 · Granted Sep 8, 2026

Sensing activation maps from eye data

Inventors: Andrew Samuel Berkovich (Sammamish, WA); Reid Frederick Pinkham (Bellevue, WA)
Assignee: Meta Platforms Technologies, LLC
G06F3/013G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,730,509
App. No.
18/887,042
Granted
Sep 8, 2026
Kind
B2
Abstract

Eye gaze data is generated by an eye-tracking module. One or more activation maps are generated by a sensing module based on the eye gaze data. The sensing module acquires sensor data based on the one or more activation maps.

Claims (37)

1 . A head-mounted device (HMD) comprising:

an eye-tracking module configured to generate eye gaze data;

a sensing module configured to:

generate one or more activation maps based on the eye gaze data; and

acquire sensor data based on the one or more activation maps.

2 . The HMD of claim 1 , wherein the one or more activation maps include regions having different sampling densities.

3 . The HMD of claim 1 , wherein generating the one or more activation maps based on the eye gaze data includes:

generating a first activation map for a first sensor; and

generating a second activation map for a second sensor.

4 . The HMD of claim 3 , wherein the first sensor has a field of view (FOV) different from the second sensor.

5 . The HMD of claim 3 , wherein the first sensor is an image sensor and the second sensor is a time-of-flight sensor.

6 . The HMD of claim 1 , wherein the one or more activation maps include a first region that corresponds to an eye gaze direction in the eye gaze data, and wherein a sampling density of the first region is higher than a sampling density corresponding to at least one other region of the one or more activation maps.

7 . The HMD of claim 6 , wherein a size of the first region in the one or more activation maps is based on a measurement of error associated with the eye gaze direction included in the eye gaze data.

8 . The HMD of claim 1 , wherein the sensor data is received from at least one of a monochrome image sensor, a color image sensor, a depth sensor, or a time-of-flight sensor.

9 . A system comprising:

an eye-tracking module configured to generate eye gaze data;

a sensing module configured to:

generate one or more activation maps based on the eye gaze data; and

acquire sensor data based on the one or more activation maps.

10 . The system of claim 9 , wherein the one or more activation maps include regions having different sampling densities.

11 . The system of claim 9 , wherein generating the one or more activation maps based on the eye gaze data includes:

generating a first activation map for a first sensor; and

generating a second activation map for a second sensor.

12 . The system of claim 11 , wherein the first sensor has a field of view (FOV) different from the second sensor.

13 . A computer-implemented method comprising:

generating eye gaze data with an eye-tracking module;

generating, with a sensing module, one or more activation maps based on the eye gaze data; and

acquiring, with the sensing module, sensor data based on the one or more activation maps.

14 . The computer-implemented method of claim 13 , wherein the one or more activation maps include regions having different sampling densities.

15 . The computer-implemented method of claim 13 , wherein generating the one or more activation maps based on the eye gaze data includes:

generating a first activation map for a first sensor; and

generating a second activation map for a second sensor.

16 . The computer-implemented method of claim 15 , wherein the first sensor has a field of view (FOV) different from the second sensor.

17 . The computer-implemented method of claim 13 , wherein the sensing module is a foveated sensing module.

18 . The computer-implemented method of claim 13 , wherein the one or more activation maps include a first region that corresponds to an eye gaze direction in the eye gaze data, and wherein a sampling density of the first region is higher than a sampling density corresponding to at least one other region of the one or more activation maps.

19 . The computer-implemented method of claim 18 , wherein a size of the first region in the one or more activation maps is based on a measurement of error associated with the eye gaze direction included in the eye gaze data.

20 . The computer-implemented method of claim 13 , wherein the sensor data is received from at least one of a monochrome image sensor, a color image sensor, a depth sensor, or a time-of-flight sensor.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2024
From: RIENHOFF, HUGH Y., JR.
To: IMAGO BIOSCIENCES, INC.
Reel/Frame 069325/0491 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2024
From: BERKOVICH, ANDREW SAMUEL; PINKHAM, REID FREDERICK
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 068984/0178 →
Continuity (3)
Continuation 17954583 · Sep 28, 2022
Provisional Application 63357564 · Jun 30, 2022
Related Publication 20250013300A1 · Jan 9, 2025
References Cited (25)
US 6252989B1 · Geisler et al. · 2001 [cited by applicant]
US 6839452B1 · Yang et al. · 2005 [cited by applicant]
US 7525586B2 · Loose · 2009 [cited by applicant]
US 10091441B1 · Northcott · 2018 [cited by applicant]
US 10572764B1 · Bastani et al. · 2020 [cited by applicant]
US 10867368B1 · Sharma et al. · 2020 [cited by applicant]
US 11379952B1 · Sharma et al. · 2022 [cited by applicant]
US 20070248273A1 · Kortum et al. · 2007 [cited by applicant]
US 20090010555A1 · Kortum et al. · 2009 [cited by applicant]
US 20150077613A1 · Petilli · 2015 [cited by applicant]
US 20190363118A1 · Berkovich et al. · 2019 [cited by applicant]
US 20200045250A1 · Geurts · 2020 [cited by applicant]
US 20200143516A1 · Martin et al. · 2020 [cited by applicant]
US 20200195828A1 · Reyserhove et al. · 2020 [cited by applicant]
US 20200195875A1 · Berkovich et al. · 2020 [cited by applicant]
US 20210044742A1 · Berkovich et al. · 2021 [cited by applicant]
US 20210112427A1 · Shveki et al. · 2021 [cited by applicant]
US 20210368124A1 · Berkovich et al. · 2021 [cited by applicant]
US 20220139034A1 · Lovegrove et al. · 2022 [cited by applicant]
US 20240007771A1 · Berkovich et al. · 2024 [cited by applicant]
Non-Final Office Action mailed Feb. 15, 2024 for U.S. Appl. No. 17/954,583, filed Sep. 28, 2022, 8 pages. [cited by applicant]
Notice of Allowance mailed Jun. 17, 2024 for U.S. Appl. No. 17/954,583, filed Sep. 28, 2022, 9 pages. [cited by applicant]
Patney A., et al., “Towards Foveated Rendering for Gaze-Tracked Virtual Reality,” Association for Computing Machinery Transactions on Graphics, Nov. 2016, vol. 35 (6), Article 179, 12 pages. [cited by applicant]
Qualcomm., “Qualcomm Introduces Snapdragon 835 Virtual Reality Development Kit,” Feb. 23, 2017, 2 pages, Retrieved from the Internet: URL: https://www.qualcomm.com/news/releases/2017/02/qualcomm-introduces-snapdragon-83… [cited by applicant]
1 Notice of Allowance, U.S. Appl. No. 18/208,236, Notification Date: Jul. 8, 2025, 8 pages. [cited by applicant]