IP Library Granted Patent US 11,808,945
Granted Patent B2
US 11,808,945 · App. 17/468,578 · Granted Nov 7, 2023

Eye data and operation of head mounted device

Inventors: Sebastian Sztuk (Menlo Park, CA); Salvael Ortega Estrada (Redmond, WA)
Assignee: Meta Platforms Technologies, LLC
G02B27/0172A61B3/112A61B3/113A61B5/02438G02B27/0093G02B27/0101G06F3/165G06V40/171G06V40/193H04R1/1083G02B2027/0118G02B2027/0138G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,808,945
App. No.
17/468,578
Granted
Nov 7, 2023
Kind
B2
Abstract

A method of operating a head mounted device includes capturing eye data with one or more sensors of the head mounted device. The one or more sensors are configured to sense an eyebox region. Operations of the head mounted device are adjusted in response to the eye data.

Claims (37)

1 . A method of operating a head mounted device, the method comprising:

capturing eye data with one or more sensors of the head mounted device, wherein the one or more sensors are configured to sense an eyebox region;

initiating an ambient light measurement with a photodetector of the head mounted device; and

adjusting a transparency of a lens the head mounted device in response to the eye data and the ambient light measurement, wherein adjusting the transparency of the lens of the head mounted device in response to the eye data and the ambient light measurement includes:

associating the eye data and the ambient light measurement to previous eye data paired with a previous ambient light measurement; and

adjusting the transparency of the lens to a previously selected lens transparency selected by a user, wherein the previously selected lens transparency corresponds to the previous eye data paired with the previous ambient light measurement, and wherein the previous eye data and the previous ambient light measurement were captured by the head mounted device during a same time period.

2 . The method of claim 1 , wherein the eye data includes at least one of a pupil size of an eye, speed of pupil dilation of the eye, a gaze direction of the eye, or eye-movement data.

3 . The method of claim 1 , wherein the eye data includes one or more images of an eye.

4 . The method of claim 3 further comprising:

performing image processing on the one or more images of the eye to determine a heart rate of a user of the head mounted device, wherein adjusting the transparency of the lens is based at least in part on the heart rate of the user.

5 . The method of claim 3 further comprising:

performing image processing on the one or more images of the eye to determine at least one of movement of eyebrows, movement of eyelids, or facial muscle micro gestures, and wherein adjusting the transparency of the lens is based at least in part on the movement of eyebrows, the movement of eyelids, or the facial muscle micro gestures.

6 . A method of operating a head mounted device, the method comprising:

capturing eye data with one or more sensors of the head mounted device, wherein the one or more sensors are configured to sense an eyebox region;

initiating an ambient light measurement with a photodetector of the head mounted device; and

adjusting a brightness of a display of the head mounted device in response to the eye data and the ambient light measurement, wherein adjusting the brightness of the display in response to the eye data and the ambient light measurement includes:

associating the eye data and the ambient light measurement with previous eye data paired with a previous ambient light measurement; and

adjusting the brightness of the display to a previously selected display brightness selected by a user, wherein the previously selected display brightness corresponds to the previous eye data paired with the previous ambient light measurement, and wherein the previous eye data and the previous ambient light measurement were captured by the head mounted device during a same time period.

7 . The method of claim 6 , wherein the eye data includes at least one of a pupil size of an eye, speed of pupil dilation of the eye, a gaze direction of the eye, or eye-movement data.

8 . The method of claim 6 , wherein the eye data includes one or more images of an eye.

9 . The method of claim 8 further comprising:

performing image processing on the one or more images of the eye to determine a heart rate of a user of the head mounted device, wherein adjusting the brightness of the display is based at least in part on the heart rate of the user.

10 . The method of claim 8 further comprising:

performing image processing on the one or more images of the eye to determine at least one of movement of eyebrows, movement of eyelids, or facial muscle micro gestures, and wherein adjusting the brightness of the display is based at least in part on the at least one of movement of eyebrows, movement of eyelids, or the facial muscle micro gestures.

11 . A method of operating a head mounted device, the method comprising:

capturing eye data with one or more sensors of the head mounted device, wherein the one or more sensors are configured to sense an eyebox region;

initiating an ambient noise measurement with a microphone of the head mounted device; and

adjusting a volume of an audio output of the head mounted device, wherein adjusting the volume of the audio output of the head mounted device is in response to the eye data and the ambient noise measurement.

12 . The method of claim 11 , wherein the eye data includes at least one of a pupil size of an eye, speed of pupil dilation of the eye, a gaze direction of the eye, or eye-movement data.

13 . The method of claim 11 , wherein the eye data includes a number of saccades in a time period.

14 . The method of claim 11 , wherein the eye data includes one or more images of an eye.

15 . A method of operating a head mounted device, the method comprising:

capturing eye data with one or more sensors of the head mounted device, wherein the one or more sensors are configured to sense an eyebox region; and

adjusting a volume of an audio output of the head mounted device in response to the eye data, wherein adjusting the volume of the audio output includes adjusting a sound magnitude of speakers of the head mounted device that are oriented to provide sound to ears of a user of the head mounted device.

16 . The method of claim 15 , wherein the eye data includes at least one of a pupil size of an eye, speed of pupil dilation of the eye, a gaze direction of the eye, or eye-movement data.

17 . The method of claim 15 , wherein the eye data includes a number of saccades in a time period.

18 . The method of claim 15 , wherein the eye data includes one or more images of an eye.

Assignments (2)
CHANGE OF NAME Recorded Jun 1, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060246/0845 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2021
From: SZTUK, SEBASTIAN; ESTRADA, SALVAEL ORTEGA
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 057563/0384 →
Continuity (1)
Related Publication 20230071993A1 · Mar 9, 2023