IP Library › Granted Patent US 11,935,442
Granted Patent B1
US 11,935,442 · App. 18/051,330 · Granted Mar 19, 2024

Controlling brightness based on eye tracking

Inventor: Russell Douglas Patton (Playa Vista, CA)
Assignee: SNAP INC.
G09G3/001G02B27/017G06F3/013G02B2027/0118G02B2027/0178G09G2320/0613G09G2320/0686G09G2330/021G09G2340/0407G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,935,442
App. No.
18/051,330
Granted
Mar 19, 2024
Kind
B1
Abstract

Methods and systems are disclosed for performing operations for controlling brightness in an AR device. The operations comprise displaying an image on an eyewear device worn by a user; detecting a gaze direction of a pupil of the user; identifying a first region of the image that corresponds to the gaze direction of the pupil; and modifying a brightness level or value of pixels in the image based on the gaze direction such that pixels in the first region of the image are set to a first brightness value and pixels in a second region of the image are set to a second brightness value that is lower than the first brightness value.

Claims (44)

1. A method comprising:

displaying an image on an eyewear device worn by a user;

detecting a gaze direction of a pupil of the user;

identifying a first region of the image that corresponds to the gaze direction of the pupil; and

modifying a brightness value of pixels in the image based on the gaze direction such that pixels in the first region of the image are set to a first brightness value and pixels in a second region of the image are set to a second brightness value that is lower than the first brightness value, the second brightness value being computed based on a continuous curve relative to the first brightness value.

2. The method of claim 1 , wherein the second region corresponds to a first distance away from the first region of the image towards which the pupil is focused.

3. The method of claim 2 , further comprising:

identifying a third region of the image that corresponds to a second distance away from the first region of the image towards which the pupil is focused, the second distance being greater than the first distance; and

setting pixels in the third region to a third brightness value that is lower than the second brightness value in response to determining that the third region corresponds to the second distance that is greater than the first distance.

4. The method of claim 1 , wherein displaying the image comprises activating one or more light emitting diodes (LEDs) to generate light representing respective pixels of the image.

5. The method of claim 1 , wherein the image is displayed on an additive display device of the eyewear device.

6. The method of claim 1 , wherein the eyewear device comprises an augmented reality device.

7. The method of claim 1 , wherein the eyewear device comprises a virtual reality device.

8. The method of claim 1 , wherein the image corresponds to augmented reality content that is overlayed on a real-world environment being viewed using the eyewear device.

9. The method of claim 1 , wherein power consumed by one or more light emitting diodes (LEDs) associated with the pixels in the second region is lower than power consumed by one or more LEDs associated with the pixels in the first region.

10. The method of claim 1 , further comprising:

interpreting a fovea position corresponding to the first region based on detecting the gaze direction, the brightness value being modified based on the fovea position.

11. The method of claim 1 , further comprising:

determining a type of content being displayed in the second region of the image; and

selecting a minimum value for the second brightness value based on the type of content.

12. The method of claim 11 , further comprising:

determining whether the type of content corresponds to an augmented reality item or a real-world item in the image;

selecting, as the minimum value, a first minimum value in response to determining that the type of content corresponds to an augmented reality item; and

selecting, as the minimum value, a second minimum value in response to determining that the type of content corresponds to a real-world item.

13. The method of claim 12 , wherein the first minimum value is greater than the second minimum value.

14. The method of claim 12 , wherein the second minimum value is greater than the first minimum value.

15. The method of claim 1 , wherein a resolution of the first region matches a resolution of the second region after the brightness value is modified.

16. A system comprising:

at least one processor of an eyewear device; and

a memory component having instructions stored thereon that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:

displaying an image on the eyewear device worn by a user;

detecting a gaze direction of a pupil of the user;

identifying a first region of the image that corresponds to the gaze direction of the pupil; and

modifying a brightness value of pixels in the image based on the gaze direction such that pixels in the first region of the image are set to a first brightness value and pixels in a second region of the image are set to a second brightness value that is lower than the first brightness value, the second brightness value being computed based on a continuous curve relative to the first brightness value.

17. The system of claim 16 , wherein the second region corresponds to a first distance away from the first region of the image towards which the pupil is focused.

18. The system of claim 17 , the operations comprising:

identifying a third region of the image that corresponds to a second distance away from the first region of the image towards which the pupil is focused, the second distance being greater than the first distance; and

setting pixels in the third region to a third brightness value that is lower than the second brightness value in response to determining that the third region corresponds to the second distance that is greater than the first distance.

19. The system of claim 16 , wherein displaying the image comprises activating one or more light emitting diodes (LEDs) to generate light representing respective pixels of the image.

20. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:

displaying an image on an eyewear device worn by a user;

detecting a gaze direction of a pupil of the user;

identifying a first region of the image that corresponds to the gaze direction of the pupil; and

modifying a brightness value of pixels in the image based on the gaze direction such that pixels in the first region of the image are set to a first brightness value and pixels in a second region of the image are set to a second brightness value that is lower than the first brightness value, the second brightness value being computed based on a continuous curve relative to the first brightness value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2022
From: PATTON, RUSSELL DOUGLAS
To: SNAP INC.
Reel/Frame 061599/0971 →
Cited By (2)
US 12,315,412 US 12,481,358