IP Library › Granted Patent US 12,008,977
Granted Patent B2
US 12,008,977 · App. 17/658,542 · Granted Jun 11, 2024

Personalized display brightness based on pupil size

Inventors: Shivendra Singh (Hyderabad, IN); Siva Ramesh Kumar Andey (Hyderabad, IN); Dinesh Singh Lourembam (Hyderabad, IN)
Assignee: QUALCOMM Incorporated
G09G5/10A61B3/112G09G2320/0626G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,008,977
App. No.
17/658,542
Granted
Jun 11, 2024
Kind
B2
Abstract

In some aspects, a device may calibrate a brightness setting of the device for a user based on: displaying, by the device, first calibration content and modifying a luminance of a display while displaying the first calibration screen until a pupil size of the user satisfies a first target pupil size; and displaying, by the device, second calibration content and modifying the luminance of the display while displaying the second calibration screen until the pupil size of the user satisfies a second target pupil size. The device may calculate a metric value based upon pixel values of content to be displayed. The device may display, using a luminance that is adjusted based on the metric and in accordance with the brightness setting, the content. Numerous other aspects are described.

Claims (107)

1. A method, comprising:

determining, by a device, a first calibrated brightness value for a display that is displaying bright content based at least in part on:

displaying, by the device, first calibration content that includes one or more first calibration frames with a first background that approximately corresponds to white, and

adjusting, by the device and while the first calibration content is displayed, a first brightness value of the display until a first measured pupil size of a user of the display matches a first target pupil size, wherein the first calibrated brightness value is based at least in part on the first brightness value of the display when the first measured pupil size of the user matches the first target pupil size;

determining, by the device, a second calibrated brightness value for the display that is displaying dark content based at least in part on:

displaying, by the device, second calibration content that includes one or more second calibration frames with a second background that approximately corresponds to black, and

adjusting, by the device and while the second calibration content is displayed, a second brightness value of the display until a second measured pupil size of the user matches a second target pupil size, wherein the second calibrated brightness value is based at least in part on the second brightness value of the display when the second measured pupil size of the user matches the second target pupil size;

calculating, by the device, a metric value for content to be displayed based upon pixel values of the content; and

adjusting, by the device, a brightness value of the display based at least in part on the first calibrated brightness value, the second calibrated brightness value, and the metric value.

2. The method of claim 1 , wherein adjusting the first brightness value of the display until the first measured pupil size of the user matches the first target pupil size comprises:

repeatedly adjusting the first brightness value of the display while the first calibration content is displayed; and

measuring a first pupil size of the user after each adjustment of the first brightness value.

3. The method of claim 1 , further comprising:

receiving a user input indicating a modification to at least one of the first calibrated brightness value or the second calibrated brightness value; and

adjusting the at least one of the first calibrated brightness value or the second calibrated brightness value based at least in part on the user input.

4. The method of claim 1 , wherein the one or more first calibration frames include the first background having a first pixel value and a first animation having a second pixel value; and

wherein the one or more second calibration frames include the second background having a third pixel value and a second animation having a fourth pixel value.

5. The method of claim 4 , wherein the first pixel value is greater than the third pixel value.

6. The method of claim 1 , wherein calculating the metric value for the content to be displayed comprises:

calculating, for one or more frames of the content, a frame metric value based on respective pixel values of the one or more frames; and

calculating the metric value for the content to be displayed based on an average of the frame metric values of the one or more frames.

7. The method of claim 1 , wherein adjusting the brightness value comprises:

calculating a first metric value for the first calibration content and a second metric value for the second calibration content;

determining a relationship between the metric value for the content to be displayed, the first metric value for the first calibration content, and the second metric value for the second calibration content; and

determining the brightness value of the display for displaying the content based on the first calibrated brightness value, the second calibrated brightness value, and the relationship.

8. The method of claim 1 , further comprising:

displaying the content using the adjusted brightness value.

9. The method of claim 1 , further comprising:

determining that the first brightness value and the second brightness value of the display can be calibrated and adjusted using a pupil size of the user based at least in part on a dilation time associated with a dilation of a pupil of the user.

10. The method of claim 1 , further comprising:

displaying the content using the adjusted brightness value; and

measuring a pupil size of the user, after displaying the content using the adjusted brightness value, to confirm whether the adjusted brightness value is correctly calibrated for the user.

11. A device, comprising:

one or more memories; and

one or more processors, coupled to the one or more memories, configured to:

obtain a brightness setting of a display screen associated with the device for a user based at least in part on:

displaying first calibration content that includes one or more first calibration frames with a first background that approximately corresponds to white, and modifying a luminance of the display screen of the device while displaying the first calibration content until a pupil size of the user satisfies a first target pupil size, and

displaying second calibration content that includes one or more second calibration frames with a second background that approximately corresponds to black, and modifying the luminance of the display screen while displaying the second calibration content until the pupil size of the user satisfies a second target pupil size;

calculate a metric value based at least in part on pixel values of content to be displayed;

adjust the luminance for the display screen based at least in part on the metric value and in accordance with the brightness setting; and

display, via the display screen and using the adjusted luminance, the content.

12. The device of claim 11 , wherein the brightness setting includes a first pupil size and a first luminance of the display screen optimized for the user for the first calibration content, and a second pupil size and a second luminance of the display screen optimized for the user for the second calibration content.

13. The device of claim 12 , wherein the one or more processors, to adjust the luminance, are configured to:

determine a relationship between the metric value, a first pixel value associated with the first calibration content, and a second pixel value associated with the second calibration content; and

determine the luminance for the display screen based at least in part on the first luminance, the second luminance, and the relationship.

14. The device of claim 12 , wherein the one or more processors are further configured to:

measure the pupil size of the user after displaying the content using the adjusted luminance;

determine whether the brightness setting is accurate for the user based at least in part on the pupil size of the user after displaying the content, the first pupil size, and the second pupil size; and

re-calibrate the brightness setting based at least in part on determining that the brightness setting is not accurate.

15. The device of claim 11 , wherein the one or more processors, to obtain the brightness setting, are configured to:

display the one or more first calibration frames with the first background having a first pixel value and a first animation having a second pixel value; and

display the one or more second calibration frames with the second background having a third pixel value and a second animation having a fourth pixel value.

16. The device of claim 11 , wherein the one or more processors, to obtain the brightness setting, are configured to:

receive a user input indicating an adjustment to at least one of:

a first luminance of the display screen calibrated for the first calibration content, or

a second luminance of the display screen calibrated for the second calibration content,

wherein the brightness setting is based at least in part on the user input.

17. The device of claim 11 , wherein the one or more processors, to obtain the brightness setting, are configured to:

display the first calibration content using a first luminance of the display screen for a first interval of time;

measure the pupil size of the user after the first interval of time; and

display the first calibration content using a second luminance of the display screen for a second interval of time based at least in part on a difference between the pupil size of the user after the first interval and the first target pupil size not satisfying a threshold.

18. The device of claim 11 , wherein the one or more processors, to calculate the metric value, are configured to:

calculate, for a set of pixels of a frame of the content, a set of pixel values based at least in part on red, green, and blue (RGB) triplet values associated with the set of pixels;

calculate, for the frame, a frame pixel value based at least in part on the set of pixel values; and

calculate the metric value based at least in part on averaging frame pixel values, including the frame pixel value, of one or more frames, including the frame, of the content.

19. The device of claim 11 , wherein the metric value includes at least one of:

a statistical average of the pixel values of the content,

a first average pixel value of the content,

a local maximum of pixel values of the content in a region of interest,

a local minimum of the pixel values of the content in the region of interest, or

a second average pixel value of the pixel values of the content in the region of interest.

20. The device of claim 11 , wherein the one or more processors are further configured to:

determine whether the device is enabled to calibrate the brightness setting using the pupil size of the user based at least in part on comparing an amount of time that a pupil of the user takes to dilate to a dilation time.

21. The device of claim 11 , wherein the one or more processors are further configured to:

store the brightness setting as being associated with a user profile associated with the user;

receive a credential associated with the user profile; and

load the brightness setting for a session associated with the user profile based on authenticating the credential.

22. A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising:

one or more instructions that, when executed by one or more processors of a device, cause the device to:

calibrate a brightness setting of the device for a user based at least in part on:

displaying first calibration content that includes one or more first calibration frames with a first background that approximately corresponds to white while adjusting a first brightness value of a display screen of the device to be a first calibrated brightness value that achieves a first target pupil size of the user,

displaying second calibration content that includes one or more second calibration frames with a second background that approximately corresponds to black while adjusting a second brightness value of the display screen of the device to be a second calibrated brightness value that achieves a second target pupil size of the user, and

displaying a user input option to adjust at least one of the first calibrated brightness value or the second calibrated brightness value;

calculate a metric value based at least in part on pixel values of content to be displayed; and

display, via the display screen and using an adjusted brightness value, the content, wherein the adjusted brightness value is based at least in part on the metric value and is adjusted in accordance with the brightness setting.

23. The non-transitory computer-readable medium of claim 22 , wherein the brightness setting includes a first pupil size and the first calibrated brightness value optimized for the user for the first calibration content, and a second pupil size and the second calibrated brightness value for the user for the second calibration content.

24. The non-transitory computer-readable medium of claim 23 , wherein the one or more instructions, when executed by the one or more processors of the device, further cause the device to:

determine a relationship between the metric value, a first pixel value associated with the first calibration content, and a second pixel value associated with the second calibration content; and

determine the adjusted brightness value based at least in part on the first calibrated brightness value, the second calibrated brightness value, and the relationship.

25. The non-transitory computer-readable medium of claim 22 , wherein the first target pupil size is an optimized pupil size for bright light environments, and wherein the second target pupil size is an optimized pupil size for dark environments.

26. The non-transitory computer-readable medium of claim 22 , wherein the one or more instructions, that cause the device to display the content, cause the device to:

determine the adjusted brightness value of the display screen based at least in part on the metric value and the brightness setting and without measuring a pupil size of the user after calibrating the brightness setting.

27. An apparatus, comprising:

means for calibrating a brightness setting of the apparatus for a user based at least in part on:

displaying first calibration content that includes one or more first calibration frames with a first background that approximately corresponds to white and modifying a luminance of a display screen of the apparatus while displaying the first calibration content until a pupil size of the user satisfies a first target pupil size, and

displaying second calibration content that includes one or more second calibration frames with a second background that approximately corresponds to black, and

modifying the luminance of the display screen while displaying the second calibration content until the pupil size of the user reaches a second target pupil size;

means for calculating a metric value based at least in part on pixel values of content to be displayed by the apparatus; and

means for adjusting the luminance for the display screen based at least in part on the metric value and in accordance with the brightness setting.

28. The apparatus of claim 27 , wherein the brightness setting includes a first pupil size and a first luminance of the display screen optimized for the user for a first brightness value of the first calibration content, and a second pupil size and a second luminance of the display screen optimized for the user for a second brightness value of the second calibration content.

29. The apparatus of claim 28 , wherein the means for adjusting the luminance for the display screen comprise:

means for determining a relationship between the metric value, a first pixel value associated with the first calibration content, and a second pixel value associated with the second calibration content; and

means for determining the luminance for the display screen based at least in part on the first luminance, the second luminance, and the relationship.

30. The apparatus of claim 28 , further comprising:

means for measuring the pupil size of the user after displaying the content using the adjusted luminance;

means for determining whether the brightness setting is accurate for the user based at least in part on the pupil size of the user after displaying the content, the first pupil size, and the second pupil size; and

means for re-calibrating the brightness setting based at least in part on determining that the brightness setting is not accurate.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2022
From: SINGH, SHIVENDRA; ANDEY, SIVA RAMESH KUMAR; LOUREMBAM, DINESH SINGH
To: QUALCOMM INCORPORATED
Reel/Frame 059730/0495 →
Continuity (1)
Related Publication 20230326427A1 · Oct 12, 2023