IP Library › Granted Patent US 12,277,269
Granted Patent B2
US 12,277,269 · App. 18/588,891 · Granted Apr 15, 2025

Control method and device for near eye display system

Inventors: John D. Le (Woodbury, MN); Kun Gao (Palo Alto, CA); Yi Zhang (Palo Alto, CA); Youngshik Yoon (Palo Alto, CA); Hao Zheng (Palo Alto, CA); Hongdong Li (Palo Alto, CA); Jianru Shi (Palo Alto, CA)
G06F3/013G09G3/001G09G2320/0686G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,277,269
App. No.
18/588,891
Granted
Apr 15, 2025
Kind
B2
Abstract

A method for controlling a near eye display system, includes determining a target area of a display of the near eye display system, the target area of the display being an area that a user wearing the near eye display system is looking at, and controlling a brightness of the target area of the display of the near eye display system to be different from a brightness of a non-target area of the display of the near eye display system, to cause a diameter of a pupil of the user to be less than or equal to a diameter threshold.

Claims (55)

1. A method for controlling a near eye display system, comprising:

determining a target area of a display of the near eye display system, the target area of the display being an area that a user wearing the near eye display system is looking at; and

controlling a brightness of the target area of the display of the near eye display system to be different from a brightness of a non-target area of the display of the near eye display system, to cause a diameter of a pupil of the user to be less than or equal to a diameter threshold.

2. The method of claim 1 , wherein determining the target area of the display includes:

obtaining an eye movement of the user; and

determining the target area of the display based on the eye movement of the user.

3. The method of claim 2 , wherein obtaining the eye movement of the user includes:

obtaining a gaze direction of an eye of the user using a sensor.

4. The method of claim 3 , wherein determining the target area of the display based on the eye movement of the user includes:

determining the target area of the display based on the gaze direction of the eye of the user and a distance between the eye of the user and the display of the near eye display system.

5. The method of claim 4 , further comprising:

obtaining the distance between the eye of the user and the display of the near eye display system.

6. The method of claim 1 , further comprising:

updating the target area of the display of the near eye display system based on an eye movement of the user in real time.

7. The method of claim 1 , wherein controlling the brightness of the target area of the display of the near eye display system to be different from the brightness of the non-target area of the display of the near eye display system includes:

determining a program activated in the near eye display system for displaying on the display; and

in response to determining that the program activated is an office-type program, controlling the brightness of the target area of the display of the near eye display system to be different from the brightness of the non-target area of the display of the near eye display.

8. The method of claim 7 , further comprising:

in response to determining that the program activated is a game program or a movie program, controlling the brightness of the target area of the display to be equal to the brightness of the non-target area of the display.

9. The method of claim 1 , wherein controlling the brightness of the target area of the display of the near eye display system to be different from the brightness of the non-target area of the display of the near eye display system includes:

controlling the brightness of the target area of the display of the near eye display system to be higher than the brightness of the non-target area of the display of the near eye display system.

10. The method of claim 1 , wherein:

the target area of the display is a first area;

controlling the brightness of the target area of the display of the near eye display system to be different from the brightness of the non-target area of the display of the near eye display system includes:

determining a second area of the display of the near eye display system, the second area surrounding the first area;

controlling the brightness of the first area of the display to be a first brightness value;

controlling a brightness of the second area of the display to be a second brightness value, the second brightness value being lower than the first brightness value; and

controlling a brightness of a third area of the display of the near eye display system to be a third brightness value, the third area being different from the first area and the second area, and the third brightness value being lower than the second brightness value.

11. The method of claim 1 , wherein the diameter threshold is 4 mm.

12. The method of claim 1 , wherein controlling the brightness of the target area of the display of the near eye display system to be different from the brightness of the non-target area of the display of the near eye display system includes:

obtaining a current diameter of the pupil of the user using a sensor; and

in response to determining that the current diameter of the pupil of the user is larger than the diameter threshold, controlling the brightness of the target area of the display of the near eye display system to be different from the brightness of the non-target area of the display of the near eye display system based on the current diameter of the pupil of the user, to cause the diameter of the pupil of the user to be less than or equal to the diameter threshold.

13. The method of claim 12 , wherein controlling the brightness of the target area of the display of the near eye display system to be different from the brightness of the non-target area of the display of the near eye display system further includes:

determining a target brightness of the display based on the diameter threshold and the current diameter of the pupil of the user; and

controlling the brightness of the target area of the display of the near eye display system to be equal to the target brightness.

14. A device for controlling a near eye display system, the near eye display system including a display, the device comprising:

a memory storing a computer program; and

a processor configure to execute the computer program to:

determine a target area of the display of the near eye display system, the target area of the display being an area that a user wearing the near eye display system is looking at; and

control a brightness of the target area of the display of the near eye display system to be different from a brightness of a non-target area of the display of the near eye display system, to cause a diameter of a pupil of the user to be less than or equal to a diameter threshold.

15. The device of claim 14 , wherein the processor is further configured to execute the computer program to:

obtain an eye movement of the user; and

determine the target area of the display based on the eye movement of the user.

16. The device of claim 14 , wherein the processor is further configured to execute the computer program to:

obtain a gaze direction of an eye of the user using a sensor.

17. The device of claim 14 , wherein the processor is further configured to execute the computer program to:

determine a program activated in the near eye display system for displaying on the display; and

in response to determining that the program activated is an office-type program, control the brightness of the target area of the display of the near eye display system to be different from the brightness of the non-target area of the display of the near eye display.

18. The device of claim 17 , wherein the processor is further configured to execute the computer program to:

in response to determining that the program activated is a game program or a movie program, control the brightness of the target area of the display to be equal to the brightness of the non-target area of the display.

19. The device of claim 14 , wherein the processor is further configured to:

control the brightness of the target area of the display of the near eye display system to be higher than the brightness of the non-target area of the display of the near eye display system.

20. A non-transitory computer-readable storage medium storing computer instructions that, when executed by a processor, causing the processor to perform:

determining a target area of a display of the near eye display system, the target area of the display being an area that a user wearing the near eye display system is looking at; and

controlling a brightness of the target area of the display of the near eye display system to be different from a brightness of a non-target area of the display of the near eye display system, to cause a diameter of a pupil of the user to be less than or equal to a diameter threshold.

Continuity (2)
Continuation 18186556 · Mar 20, 2023
Related Publication 20240319787A1 · Sep 26, 2024
References Cited (20)
US 9965030B2 · Jeong · 2018 [cited by applicant]
US 10216267B2 · Thorn et al. · 2019 [cited by applicant]
US 10303250B2 · Jeong · 2019 [cited by applicant]
US 10712817B1 · Rönngren · 2020 [cited by applicant]
US 10719127B1 · Keith · 2020 [cited by applicant]
US 10983593B2 · Jeong · 2021 [cited by applicant]
US 20160034032A1 · Jeong · 2016 [cited by applicant]
US 20160291690A1 · Thorn et al. · 2016 [cited by applicant]
US 20180136719A1 · Chen · 2018 [cited by applicant]
US 20180188803A1 · Sharma et al. · 2018 [cited by applicant]
US 20180224934A1 · Jeong · 2018 [cited by applicant]
US 20180286070A1 · Benedetto · 2018 [cited by applicant]
US 20190235625A1 · Jeong · 2019 [cited by applicant]
US 20190286227A1 · Samadani et al. · 2019 [cited by applicant]
US 20200341547A1 · Samadani et al. · 2020 [cited by applicant]
US 20220197377A1 · Kim et al. · 2022 [cited by applicant]
US 20230196522A1 · Weinstock et al. · 2023 [cited by applicant]
Artal, P. and Navarro, R., 1994. Monochromatic modulation transfer function of the human eye for different pupil diameters: an analytical expression. JOSA A, 11(1), pp. 246-249. [cited by applicant]
Napieralski, P. and Rynkiewicz, F., 2019. Modeling human pupil dilation to decouple the pupillary light reflex. Open Physics, 17(1), pp. 458-467. [cited by applicant]
Goldman, D.B., 2010. Vignette and exposure calibration and compensation. IEEE transactions on pattern analysis and machine intelligence, 32(12), pp. 2276-2288. [cited by applicant]