IP Library › Granted Patent US 11,320,900
Granted Patent B2
US 11,320,900 · App. 15/448,402 · Granted May 3, 2022

Current drain reduction in AR/VR display systems

Inventor: Tal Mor (Coral Springs, FL)
Assignee: Magic Leap, Inc.
G06F3/013G06F1/3231G06F1/3265G06F3/0304G09G3/3406G09G3/3648G09G2330/021G09G2340/0435G09G2354/00Y02D10/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,320,900
App. No.
15/448,402
Filed
Mar 2, 2017
Granted
May 3, 2022
Kind
B2
Art Unit
2626
USPC
345/156
Abstract

In some embodiments, eye tracking is used on an AR or VR display system to determine if a user of the display system is blinking or otherwise cannot see. In response, current drain or power usage of a display associated with the display system may be reduced, for example, by dimming or turning off a light source associated with the display, or by configuring a graphics driver to skip a designated number of frames or reduce a refresh rate for a designated period of time.

Claims (75)

1. A display system with reduced power use, the display system comprising:

an inward-facing sensor;

a head-mounted display configured to be worn by a user and disposed on a frame configured to support said display thereon, said display configured to project light into said user's eye to display augmented reality image content to the user's vision field, at least a portion of said display being transparent and disposed at a location in front of the user's eye when the user wears the frame such that said transparent portion transmits light from a portion of an environment in front of the user and said head-mounted display to the user's eye to provide a view of said portion of the environment in front of the user and said head-mounted display; and

processing electronics in communication with the inward-facing sensor and the display, the processing electronics configured to:

detect a first change in a user's eye status using the inward-facing sensor, the first change comprising an indication associated with a closed state of the user's eyes,

detect a second change in a user's eye status, the second change comprising an indication associated with an open state of the user's eyes, and

reduce a current drain of the display system in response to the change in the user's eye status, wherein reducing the current drain of the display comprises configuring a graphics driver associated with the display to reduce an amount of power consumed by the display over multiple frames without turning off the display.

2. The display system of claim 1 , wherein the display comprises a light source, and wherein reducing the current drain of the display further comprises dimming the light source of the display.

3. The display system of claim 1 , wherein the graphics driver is configured to skip a designated number of frames, the designated number of frames based upon a length of time that the user is unable to see.

4. The display system of claim 1 , wherein the processing electronics is configured to reduce the current drain of the display by reducing a refresh rate associated with the display.

5. A method for reducing power use of a display system, comprising:

detecting a first change in a user's eye status using an inward facing sensor, the first change comprising an indication associated with a closed state of the user's eyes,

detecting a second change in a user's eye status, the second change comprising an indication associated with an open state of the user's eyes,

reducing a current drain of the display system in response to detecting the first change in the user's eye status, wherein reducing the current drain of the display comprises configuring a graphics driver associated with a display to reduce an amount of power consumed by the display over multiple frames without turning off the display, and

increasing a current drain of the display system in response to detecting the second change in the user's eye status.

6. The method of claim 5 , wherein the first and second changes in the user's eye status corresponds to a blink.

7. The method of claim 5 , wherein reducing the current drain of the display further comprises turning off a light source.

8. The method of claim 5 , wherein reducing the current drain of the display further comprises dimming a light source of the display.

9. The method of claim 5 , wherein the graphics driver is configured to skip a designated number of frames, the designated number of frames based upon a length of time that the user is unable to see.

10. The method of claim 5 , wherein the graphics driver is configured to further reduce the current drain of the display by reducing a refresh rate associated with the display.

11. A method for reducing power use of a display system, comprising:

detecting a first change in a user's eye status using an inward-facing sensor, the first change comprising an indication associated with a closed state of the user's eyes,

detecting a second change in a user's eye status, the second change comprising an indication associated with an open state of the user's eyes, reducing a current drain of the display system in response to detecting the first change in the user's eye status, wherein reducing the current drain of the display comprises skipping a designated number of frames without turning off the display, the designated number of frames based upon a length of time that the user is unable to see, and

increasing a current drain of the display system in response to detecting the second change in the user's eye status.

12. The method of claim 11 , wherein the first and second changes in the user's eye status corresponds to a blink.

13. The method of claim 11 , wherein reducing the current drain of the display further comprises turning off a light source.

14. The method of claim 11 , wherein reducing the current drain of the display further comprises dimming a light source of the display.

15. The method of claim 11 , wherein reducing the current drain of the display further comprises configuring a graphics driver associated with the display to reduce an amount of power consumed by the display.

16. The method of claim 11 , wherein reducing the current drain of the display further comprises reducing the current drain of the display by reducing a refresh rate associated with the display.

17. A display system with reduced power use, comprising:

an inward-facing sensor;

a display; and

processing electronics in communication with the inward-facing sensor and the display, the processing electronics configured to:

detect a first change in a user's eye status using the inward-facing sensor, the first change comprising an indication associated with a closed state of the user's eyes,

detect a second change in a user's eye status, the second change comprising an indication associated with an open state of the user's eyes,

reduce a current drain of the display system in response to detecting the first change in the user's eye status, wherein reducing the current drain of the display comprises skipping a designated number of frames without turning off the display, the designated number of frames based upon a length of time that the user is unable to see, and

increase a current drain of the display system in response to the detected second change in the user's eye.

18. The display system of claim 17 , wherein the first and second changes in the user's eye status corresponds to a blink.

19. The display system of claim 17 , wherein reducing the current drain of the display further comprises turning off a light source.

20. The display system of claim 17 , wherein reducing the current drain of the display further comprises dimming a light source of the display.

21. The display system of claim 17 , wherein reducing the current drain of the display further comprises configuring a graphics driver associated with the display to reduce an amount of power consumed by the display.

22. The display system of claim 17 , wherein the processing electronics is further configured to reduce the current drain of the display by reducing a refresh rate associated with the display.

23. A method for reducing power use of a display system, comprising:

detecting a first change in a user's eye status using an inward-facing sensor, the first change comprising an indication associated with a closed state of the user's eyes,

detecting a second change in a user's eye status, the second change comprising an indication associated with an open state of the user's eyes,

reducing a current drain of the display system in response to detecting the first change in the user's eye status, wherein reducing the current drain of the display comprises reducing a refresh rate associated with the display without turning off the display, and

increasing a current drain of the display system in response to detecting the second change in the user's eye status.

24. The method of claim 23 , wherein the first and second changes in the user's eye status corresponds to a blink.

25. The method of claim 23 , wherein reducing the current drain of the display further comprises turning off a light source.

26. The method of claim 23 , wherein reducing the current drain of the display further comprises dimming a light source of the display.

27. The method of claim 23 , wherein reducing the current drain of the display further comprises configuring a graphics driver associated with the display to reduce an amount of power consumed by the display.

28. The method of claim 27 , wherein the graphics driver is configured to skip a designated number of frames, the designated number of frames based upon a length of time that the user is unable to see.

29. A display system with reduced power use, comprising:

an inward-facing sensor;

a display; and

processing electronics in communication with the inward-facing sensor and the display, the processing electronics configured to:

detect a first change in a user's eye status using the inward-facing sensor, the first change comprising an indication associated with a closed state of the user's eyes,

detect a second change in a user's eye status, the second change comprising an indication associated with an open state of the user's eyes,

reduce a current drain of the display system in response to detecting the first change in the user's eye status, wherein reducing the current drain of the display comprises reducing a refresh rate associated with the display without turning off the display, and

increase a current drain of the display system in response to the detected second change in the user's eye status.

30. The display system of claim 29 , wherein the first and second changes in the user's eye status corresponds to a blink.

31. The display system of claim 29 , wherein reducing the current drain of the display further comprises turning off a light source.

32. The display system of claim 29 , wherein reducing the current drain of the display further comprises dimming a light source of the display.

33. The display system of claim 29 , wherein reducing the current drain of the display further comprises configuring a graphics driver associated with the display to reduce an amount of power consumed by the display.

34. The display system of claim 33 , wherein the graphics driver is configured to skip a designated number of frames, the designated number of frames based upon a length of time that the user is unable to see.

35. The display system of claim 1 , wherein determining a first change in a user's eye status comprises monitoring images of the iris or pupil obtained by the inward-facing sensor or monitoring contrast in images of the user's eye obtained by the inward-facing sensor.

36. The method of claim 5 , wherein determining a first change in a user's eye status comprises monitoring images of the iris or pupil obtained by the inward-facing sensor or monitoring contrast in images of the user's eye obtained by the inward-facing sensor.

37. The method of claim 11 , wherein determining a first change in a user's eye status comprises monitoring images of the iris or pupil obtained by the inward-facing sensor or monitoring contrast in images of the user's eye obtained by the inward-facing sensor.

38. The display system of claim 17 , wherein determining a first change in a user's eye status comprises monitoring images of the iris or pupil obtained by the inward-facing sensor or monitoring contrast in images of the user's eye obtained by the inward-facing sensor.

39. The method of claim 23 , wherein determining a first change in a user's eye status comprises monitoring images of the iris or pupil obtained by the inward-facing sensor or monitoring contrast in images of the user's eye obtained by the inward-facing sensor.

40. The display system of claim 29 , wherein determining a first change in a user's eye status comprises monitoring images of the iris or pupil obtained by the inward-facing sensor or monitoring contrast in images of the user's eye obtained by the inward-facing sensor.

41. The method of claim 15 , wherein configuring the graphics driver associated with the display to reduce an amount of power consumed by the display comprises reducing an amount of power consumed by the display over multiple frames.

42. The display system of claim 21 , wherein configuring the graphics driver associated with the display to reduce an amount of power consumed by the display comprises reducing an amount of power consumed by the display over multiple frames.

43. The method of claim 27 , wherein configuring the graphics driver associated with the display to reduce an amount of power consumed by the display comprises reducing an amount of power consumed by the display over multiple frames.

44. The display system of claim 33 , wherein configuring the graphics driver associated with the display to reduce an amount of power consumed by the display comprises reducing an amount of power consumed by the display over multiple frames.

Assignments (5)
SECURITY INTEREST Recorded Oct 24, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073255/0581 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2022
From: MOR, TAL
To: MAGIC LEAP, INC.
Reel/Frame 058579/0567 →
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2018
From: MOR, TAL
To: MAGIC LEAP, INC.
Reel/Frame 046689/0115 →
Continuity (2)
Provisional Application 62304098 · Mar 4, 2016
Related Publication 20170255259A1 · Sep 7, 2017
Cited By (4)
US 12,205,545 US 12,229,337 US 12,607,859 US 12,632,108