IP Library Granted Patent US 11,676,333
Granted Patent B2
US 11,676,333 · App. 17/895,313 · Granted Jun 13, 2023

Spatially-resolved dynamic dimming for augmented reality device

Inventors: Vaibhav Mathur (Weston, FL); David Manly (Fort Lauderdale, FL); Jahja I. Trisnadi (Cupertino, CA); Clinton Carlisle (Parkland, FL); Lionel Ernest Edwin (Hollywood, FL); Michael Anthony Klug (Austin, TX)
Assignee: Magic Leap, Inc.
G06T15/506G02B27/0172G06F3/013G06T15/80G02B2027/0118G02B2027/0178G06T2215/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,676,333
App. No.
17/895,313
Granted
Jun 13, 2023
Kind
B2
Abstract

Techniques are described for operating an optical system. In some embodiments, light associated with a world object is received at the optical system. Virtual image light is projected onto an eyepiece of the optical system. A portion of a system field of view of the optical system to be at least partially dimmed is determined based on information detected by the optical system. A plurality of spatially-resolved dimming values for the portion of the system field of view may be determined based on the detected information. The detected information may include light information, gaze information, and/or image information. A dimmer of the optical system may be adjusted to reduce an intensity of light associated with the world object in the portion of the system field of view according to the plurality of dimming values.

Claims (43)

1. A method of operating an optical system, the method comprising:

receiving, at the optical system, light associated with a world object;

generating a desired pixelated mask at a depth from the optical system;

deconvolving the desired pixelated mask using a power spectral density (PSF) of a pixel of a dimmer of the optical system to obtain a deconvolved pixelated mask; and

adjusting the dimmer based on the deconvolved pixelated mask to reduce an intensity of the light associated with the world object in accordance with the deconvolved pixelated mask.

2. The method of claim 1 , further comprising:

estimating the PSF of the pixel based on a size of the pixel.

3. The method of claim 2 , further comprising:

detecting a diameter of a pupil of an eye of a user using a sensor of the optical system, wherein the PSF of the pixel is estimated further based on the diameter of the pupil.

4. The method of claim 2 , further comprising:

detecting an accommodative state of an eye of a user using a sensor of the optical system, wherein the PSF of the pixel is estimated further based on the accommodative state of the eye.

5. The method of claim 2 , wherein the PSF of the pixel is estimated further based on a distance between an eye of a user and the pixel.

6. The method of claim 1 , wherein the depth is the depth at which virtual content is to be perceived by a user.

7. The method of claim 6 , further comprising:

projecting virtual image light onto an eyepiece of the optical system to cause the user to perceive the virtual content.

8. The method of claim 1 , wherein the dimmer comprises a plurality of pixels including the pixel.

9. A non-transitory computer-readable medium comprising instructions that, when executed by a processor, cause the processor to perform operations comprising:

generating a desired pixelated mask at a depth from an optical system, wherein the optical system is configured to receive light associated with a world object;

deconvolving the desired pixelated mask using a power spectral density (PSF) of a pixel of a dimmer of the optical system to obtain a deconvolved pixelated mask; and

adjusting the dimmer based on the deconvolved pixelated mask to reduce an intensity of the light associated with the world object in accordance with the deconvolved pixelated mask.

10. The non-transitory computer-readable medium of claim 9 , wherein the operations further comprise:

estimating the PSF of the pixel based on a size of the pixel.

11. The non-transitory computer-readable medium of claim 10 , wherein the operations further comprise:

detecting a diameter of a pupil of an eye of a user using a sensor of the optical system, wherein the PSF of the pixel is estimated further based on the diameter of the pupil.

12. The non-transitory computer-readable medium of claim 10 , wherein the operations further comprise:

detecting an accommodative state of an eye of a user using a sensor of the optical system, wherein the PSF of the pixel is estimated further based on the accommodative state of the eye.

13. The non-transitory computer-readable medium of claim 10 , wherein the PSF of the pixel is estimated further based on a distance between an eye of a user and the pixel.

14. The non-transitory computer-readable medium of claim 9 , wherein the depth is the depth at which virtual content is to be perceived by a user.

15. The non-transitory computer-readable medium of claim 14 , wherein the operations further comprise:

causing virtual image light to be projected onto an eyepiece of the optical system to cause the user to perceive the virtual content.

16. The non-transitory computer-readable medium of claim 9 , wherein the dimmer comprises a plurality of pixels including the pixel.

17. An optical system comprising:

a dimmer configured to dim light associated with a world object, the dimmer comprising a plurality of pixels; and

a processor communicatively coupled to the dimmer, wherein the processor is configured to perform operations comprising:

generating a desired pixelated mask at a depth from the optical system;

deconvolving the desired pixelated mask using a power spectral density (PSF) of a pixel of the dimmer to obtain a deconvolved pixelated mask; and

adjusting the dimmer based on the deconvolved pixelated mask to reduce an intensity of the light associated with the world object in accordance with the deconvolved pixelated mask.

18. The optical system of claim 17 , wherein the operations further comprise:

estimating the PSF of the pixel based on a size of the pixel.

19. The optical system of claim 18 , wherein the operations further comprise:

detecting a diameter of a pupil of an eye of a user using a sensor of the optical system, wherein the PSF of the pixel is estimated further based on the diameter of the pupil.

20. The optical system of claim 18 , wherein the operations further comprise:

detecting an accommodative state of an eye of a user using a sensor of the optical system, wherein the PSF of the pixel is estimated further based on the accommodative state of the eye.

Assignments (3)
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0238 →
SECURITY INTEREST Recorded Feb 7, 2023
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 062681/0065 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 15, 2022
From: MATHUR, VAIBHAV; MANLY, DAVID; TRISNADI, JAHJA I; EDWIN, LIONEL ERNEST; KLUG, MICHAEL ANTHONY; CARLISLE, CLINTON
To: MAGIC LEAP, INC.
Reel/Frame 061781/0296 →