IP Library Granted Patent US 11,579,441
Granted Patent B2
US 11,579,441 · App. 17/256,961 · Granted Feb 14, 2023

Pixel intensity modulation using modifying gain values

Inventors: Richard Stephen Johnston (Sammamish, WA); Brian T. Schowengerdt (Seattle, WA)
Assignee: Magic Leap, Inc.
G02B26/103G06V40/18G09G3/002G02B2027/0118G02B2027/0187G09G2320/0285
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,579,441
App. No.
17/256,961
Filed
Dec 29, 2020
Granted
Feb 14, 2023
Kind
B2
Art Unit
2487
USPC
348/78
Abstract

A visual perception device has a look-up table stored in a laser driver chip. The look-up table includes relational gain data to compensate for brighter areas of a laser pattern wherein pixels are located more closely than areas where the pixels are further apart and to compensate for differences in intensity of individual pixels when the intensities of pixels are altered due to design characteristics of an eye piece.

Claims (54)

1. A visual perception device comprising:

a data store;

relational gain data stored in the data store and representing a plurality of reference locations and a plurality of gain values, each gain value corresponding to a respective reference location;

a video data receiver connectable to a video data channel to receive video data including a plurality of pixels;

a correlator connected to the relational gain data and the video data receiver and operable to correlate each pixel with a reference location in the relational gain data to find a gain value corresponding to the respective pixel;

a beam modulator connected to the video data receiver and the correlator and operable to modify an intensity value of the respective pixel based on the gain value for the respective pixel to determine a modulated gain value for the respective pixel; and a laser projector connected to the beam modulator and operable to generate a plurality of beams of light, each respective beam of light corresponding to the modulated gain value of each respective pixel, the laser projector transmitting the beams of light in a two-dimensional pattern wherein the beams of light are spatially separated, wherein first and second adjacent light beams in the pattern are further from one another than third and fourth light beams in the pattern and the gain values create more intensity for the first and second light beams than for the third and fourth light beams.

2. The device of claim 1 , further comprising:

a look-up table, wherein the relational gain data is stored in the look-up table.

3. The device of claim 1 , wherein the correlator is a pixel counter that counts the pixels in the video data and determines a respective reference location in the reference data based on the counting of the pixels, the relational gain data includes three different gain values for each reference location, each gain value corresponding to a different color, the video data includes a plurality of pixels for each of the three colors, and pixels of all three colors are correlated with reference locations in the relational gain data to find a gain value corresponding to the respective pixel.

4. The device of claim 1 , wherein the reference locations correspond to the pattern that is created by the projector.

5. The device of claim 1 , wherein the laser projector travels faster from the first light beam to the second light beam in the pattern than from the third light beam to the fourth light beam in the pattern.

6. The device of claim 1 , wherein the pattern is a spiral pattern and the first and second light beams are in an outer region of the pattern compared to the third and fourth light beams in the pattern.

7. The device of claim 1 , further comprising:

an eye piece, the beams entering the eye piece, reflecting within the eye piece and exiting the eye piece, wherein the eye piece alters an intensity of the beams relative to one another and the gain values compensate for the eye piece altering the intensity of the beams relative to one another.

8. The device of claim 1 , wherein each pixel in the video data has as respective intensity value and the gain value in the relational data is a gain value that the beam modulator uses to modify the intensity value in the video data.

9. The device of claim 8 , further comprising:

a background camera that captures a background; and

a background analyzer connected to the background camera that determines at least one gain value based on the background, wherein the beam modulator uses the gain value based on the background to modify the intensity value in the video data.

10. The device of claim 9 , wherein the background analyzer determines at least a first gain value for a lighter area of the background and a second gain value for a darker area of the background and the modulator modifies the intensity value of respective pixels such that a pixel in the lighter area of the background has more intensity than a pixel in a darker area of the background.

11. The device of claim 8 , further comprising:

an eye camera that captures an eye; and

an eye analyzer connected to the eye camera that determines at least one gain value based on a gaze direction of a pupil of the eye, wherein the beam modulator uses the gain value based on the gaze direction of the pupil to modify the intensity value in the video data such that pixels in a gaze direction of the pupil have more intensity than pixels distant from the pupil.

12. The device of claim 11 , wherein the beam modulator reduces an intensity of pixels distant from the gaze direction of the pupil.

13. The device of claim 1 , wherein the beam modulator includes:

a video data digital-to-analog converter (VDAC) that receives the video data;

a gain digital-to-analog converter (GDAC) having an input for receiving a gain setting and an output connected to the VDAC to set a gain on the VDAC; and

a multiplier connected to the relational data to modify an output of the VDAC.

14. The device of claim 13 , wherein the multiplier multiplies the gain that is provided to the GDAC with the gain values of the pixels to modulate the gain that is provided to the GDAC.

15. The device of claim 13 , wherein the multiplier multiplies the gain that is provided to the VDAC with the gain values of the pixels to modulate the gain that is provided to the VDAC.

16. The device of claim 15 , wherein the VDAC is a first VDAC, further comprising:

a second VDAC, wherein the multiplier multiplies the gain that is provided to the second VDAC with the gain values of the pixels to modulate the gain that is provided to the VDAC; and

first and second current sources connected to and driven by the first and second VDAC's respectively, the current sources being connected in parallel.

17. The device of claim 1 further comprising:

a laser driver chip, wherein the beam modulator and the relational gain data are located on the laser driver chip.

18. A method of creating an image comprising: storing relational gain data representing a plurality of reference locations and a plurality of gain values, each gain value corresponding to a respective reference location; receiving video data including a plurality of pixels over a video data channel; correlating each pixel with a reference location in the relational gain data to find a gain value corresponding to the respective pixel; gaining an intensity value of the respective pixel based on the gain value for the respective pixel to determine a modulated gain for the respective pixel; and generating a plurality of beams of light, each respective beam of light corresponding to the modulated gain value of each respective pixel; and transmitting the beams of light in a two-dimensional pattern wherein the beams of light are spatially separated, wherein first and second adjacent light beams in the pattern are further from one another than third and fourth light beams in the pattern and the gain values create more intensity for the first and second light beams than for the third and fourth light beams.

19. A visual perception device comprising:

a data store;

relational gain data stored in the data store and representing a plurality of reference locations and a plurality of gain values, each gain value corresponding to a respective reference location;

a video data receiver connectable to a video data channel to receive video data including a plurality of pixels;

a correlator connected to the relational gain data and the video data receiver and operable to correlate each pixel with a reference location in the relational gain data to find a gain value corresponding to the respective pixel;

a background camera that captures a background;

a background analyzer connected to the background camera that determines at least one gain value based on the background;

a beam modulator connected to the video data receiver and the correlator and operable to modify an intensity value of the respective pixel based on the gain value for the respective pixel to determine a modulated gain value for the respective pixel wherein the beam modulator uses the gain value based on the background to modify the intensity value in the video data; and

a laser projector connected to the beam modulator and operable to generate a plurality of beams of light, each respective beam of light corresponding to the modulated gain value of each respective pixel, the laser projector transmitting the beams of light in a two-dimensional pattern wherein the beams of light are spatially separated.

20. A visual perception device comprising:

a data store;

relational gain data stored in the data store and representing a plurality of reference locations and a plurality of gain values, each gain value corresponding to a respective reference location;

a video data receiver connectable to a video data channel to receive video data including a plurality of pixels;

a correlator connected to the relational gain data and the video data receiver and operable to correlate each pixel with a reference location in the relational gain data to find a gain value corresponding to the respective pixel;

a beam modulator connected to the video data receiver and the correlator and operable to modify an intensity value of the respective pixel based on the gain value for the respective pixel to determine a modulated gain value for the respective pixel, wherein the beam modulator includes:

a video data digital-to-analog converter (VDAC) that receives the video data;

a gain digital-to-analog converter (GDAC) having an input for receiving a gain setting and an output connected to the VDAC to set a gain on the VDAC; and

a multiplier connected to the relational data to modify an output of the VDAC; and

a laser projector connected to the beam modulator and operable to generate a plurality of beams of light, each respective beam of light corresponding to the modulated gain value of each respective pixel, the laser projector transmitting the beams of light in a two-dimensional pattern wherein the beams of light are spatially separated.

Assignments (3)
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0476 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2021
From: JOHNSTON, RICHARD STEPHEN; SCHOWENGERDT, BRIAN T.
To: MAGIC LEAP, INC.
Reel/Frame 055553/0357 →
Continuity (2)
Provisional Application 62693228 · Jul 2, 2018
Related Publication 20210181500A1 · Jun 17, 2021