IP Library Granted Patent US 10,534,173
Granted Patent B2
US 10,534,173 · App. 15/065,813 · Granted Jan 14, 2020

Display with a tunable mask for augmented reality

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,534,173
App. No.
15/065,813
Granted
Jan 14, 2020
Kind
B2
Abstract

A display device includes a two-dimensional array of tiles. Each tile includes a two-dimensional array of pixels and a two-dimensional array of tunable masks. Each pixel is configured to output light so that the two-dimensional array of pixels outputs a respective pattern of light. The two-dimensional array of tunable masks is configured to conditionally block transmission of light for displaying an augmented reality image.

Claims (86)

1. A display device, comprising:

an eye tracking module configured to determine a first location of a pupil of an eye of a user at a first time;

a two-dimensional array of tiles, each tile comprising:

a two-dimensional array of pixels, wherein each pixel is configured to output light so that the two-dimensional array of pixels outputs a respective pattern of light; and

a lens, of a two-dimensional array of lenses, positioned on a first side of the two-dimensional array of pixels and configured to direct at least a portion of the respective pattern of light from the two-dimensional array of pixels to the pupil of an eye of a user;

a two-dimensional array of tunable masks configured to conditionally block transmission of external light, the two-dimensional array of tunable masks positioned on a second side of the two-dimensional array of pixels, opposite to the first side of the two-dimensional array of pixels, wherein each tunable mask of the two-dimensional array of tunable masks corresponds to a single tile of the two-dimensional array of tiles; and

one or more processors coupled with the two-dimensional array of tiles and configured to:

select, based on the first location of the pupil of the eye of the user, a first subset of the two-dimensional array of tiles and a first subset of the two-dimensional array of tunable masks;

activate the first subset of the two-dimensional array of tiles for outputting, from at least the first subset of the two-dimensional array of tiles, a collective pattern of light that is directed to the first location of the pupil of the eye of the user, the first subset of the two-dimensional array of tiles including two or more contiguous tiles, a first tile of the two or more contiguous tiles outputting a first portion of an image and a second tile, adjacent to the first tile, of the two or more contiguous tiles outputting a second portion of the image that does not overlap with the first portion of the image, wherein each pixel of the first subset of the two-dimensional array of tiles outputs light at least a portion of which is directed to the first location of the pupil of the eye of the user; and

initiate the first subset of the two-dimensional array of tunable masks to block transmission of at least a first portion of external light from entering the pupil of the eye of the user at the first location.

2. The display device of claim 1 , wherein the first subset of the two-dimensional array of tunable masks that blocks transmission of at least the first portion of external light corresponds to the first subset of the two-dimensional array of tiles.

3. The display device of claim 1 , wherein the one or more processors are configured to:

select a subset of pixels of the two-dimensional array of tiles for outputting the collective pattern of light; and

identify a subset of the two-dimensional array of tunable masks that corresponds to the selected subset of pixels of the two-dimensional array of tiles for blocking transmission of light.

4. The display device of claim 3 , wherein the one or more processors are configured to:

obtain an image that corresponds to the collective pattern of light; and

select the subset of pixels of the two-dimensional array of tiles based on the obtained image.

5. The display device of claim 1 , wherein the one or more processors are further configured to:

deactivate one or more tiles of the two-dimensional array of tiles other than the first subset of the two-dimensional array of tiles;

initiate a second subset of the two-dimensional array of tunable masks, that corresponds to the one or more tiles of the two-dimensional array of tiles other than the first subset of the two-dimensional array of tiles, to transmit a second portion of external light distinct from the first portion of external light to the first location of the pupil of the eye of the user; and

in conjunction with transmitting the second portion of external light through the second subset of the two-dimensional array of tunable masks, maintain a direction of the second portion of external light.

6. The display device of claim 1 , wherein:

the eye tracking module is further configured to, subsequent to determining the first location of the pupil of the eye of the user at the first time, determine a second location, distinct from the first location of the pupil of the eye of the user, of the pupil of the eye of the user at a second time that is distinct from the first time; and

the one or more processors are further configured to:

select, based on the second location of the pupil of the eye of the user, a second subset of the two-dimensional array of tiles distinct from the first subset of the two-dimensional array of tiles and a second subset of the two-dimensional array of tunable masks distinct from the first subset of the two-dimensional array of tunable masks;

activate the second subset of the two-dimensional array of tiles for outputting, from at least the second subset of the two-dimensional array of tiles, a collective pattern of light that is directed to the second location of the pupil of the eye of the user; and

initiate the second subset of the two-dimensional array of tunable masks to block transmission of at least a second portion of external light from entering the pupil of the eye of the user at the second location.

7. A method, comprising:

at a display device comprising an eye tracking module, a two-dimensional array of tiles, and a two-dimensional array of tunable masks, each tunable mask of the two-dimensional array of tunable masks corresponding to a single tile of the two-dimensional array of tiles, each tile comprising:

a two-dimensional array of pixels, each pixel configured to output light so that the two-dimensional array of pixels outputs a respective pattern of light, the two-dimensional array of tunable masks configured to conditionally block transmission of external light; and

a lens, of a two-dimensional array of lenses, positioned on a first side of the two-dimensional array of pixels and configured to direct at least a portion of the respective pattern of light from the two-dimensional array of pixels to a pupil of an eye of a user:

determining a first location of the pupil of an eye of a user at a first time;

selecting, based on the first location of the pupil of the eye of the user, a first subset of the two-dimensional array of tiles and a first subset of the two-dimensional array of tunable masks;

activating the first subset of the two-dimensional array of tiles for outputting, from at least the first subset of the two-dimensional array of tiles, a collective pattern of light that is directed to the first location of the pupil of the eye of the user, the first subset of the two-dimensional array of tiles including two or more contiguous tiles, a first tile of the two or more contiguous tiles outputting a first portion of an image and a second tile, adjacent to the first tile, of the two or more contiguous tiles outputting a second portion of the image that does not overlap with the first portion of the image, wherein each pixel of the first subset of the two-dimensional array of tiles outputs light at least a portion of which is directed to the first location of the pupil of the eye of the user; and

initiating the first subset of the two-dimensional array of tunable masks to block transmission of at least a first portion of external light from entering the pupil of the eye of the user at the first location, wherein the two-dimensional array of tunable masks is positioned on a second side of the two-dimensional array of pixels, opposite to the first side of the two-dimensional array of pixels.

8. The method of claim 7 , wherein the first subset of the two-dimensional array of tunable masks that blocks transmission of at least the first portion of external light corresponds to the first subset of the two-dimensional array of tiles.

9. The method of claim 7 , including:

selecting a subset of pixels of the two-dimensional array of tiles for outputting the collective pattern of light; and

identifying a subset of the two-dimensional array of tunable masks that corresponds to the selected subset of pixels of the two-dimensional array of tiles for blocking transmission of light.

10. The method of claim 9 , including:

obtaining an image that corresponds to the collective pattern of light; and

selecting the subset of pixels of the two-dimensional array of tiles based on the obtained image.

11. The method of claim 7 , including:

deactivating one or more tiles of the two-dimensional array of tiles other than the first subset of the two-dimensional array of tiles;

initiating a second subset of the two-dimensional array of tunable masks, that corresponds to the one or more tiles of the two-dimensional array of tiles other than the first subset of the two-dimensional array of tiles, to transmit a second portion of external light distinct from the first portion of external light to the first location of the pupil of the eye of the user; and

in conjunction with transmitting the second portion of external light through the second subset of the two-dimensional array of tunable masks, maintaining a direction of the second portion of external light.

12. The method of claim 7 , further comprising:

subsequent to determining the first location of the pupil of the eye of the user at the first time, determining a second location, distinct from the first location of the pupil of the eye of the user, of the pupil of the eye of the user at a second time that is distinct from the first time; and

selecting, based on the second location of the pupil of the eye of the user, a second subset of the two-dimensional array of tiles distinct from the first subset of the two-dimensional array of tiles and a second subset of the two-dimensional array of tunable masks distinct from the first subset of the two-dimensional array of tunable masks;

activating the second subset of the two-dimensional array of tiles for outputting, from at least the second subset of the two-dimensional array of tiles, a collective pattern of light that is directed to the second location of the pupil of the eye of the user; and

initiating the second subset of the two-dimensional array of tunable masks to block transmission of at least a second portion of external light from entering the pupil of the eye of the user at the second location.

13. A display device, comprising:

an eye tracking module configured to determine a first location of a pupil of an eye of a user at a first time;

a two-dimensional array of tiles, each tile comprising:

a two-dimensional array of pixels, wherein each pixel is configured to output light so that the two-dimensional array of pixels outputs a respective pattern of light; and

a lens, of a two-dimensional array of lenses, positioned on a first side of the two-dimensional array of pixels and configured to direct at least a portion of the respective pattern of light from the two-dimensional array of pixels to the pupil of an eye of a user; and

a two-dimensional array of tunable masks configured to conditionally block transmission of external light, the two-dimensional array of tunable masks positioned on a second side of the two-dimensional array of pixels, opposite to the first side of the two-dimensional array of pixels, wherein:

each tunable mask of the two-dimensional array of tunable masks corresponds to a single tile of the two-dimensional array of tiles; and

the display device is configured to:

select, based on the first location of the pupil of the eye of the user, a first subset of the two-dimensional array of tiles and a first subset of the two-dimensional array of tunable masks;

activate the first subset of the two-dimensional array of tiles for outputting, from at least the first subset of the two-dimensional array of tiles, a collective pattern of light that is directed to the first location of the pupil of the eye of the user, the first subset of the two-dimensional array of tiles including two or more contiguous tiles, a first tile of the two or more contiguous tiles outputting a first portion of an image and a second tile, adjacent to the first tile, of the two or more contiguous tiles outputting a second portion of the image that does not overlap with the first portion of the image, wherein each pixel of the first subset of the two-dimensional array of tiles outputs light at least a portion of which is directed to the first location of the pupil of the eye of the user; and

initiate the first subset of the two-dimensional array of tunable masks to block transmission of at least a first portion of external light from entering the pupil of the eye of the user at the first location.

14. The display device of claim 13 , wherein:

The eye tracking module is further configured to, subsequent to determining the first location of the pupil of the eye of the user at the first time, determine a second location, distinct from the first location of the pupil of the eye of the user, of the pupil of the eye of the user at a second time that is distinct from the first time; and

the display device is further configured to:

select, based on the second location of the pupil of the eye of the user, a second subset of the two-dimensional array of tiles distinct from the first subset of the two-dimensional array of tiles and a second subset of the two-dimensional array of tunable masks distinct from the first subset of the two-dimensional array of tunable masks;

activate the second subset of the two-dimensional array of tiles for outputting, from at least the second subset of the two-dimensional array of tiles, a collective pattern of light that is directed to the second location of the pupil of the eye of the user; and

initiate the second subset of the two-dimensional array of tunable masks to block transmission of at least a second portion of external light from entering the pupil of the eye of the user at the second location.

15. The display device of claim 13 , wherein the display device is configured to:

select a subset of pixels of the two-dimensional array of tiles for outputting the collective pattern of light; and

identify a subset of the two-dimensional array of tunable masks that corresponds to the selected subset of pixels of the two-dimensional array of tiles for blocking transmission of light.

16. The display device of claim 15 , wherein the display device is configured to:

obtain an image that corresponds to the collective pattern of light; and

select the subset of pixels of the two-dimensional array of tiles based on the obtained image.

17. The display device of claim 13 , wherein the display device is configured to:

deactivate one or more tiles of the two-dimensional array of tiles other than the first subset of the two-dimensional array of tiles;

initiate a second subset of the two-dimensional array of tunable masks, that corresponds to the one or more tiles of the two-dimensional array of tiles other than the first subset of the two-dimensional array of tiles, to transmit a second portion of external light distinct from the first portion of external light to the first location of the pupil of the eye of the user; and

in conjunction with transmitting the second portion of external light through the second subset of the two-dimensional array of tunable masks, maintain a direction of the second portion of external light.

18. The display device of claim 1 , wherein:

the eye tracking module includes one or more sensors and one or more emitters configured to emit non-visible light;

the one or more sensors and the one or more emitters are located on a first substrate;

the two-dimensional array of pixels is located on a second substrate that is distinct from the first substrate, separate from the first substrate, and located between the first substrate and the two-dimensional array of lenses;

the two-dimensional array of pixels is configured to transmit at least a portion of non-visible light emitted by the one or more emitters to the eye of the user and to transmit at least a portion of non-visible light from the eye of the user toward the one or more sensors; and

the two-dimensional array of lenses is configured to transmit at least a portion of non-visible light emitted by the one or more emitters to the eye of the user and to transmit at least a portion of non-visible light from the eye of the user toward the one or more sensors.

19. The display device of claim 1 , wherein:

each tile of the two-dimensional array of tiles has a same size.

Assignments (5)
CHANGE OF NAME Recorded Jun 18, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060390/0056 →
CHANGE OF NAME Recorded Jun 6, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 061033/0801 →
CHANGE OF NAME Recorded Nov 28, 2018
From: OCULUS VR, LLC
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 047674/0369 →
CHANGE OF NAME Recorded Sep 20, 2018
From: OCULUS VR, LLC
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 048888/0706 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2016
From: JEPSEN, MARY LOU
To: OCULUS VR, LLC
Reel/Frame 039059/0813 →