IP Library Granted Patent US 11,221,494
Granted Patent B2
US 11,221,494 · App. 16/709,787 · Granted Jan 11, 2022

Adaptive viewport optical display systems and methods

Inventors: Louahab Noui (Hartfield, GB); Adrian Stannard (St Leonards-on-Sea, GB)
Assignee: FACEBOOK TECHNOLOGIES, LLC
G02B27/0179G02B27/0172G06F3/013G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,221,494
App. No.
16/709,787
Granted
Jan 11, 2022
Kind
B2
Abstract

Optical adaptive viewport display systems and methods are provided. One such optical adaptive viewport display system has an adaptive pupil device which is optical coupled to an optical combiner. The adaptive pupil device is optically couplable to an image projector and is configured to select a sub-pupil from the pupil of the projector. The selected sub-pupil is optically relayed by relay optics from the adaptive pupil device to an eyebox. The relay optics includes an optical combiner. The sub-pupil size and position is selected by the adaptive pupil device so that an optical image spot beam from the sub-pupil and reflected by the optical combiner on to the eye box has a diameter at the eyebox such that the virtual image, as seen by a human eye disposed at the eyebox, is hyperfocused.

Claims (31)

1. An optical display system comprising:

an adaptive pupil device locatable at a pupil of a projection system;

wherein the adaptive pupil device comprises a digital display device configured to select a sub-area of the pupil of the projection system to thereby provide a sub-pupil of the projection system; wherein the digital display device is configured to control selection of size and position of the sub-pupil;

relay optics arranged in optical communication between the digital display device and an eye box;

wherein the digital display device is configured to select the size and the position of the sub-pupil such that the sub-pupil, when relayed by the relay optics on a user's eye at the eyebox, corresponds to a single viewport through which a projected virtual image is viewable by the user's eye in focus beyond a hyperfocal distance;

wherein the relay optics comprises an optical combiner; and

wherein the digital display device is configured to select the corresponding size and position of the sub-pupil of the projection system in response to a monitored gaze angle and eye pupil size such that the projected virtual image is viewable by the user's eye in focus beyond the hyperfocal distance for different gaze angles and eye pupil sizes.

2. The optical display system of claim 1 , wherein the optical combiner is a free space optical combiner.

3. The system of claim 1 , wherein the digital display device comprises a micro display panel.

4. The system of claim 3 , wherein the micro display panel comprises an MEMS, DMD or LCoS.

5. The optical display system of claim 1 , further comprising an eye tracking and sensing device configured to monitor the gaze angle and pupil size of the user's eye.

6. The optical system of claim 1 , wherein the digital display device comprises a micro display panel, and wherein the micro display panel is configured to steer a projected image beam.

7. The optical system of claim 1 , wherein the relay optics are configured to introduce optical power to the system so that location of a projected image can be varied to produce multiple focal planes.

8. The optical system of claim 1 , wherein the optical system comprises a head mounted display.

9. An optical method comprising,

selecting, by a digital display device located at a pupil of a projection system, a sub-area of the pupil of the projection system to thereby provide a sub-pupil of the projection system;

relaying, by optics arranged in optical communication between the digital display device and an eye box; the sub-pupil to the eye box;

where the act of selecting, by a digital display device located at the pupil of the projection system, the sub-area of the pupil of the projection system comprises selecting size and position of the sub-pupil such that the relayed sub-pupil corresponds to a single viewport through which a virtual image projected from the projector system is viewable in focus beyond a hyperfocal distance by a user's eye at the eyebox;

further comprising monitoring, by an eye tracking and sensing device, a gaze angle and pupil size of the user's eye; and

further comprising selecting the corresponding size and position of the sub-pupil of the projection system in response to monitoring the gaze angle and eye pupil size such that a projected virtual image is viewable by the user's eye in focus beyond a hyperfocal distance for different gaze angles and eye pupil sizes.

10. The optical method of claim 9 , wherein the step of relaying, by optics arranged in optical communication between said digital display device and an eye box; the sub-pupil to the eye box; comprises relaying the sub-pupil to the eye box via an optical combiner.

11. The optical method of claim 10 , wherein the optical combiner is a free space optical combiner.

12. The optical method of claim 9 , wherein said digital display device comprises a micro display panel.

13. The optical method of claim 9 , wherein said micro display panel comprises a MEMS, DMD or Locos.

14. The optical method of claim 9 , wherein said digital display device comprises a micro display panel, and steering, by the micro display panel, the projected image beam.

15. The optical method of claim 9 , further comprising introducing optical power to the relay optics so that the location of the projected image can be varied to produce multiple focal planes.

16. An optical display system comprising:

an adaptive pupil device, located at a pupil of a projection system, the adaptive pupil device comprising a digital display device configured provide a sub-pupil of the pupil, and control selection of size and position of the sub-pupil;

relay optics arranged in optical communication between the digital display device and an eye box;

wherein the digital display device is configured to select the size and the position of the sub-pupil such that the sub-pupil, when relayed by the relay optics on a user's eye at the eyebox, corresponds to a single viewport through which a projected virtual image is viewable by the user's eye in focus beyond a hyperfocal distance; and

wherein the digital display device is configured to select the corresponding size and position of the sub-pupil in response to a monitored gaze angle and eye pupil size such that the projected virtual image is viewable by the user's eye in focus beyond the hyperfocal distance for different gaze angles and eye pupil sizes.

Assignments (10)
CHANGE OF NAME Recorded Aug 3, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060936/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2021
From: RPX CORPORATION
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 056777/0588 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2021
From: DAQRI, LLC
To: RPX CORPORATION
Reel/Frame 056195/0239 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2021
From: NOUI, LOUAHAB; STANNARD, ADRIAN
To: DAQRI LLC
Reel/Frame 055686/0056 →
RELEASE OF SECURITY INTEREST Recorded Oct 26, 2020
From: JEFFERIES FINANCE LLC
To: RPX CORPORATION
Reel/Frame 054486/0422 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054198/0029 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054244/0566 →
RELEASE OF SECURITY INTEREST Recorded Aug 14, 2020
From: AR HOLDINGS I, LLC
To: DAQRI, LLC
Reel/Frame 053498/0580 →
PATENT SECURITY AGREEMENT Recorded Aug 14, 2020
From: RPX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 053498/0095 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2020
From: DAQRI, LLC
To: RPX CORPORATION
Reel/Frame 053413/0642 →
Continuity (2)
Provisional Application 62777474 · Dec 10, 2018
Related Publication 20200183174A1 · Jun 11, 2020
Cited By (1)
US 12,204,096