IP Library Granted Patent US 11,614,631
Granted Patent B1
US 11,614,631 · App. 17/570,012 · Granted Mar 28, 2023

Adaptive viewports for a hyperfocal viewport (HVP) display

Inventors: Louahab Noui (Hartfield, GB); Adrian Stannard (St Leonards-On-Sea, GB)
Assignee: Meta Platforms Technologies, LLC
G02B27/0179G02B27/0172G06F3/013G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,614,631
App. No.
17/570,012
Granted
Mar 28, 2023
Kind
B1
Abstract

Optical adaptive viewport display systems and methods are provided. One such optical adaptive viewport display system has an adaptive pupil device which is optical coupled to an optical combiner. The adaptive pupil device is optically couplable to an image projector and is configured to select a sub-pupil from the pupil of the projector. The selected sub-pupil is optically relayed by relay optics from the adaptive pupil device to an eyebox. The relay optics includes an optical combiner. The sub-pupil size and position is selected by the adaptive pupil device so that an optical image spot beam from the sub-pupil and reflected by the optical combiner on to the eye box has a diameter at the eyebox such that the virtual image, as seen by a human eye disposed at the eyebox, is hyperfocused.

Claims (37)

1. An optical display system that provides an adaptive viewport, the optical display system comprising:

one or more processors configured to execute machine-executable components stored in memory;

an eye tracking device configured to, alone or in combination with the one or more processors, monitor a gaze angle and a size of a pupil of a user's eye located at an eyebox of the optical display system;

an adaptive pupil device located at a pupil of a projection system and configured to select, based on the gaze angle and the size of the pupil of the user's eye, a position and a size of a sub-pupil of the pupil of the projection system;

and

an optical combiner including relay optics configured to relay the sub-pupil of the pupil of the projection system to the eyebox, wherein the sub-pupil of the pupil of the projection system corresponds to the adaptive viewport through which a virtual image projected by the projection system is viewed by the user's eye as hyperfocused.

2. The optical display system of claim 1 , wherein the optical combiner is at least a free space optical combiner, and wherein the optical combiner includes at least one of a partial mirror or a full mirror.

3. The optical display system of claim 1 , wherein the adaptive pupil device comprises a digital display device that selects the size and the position of the sub-pupil of the pupil of the projection system in response to receiving information comprising the gaze angle and the size of the pupil of the user's eye from the eye tracking device.

4. The optical display system of claim 1 , wherein the relay optics is configured to optically relay the sub-pupil of the pupil of the projection system from the adaptive pupil device to the optical combiner and from the optical combiner to the eyebox.

5. The optical display system of claim 1 , wherein the optical display system comprises at least one of an augmented reality (AR) system or a virtual reality (VR) system.

6. The optical display system of claim 1 , wherein:

the optical display system includes a binocular system that includes a first optical display subsystem and a second optical display subsystem,

the first optical display subsystem is configured for a left eye target area, and

the second optical display subsystem is configured for a right eye target area.

7. The optical display system of claim 1 , wherein the adaptive pupil device includes a digital display device, and wherein the digital display device comprises a micro-electrical-mechanical system (MEMS), a Digital Micromirror device (DMD), or a Liquid crystal on silicon (LCoS) display device.

8. The optical display system of claim 1 , wherein the optical combiner comprises a flat reflective combiner, a cascade prism/mirror combiner, arrayed reflectors, total internal reflection (TIR) free form surfaces with see through correctors, or on and off axis reflective lenses.

9. An optical display method, comprising:

monitoring a gaze angle and a pupil size of a lens-detector system located at an eyebox of an optical display system;

selecting, by an adaptive pupil device and based on the gaze angle and the pupil size of the lens-detector system, a position and a size of a sub-pupil of a pupil of a projection system of the optical display system; and

relaying, by relay optics of the optical display system, the sub-pupil of the pupil of the projection system to the eyebox, wherein the sub-pupil of the pupil of the projection system corresponds to an adaptive viewport through which a virtual image projected by the projection system is viewed by the lens-detector system as hyperfocused.

10. The optical display method of claim 9 , wherein relaying the sub-pupil of the pupil of the projection system to the eyebox comprises:

optically relaying the sub-pupil of the pupil of the projection system from the adaptive pupil device to an optical combiner and from the optical combiner to the eyebox.

11. The optical display method of claim 10 , wherein the optical combiner is at least a free space optical combiner, and wherein the optical combiner includes at least one of a partial mirror or a full mirror.

12. The optical display method of claim 9 , wherein the optical display system comprises at least one of an AR system or a VR system.

13. The optical display method of claim 9 , wherein the lens-detector system is at least one of a human eye or an optical lens-detector device.

14. The optical display method of claim 9 , further comprising:

configuring, by the optical display system, a first optical display subsystem for a left eye target area, and a second optical display subsystem for a right eye target area for a binocular system.

15. The optical display method of claim 9 , wherein selecting the position and the size of the sub-pupil of the pupil of the projection system comprises selecting the position and the size of the sub-pupil of the pupil of the projection system via a digital display device located at the pupil of the projection system.

16. A non-transitory machine-readable medium, comprising executable instructions that, when executed by one or more processors, facilitate performance of operations comprising:

monitoring a gaze angle and a pupil size of a lens-detector system located at an eyebox of an optical display system;

selecting, via an adaptive pupil device and based on the gaze angle and the pupil size of the lens-detector system, a position and a size of a sub-pupil of a pupil of a projection system; and

relaying the sub-pupil of the pupil of the projection system to the eyebox, wherein the sub-pupil of the pupil of the projection system corresponds to an adaptive viewport through which a virtual image projected by the projection system is viewed by the lens-detector system as hyperfocused.

17. The non-transitory machine-readable medium of claim 16 , wherein relaying the sub-pupil of the pupil of the projection system to the eyebox comprises:

optically relaying the sub-pupil of the pupil of the projection system from the adaptive pupil device to an optical combiner and from the optical combiner to the eyebox.

18. The non-transitory machine-readable medium of claim 16 , wherein the lens-detector system is at least one of a human eye or an optical lens-detector device.

19. The non-transitory machine-readable medium of claim 16 , wherein selecting the position and the size of the sub-pupil of the pupil of the projection system comprises selecting the position and the size of the sub-pupil of the pupil of the projection system via a digital display device located at the pupil of the projection system.

20. The non-transitory machine-readable medium of claim 16 , wherein the operations further comprise configuring, via the optical display system, a first optical display subsystem for a left eye target area and a second optical display subsystem for a right eye target area for a binocular system.

Assignments (2)
CHANGE OF NAME Recorded Aug 3, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060936/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2022
From: RPX CORPORATION
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 059594/0880 →
Continuity (2)
Continuation 16709787 · Dec 10, 2019
Provisional Application 62777474 · Dec 10, 2018
Cited By (2)
US 12,204,096 US 12,603,983