IP Library Granted Patent US 12,022,054
Granted Patent B2
US 12,022,054 · App. 17/649,436 · Granted Jun 25, 2024

Volumetric display including liquid crystal-based lenses

Inventors: Afsoon Jamali (Redmond, WA); Yang Zhao (Kirkland, WA); Wai Sze Tiffany Lam (Redmond, WA); Lu Lu (Kirkland, WA); Douglas Robert Lanman (Bellevue, WA)
Assignee: Meta Platforms Technologies, LLC
H04N13/388G09G3/003H04N13/332H04N13/398G02F1/0136
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,022,054
App. No.
17/649,436
Granted
Jun 25, 2024
Kind
B2
Abstract

A volumetric display may include a two-dimensional display; a varifocal optical system configured to receive image light from the two-dimensional display and focus the image light; and at least one processor configured to: control the two-dimensional display to cause a plurality of sub-frames associated with an image frame to be displayed by the display, wherein each sub-frame of the plurality of sub-frames includes a corresponding portion of image data associated with the image frame; and control the varifocal optical system to a corresponding focal state for each respective sub-frame.

Claims (34)

1. A volumetric display comprising:

a two-dimensional display;

a varifocal optical system configured to receive image light from the two-dimensional display and focus the image light; and

at least one processor configured to:

control the two-dimensional display to cause a plurality of sub-frames associated with an image frame to be displayed by the display in an order corresponding to a depth value range of each sub-frame of the plurality of sub-frames, wherein each sub-frame of the plurality of sub-frames includes a corresponding portion of image data associated with the image frame, wherein each sub-frame includes a plurality of pixels of the image frame binned into the sub-frame based on depth values associated with the pixels, and wherein the depth value range of each sub-frame is determined based on the depth values associated with the pixels such that a first sub-frame of the plurality of sub-frames includes one or more first pixels, of the plurality of pixels, having depth values between a first depth and a second depth greater than the first depth and a second sub-frame of the plurality of sub-frames includes one or more second pixels, of the plurality of pixels, having depth values greater than the second depth; and

control the varifocal optical system to a corresponding focal state for each respective sub-frame.

2. The volumetric display of claim 1 , wherein the varifocal optical system comprises a plurality of optical stages, and wherein each optical stage of the plurality of optical stages comprises a focusing optical element.

3. The volumetric display of claim 2 , wherein the focusing optical element comprises a polarization sensitive focusing optical element, and wherein at least one optical stage of the plurality of optical stages further comprises a switchable wave retarder.

4. The volumetric display of claim 3 , wherein the switchable wave retarder comprises a switchable half waveplate.

5. The volumetric display of claim 3 , wherein the switchable wave retarder comprises at least one ferroelectric liquid crystal cell.

6. The volumetric display of claim 3 , wherein the polarization sensitive focusing optical element comprises at least one of a Pancharatnam-Berry phase (PBP) lens, a polarization sensitive hologram (PSH) lens, a metamaterial, or a liquid crystal optical phase array.

7. The volumetric display of claim 1 , wherein the at least one processor is further configured to control the varifocal optical system to the corresponding focal state for each of the sub-frames within a persistence of a user's vision.

8. The volumetric display of claim 1 , wherein the plurality of sub-frames together recreate the image frame.

9. A system comprising:

a head-mounted display comprising:

a housing;

a two-dimensional display mechanically coupled to the housing;

a varifocal optical system mechanically coupled to the housing and configured to receive image light from the two-dimensional display and focus the image light; and

at least one processor configured to:

cause a plurality of sub-frames associated with an image frame to be displayed by the display in an order corresponding to a depth value range of each sub-frame of the plurality of sub-frames, wherein each sub-frame of the plurality of sub-frames includes a corresponding portion of image data associated with the image frame, wherein each sub-frame includes a plurality of pixels of the image frame binned into the sub-frame based on depth values associated with the pixels such that a first sub-frame of the plurality of sub-frames includes one or more first pixels, of the plurality of pixels, having depth values between a first depth and a second depth greater than the first depth and a second sub-frame of the plurality of sub-frames includes one or more second pixels, of the plurality of pixels, having depth values greater than the second depth, wherein the depth value range of each sub-frame is determined based on the depth values associated with the pixels, and wherein the plurality of sub-frames together include all of the image data associated with the image frame; and

control the varifocal optical system to a corresponding focal state for each respective sub-frame.

10. The system of claim 9 , wherein the varifocal optical system comprises a plurality of optical stages, and wherein each optical stage of the plurality of optical stages comprises a focusing optical element.

11. The system of claim 10 , wherein the focusing optical element comprises a polarization sensitive focusing optical element, and wherein at least one optical stage of the plurality of optical stages further comprises a switchable wave retarder.

12. The system of claim 11 , wherein the switchable wave retarder comprises a switchable half waveplate.

13. The system of claim 11 , wherein the switchable wave retarder comprises at least one ferroelectric liquid crystal cell.

14. The system of claim 11 , wherein the polarization sensitive focusing optical element comprises at least one of a Pancharatnam-Berry phase (PBP) lens, a polarization sensitive hologram (PSH) lens, a metamaterial, or a liquid crystal optical phase array.

15. The system of claim 9 , wherein the at least one processor is further configured to control the varifocal optical system to the corresponding focal state for each respective sub-frame within a persistence of user's vision.

16. The system of claim 9 , further comprising a console communicatively coupled to the head-mounted display, wherein the console is configured to generate the plurality of sub-frames by binning pixels of the image frame into bins based on depth values associated with the pixels.

17. The system of claim 9 , wherein the plurality of sub-frames together recreate the image frame.

18. A method comprising:

causing, by one or more processors, a plurality of sub-frames associated with an image frame to be displayed by a two-dimensional display in an order corresponding to a depth value range of each sub-frame of the plurality of sub-frames, wherein each sub-frame of the plurality of sub-frames includes a corresponding portion of image data associated with the image frame, wherein each sub-frame includes a plurality of pixels of the image frame binned into the sub-frame based on depth values associated with the pixels, wherein the depth value range of each sub-frame is determined based on the depth values associated with the pixels such that a first sub-frame of the plurality of sub-frames includes one or more first pixels, of the plurality of pixels, having depth values between a first depth and a second depth greater than the first depth and a second sub-frame of the plurality of sub-frames includes one or more second pixels, of the plurality of pixels, having depth values greater than the second depth, wherein the depth value range of each sub-frame is determined frame-by-frame, and wherein the plurality of sub-frames together include all of the image data associated with the image frame; and

controlling, by the one or more processors, a varifocal optical system to a corresponding focal state for each respective sub-frame, wherein the varifocal optical system is configured to receive image light from the two-dimensional display and focus the image light.

19. The method of claim 18 , wherein the varifocal optical system comprises a plurality of optical stages, and wherein each optical stage of the plurality of optical stages comprises a focusing optical element, wherein the focusing optical element comprises a polarization sensitive focusing optical element, wherein the polarization sensitive focusing optical element comprises at least one of a Pancharatnam-Berry phase (PBP) lens, a polarization sensitive hologram (PSH) lens, a metamaterial, or a liquid crystal optical phase array, wherein the polarization sensitive focusing optical element comprises an active polarization sensitive focusing optical element, wherein controlling the varifocal optical system comprises controlling a state of the active polarization sensitive focusing optical element, wherein at least one optical stage of the plurality of optical stages further comprises a switchable wave retarder, and wherein controlling the varifocal optical system comprises controlling a state of the switchable wave retarder.

20. The method of claim 18 , wherein causing the plurality of sub-frames associated with the image frame to be displayed by the two-dimensional display and controlling the varifocal optical system to the corresponding focal state for each respective sub-frame occurs within a persistence of a user's vision.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 14, 2024
From: JAMALI, AFSOON; ZHAO, YANG; LAM, WAI SZE TIFFANY; LU, LU; LANMAN, DOUGLAS ROBERT
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 067403/0331 →
CHANGE OF NAME Recorded Jul 21, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060802/0799 →
Continuity (3)
Continuation 16723152 · Dec 20, 2019
Provisional Application 62905113 · Sep 24, 2019
Related Publication 20220159236A1 · May 19, 2022