IP Library Granted Patent US 11,011,123
Granted Patent B1
US 11,011,123 · App. 16/539,883 · Granted May 18, 2021

Pan-warping and modifying sub-frames with an up-sampled frame rate

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,011,123
App. No.
16/539,883
Granted
May 18, 2021
Kind
B1
Abstract

In an embodiment, a method includes accessing a first rendered frame generated at a first frame rate. The method includes generating, based on the first rendered frame, one or more sub-frames at a second frame rate that is higher than the first frame rate. A first sub-frame of the one or more sub-frames is generated by determining a displacement measure associated with an anticipated movement of an optics component of a display system and applying, based on the displacement measure, one or more transformations to the first rendered frame to generate the first sub-frame. The first sub-frame is to be perceived by a user using the optics component of the display system. The method includes outputting the one or more sub-frames for display at the second frame rate. The one or more sub-frames are perceived by the user using the optics component of the display system.

Claims (47)

1. A method comprising:

accessing a first rendered frame generated at a first frame rate;

generating, based on the first rendered frame, one or more sub-frames at a second frame rate that is higher than the first frame rate, wherein a first sub-frame of the one or more sub-frames is generated by:

determining a displacement measure associated with an anticipated movement of an optics component for providing output of a display system, wherein first sub-frame is to be perceived by a user using the optics component of the display system; and

applying, based on the displacement measure, one or more transformations to the first rendered frame to generate the first sub-frame; and

outputting the one or more sub-frames for display at the second frame rate, wherein the one or more sub-frames are perceived by the user using the optics component for providing output of the display system.

2. The method of claim 1 , wherein the applying the one or more transformations further comprises:

determining a magnitude and direction by which the first rendered frame has been displaced; and

electronically shifting the first sub-frame inversely proportional to the magnitude and the direction of the displacement.

3. The method of claim 1 , further comprising determining a location of one or more malfunctioning light emitters of the display system.

4. The method of claim 3 , wherein the one or more transformations are based on the location of the one or more malfunctioning light emitters.

5. The method of claim 1 , wherein the anticipated movement of the optics component of the display system comprises a mechanical displacement of a component of the display system in accordance with the first frame rate.

6. The method of claim 1 , wherein the one or more transformations are augmented by a mechanical displacement of the optics component of the display system in accordance with the second frame rate.

7. The method of claim 1 , wherein the one or more transformations comprise a geometric warp of the first rendered frame.

8. The method of claim 1 , wherein the one or more transformations comprise a modification of one or more colors of the first rendered frame or one or more color channels of the first rendered frame.

9. The method of claim 1 , wherein the first rendered frame is generated based on a viewing direction of a user; and

the first sub-frame is further generated by applying one or more transformations to the first rendered frame based on a second viewing direction of the user determined based on sensor data.

10. The method of claim 1 , further comprising:

accessing a second rendered frame generated at the first frame rate after outputting a threshold number of the one or more sub-frames for display.

11. The method of claim 1 , wherein the anticipated movement of the optics component of the display system was performed at a rate sufficient to cause the displacement caused by the movement to be imperceptible to the user.

12. The method of claim 1 , wherein the one or more transformations applied to the first rendered frame decrease a degradation of perceived resolution related to the anticipated movement of the optics component.

13. The method of claim 1 , wherein the first rendered frame is generated by a different computing device than the one or more sub-frames.

14. The method of claim 13 , wherein the computing device that generated the one or more sub-frames is a component of the display system.

15. A system comprising:

one or more processors; and

one or more computer-readable non-transitory storage media coupled to one or more of the processors and comprising instructions operable when executed by one or more of the processors to cause the system to:

access a first rendered frame generated at a first frame rate;

generate, based on the first rendered frame, one or more sub-frames at a second frame rate that is higher than the first frame rate, wherein a first sub-frame of the one or more sub-frames is generated by:

determining a displacement measure associated with an anticipated movement of an optics component for providing output of a display system, wherein first sub-frame is to be perceived by a user using the optics component of the display system; and

applying, based on the displacement measure, one or more transformations to the first rendered frame to generate the first sub-frame; and

output the one or more sub-frames for display at the second frame rate, wherein the one or more sub-frames are perceived by the user using the optics component for providing output of the display system.

16. The system of claim 15 , wherein the applying the one or more transformations further comprises:

determining a magnitude and direction by which the first rendered frame has been displaced; and

electronically shifting the first sub-frame inversely proportional to the magnitude and the direction of the displacement.

17. The system of claim 15 , wherein the instructions are further operable to when executed by one or more of the processors to cause the system to:

determine a location of one or more malfunctioning light emitters of the display system.

18. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

access a first rendered frame generated at a first frame rate;

generate, based on the first rendered frame, one or more sub-frames at a second frame rate that is higher than the first frame rate, wherein a first sub-frame of the one or more sub-frames is generated by:

determining a displacement measure associated with an anticipated movement of an optics component for providing output of a display system, wherein first sub-frame is to be perceived by a user using the optics component of the display system; and

applying, based on the displacement measure, one or more transformations to the first rendered frame to generate the first sub-frame; and

output the one or more sub-frames for display at the second frame rate, wherein the one or more sub-frames are perceived by the user using the optics component for providing output of the display system.

19. The computer-readable non-transitory storage media of claim 18 , wherein the applying the one or more transformations further comprises:

determining a magnitude and direction by which the first rendered frame has been displaced; and

electronically shifting the first sub-frame inversely proportional to the magnitude and the direction of the displacement.

20. The computer-readable non-transitory storage media of claim 18 , wherein the software is further operable when executed to:

determine a location of one or more malfunctioning light emitters of the display system.

Assignments (2)
CHANGE OF NAME Recorded Jul 6, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060591/0848 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2019
From: HUNT, WARREN ANDREW; BLANK, WILLIAM THOMAS; PAPPAS, ILIAS; YEE, MICHAEL; BUCKLEY, EDWARD
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 050269/0731 →