IP Library › Granted Patent US 10,504,207
Granted Patent B1
US 10,504,207 · App. 16/433,236 · Granted Dec 10, 2019

Rendering composite content on a head-mounted display including a high resolution inset

Inventors: Austin Wilson (Seattle, WA); Douglas Robert Lanman (Bellevue, WA); Nicholas Daniel Trail (Bothell, WA); Scott Charles McEldowney (Redmond, WA); Stephen James McNally (Woodinville, WA); Yusufu Njoni Bamaxam Sulai (Snohomish, WA)
Assignee: Facebook Technologies, LLC
G06T3/4092G06F3/012G06F3/013G06F3/0346G06T1/20G06T7/12G06T11/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,504,207
App. No.
16/433,236
Granted
Dec 10, 2019
Kind
B1
Abstract

A head-mounted display (HMD) divides an image into a high resolution (HR) inset portion at a first resolution, a peripheral portion, and a transitional portion. The peripheral portion is downsampled to a second resolution that is less than the first resolution. The transitional portion is blended such that there is a smooth change in resolution that corresponds to a change in resolution between a fovea region and a non-fovea region of a retina. An inset region is generated using the HR inset portion and the blended transitional portion, and a background region is generated using the downsampled peripheral portion. The inset region is provided to a HR inset display, and the background region is provided to a peripheral display. An optics block combines the displayed inset region with the displayed background region to generate composite content.

Claims (48)

1. A device comprising:

one or more controllers configured, in combination, to:

generate an image with a high resolution (HR) inset portion, a peripheral portion, and a transitional portion between the HR inset portion and the peripheral portion, wherein the peripheral portion is at a lower resolution than the HR inset portion, and

the transitional portion is configured to conceal a change resolution between the HR inset portion and the peripheral portion;

a display system coupled to the controller and configured to present the HR inset portion, the peripheral portion, and the transitional portion; and

an optics block configured to:

connect the HR inset portion to the peripheral portion using the transitional portion to present a multi-resolution composite of the image.

2. The device of claim 1 , further comprising:

an optical anti-aliasing filter that optically blurs a portion of the peripheral portion.

3. The device of claim 1 , wherein the multi-resolution composite of the image has variable resolution that matches a resolution of a retina of a human eye.

4. The device of claim 1 , wherein the transitional portion is blended such that there is a smooth change in resolution.

5. The device of claim 1 , wherein the optics block includes a steering element that, responsive to instructions received from a controller of the one or more controllers, is configured to adjust a position of the HR inset portion in the multi-resolution composite of the image.

6. The device of claim 1 , wherein the optics block includes a beam splitter that combines the HR inset portion, the peripheral portion, and the transitional portion to form the multi-resolution composite of the image.

7. The device of claim 6 , wherein the beam splitter is within a ball structure.

8. The device of claim 7 , wherein a peripheral display of the display system is a curved display that is coupled directly to a curved surface of the ball structure.

9. The device of claim 7 , further comprising a fiber taper having a first surface and a second surface, and a peripheral display of the display system is a flat display that is coupled to the first surface of the fiber taper, and the second surface of the fiber taper is curved and is coupled to a curved surface of the ball structure.

10. The device of claim 1 , wherein the display system comprises:

a high resolution (HR) inset display that is configured to display the HR inset portion; and

a peripheral display that is configured to display the peripheral portion and the transitional portion.

11. The device of claim 1 , wherein the display system comprises:

a high resolution (HR) inset display that is configured to display the HR inset portion and the transitional portion; and

a peripheral display that is configured to display the peripheral portion.

12. The device of claim 1 , wherein a resolution of the HR inset portion corresponds to a resolution of a fovea of a human eye.

13. The device of claim 1 , wherein a resolution of the HR inset portion is lower than a corresponding resolution of a fovea of a human eye, and the display system comprises:

a high resolution (HR) inset display that is a large inset display that is configured to display the HR inset portion,

wherein the optics block is configured to de-magnify the HR inset portion displayed by the large inset display to increase its resolution.

14. The device of claim 1 , wherein the device is a head-mounted display.

15. The device of claim 1 , further comprising:

an eye tracking unit that is configured to detect movement of an eye of a user, and

wherein at least one of the one or more controllers is further configured to:

receive, from the eye tracking unit, information related to movement of the eye,

determine, based on the information, a gaze direction of the user, and

send steering instructions to a steering element of the optics block to adjust a position of the HR inset portion such that the inset region is centered on the determined gaze direction.

16. The device of claim 1 , wherein at least one controller of the one or more controllers is configured to:

apply a blurring function that blurs a portion of the transitional portion of the image.

17. The device of claim 1 , wherein the display system comprises:

a high resolution (HR) inset display that is configured to display the HR inset portion; and

a peripheral display that is configured to display the peripheral portion, and

wherein at least one controller of the one or more controllers is configured to:

calibrate color for the peripheral display and the HR inset display such that they both are within a threshold range of color values.

18. The device of claim 1 , wherein the display system comprises:

a high resolution (HR) inset display that is configured to display the HR inset portion; and

a peripheral display that is configured to display the peripheral portion, and

wherein at least one controller of the one or more controllers is configured to:

calibrate luminance for the peripheral display and the HR inset display such that they both are within a threshold range of luminance values.

19. The device of claim 1 , wherein at least one controller of the one or more controllers is configured to:

downsample a portion of the image to first resolution that is lower than a resolution of the HR inset portion to generate the peripheral portion.

20. The device of claim 19 , wherein the first resolution corresponds to a resolution of a non-fovea region of a human eye.

Assignments (1)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0224 →
Continuity (3)
Continuation 15947846 · Apr 8, 2018
Continuation 15684769 · Aug 23, 2017
Continuation 15284898 · Oct 4, 2016
Cited By (1)
US 12,360,378