IP Library Granted Patent US 10,176,639
Granted Patent B2
US 10,176,639 · App. 15/212,053 · Granted Jan 8, 2019

Virtual/augmented reality system having dynamic region resolution

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,176,639
App. No.
15/212,053
Granted
Jan 8, 2019
Kind
B2
Abstract

A virtual image generation system and method is provided. A plurality of synthetic image frames of the three-dimensional scene are rendered, and sequentially displayed to an end user. Each of the displayed image frames has a non-uniform resolution distribution.

Claims (32)

1. A method of operating a virtual image generation system, the method comprising:

estimating a focal point of an eye within a field of view of the end user;

rendering a plurality of synthetic image frames of a three-dimensional scene;

sequentially displaying the plurality of image frames to the end user;

generating a non-uniform resolution distribution for each of the displayed image frames in response to the estimated focal point, the non-uniform resolution distribution having a region of highest resolution and a region of lower resolution, wherein the region of highest resolution is coincident with the estimated focal point, and wherein the estimated focal point of the end user has an error margin to provide a focal range within the field of the view of the end user, and the region of highest resolution intersects the focal range;

blurring the displayed image frames in the region of lower resolution; and

dynamically modifying the error margin based on an assumed eye angular velocity profile.

2. The method of claim 1 , wherein each of the image frames is rendered with the non-uniform resolution distribution.

3. The method of claim 1 , wherein each of the image frames is rendered having a uniform resolution distribution, and wherein displaying the respective image frame comprises incorporating the non-uniform resolution distribution into the already rendered image frame.

4. The method of claim 1 , wherein the region of highest resolution and a region of lower resolution are discrete.

5. The method of claim 4 , further comprising selecting the region of highest resolution from a field of view template having a plurality of discrete regions.

6. The method of claim 5 , wherein the plurality of discrete regions in the field of view template overlap each other.

7. The method of claim 5 , wherein each of the image frames is scanned in a spiral pattern, and wherein each of the discrete regions is sector-shaped.

8. The method of claim 1 , wherein each of the displayed image frames is scanned, and blurring the displayed image frames comprises dithering scan lines in adjacent displayed image frames in the region of lower resolution.

9. The method of claim 1 , wherein blurring the displayed image frames comprises defocusing the displayed image frames in the region of lower resolution.

10. The method of claim 1 , wherein each of the displayed image frames is scanned, and the blurring of the image frames in the region of lower resolution minimizes visual artifacts due to relatively large spacing between scan lines in the region of lower resolution.

11. The method of claim 1 , wherein a resolution distribution of each of the displayed image frames has a slope that matches the slope of an acuity distribution of an eye of the end user.

12. The method of claim 1 , wherein a resolution distribution of each of the displayed image frames has a slope that is greater than the slope of an acuity distribution of an eye of the end user.

13. A virtual image generation system for use by an end user, comprising:

memory storing a three-dimensional scene;

a control subsystem configured for

rendering a plurality of synthetic image frames of the three-dimensional scene,

estimating a focal point of an eye within a field of view of the end user, and generating a non-uniform resolution distribution for each of the displayed image frames based on the estimated focal point, the non-uniform resolution distribution having a region of highest resolution and a region of lower resolution, wherein the region of highest resolution is coincident with the estimated focal point, and wherein the estimated focal point of the end user has an error margin to provide a focal range within the field of the view of the end user, and the region of highest resolution intersects the focal range,

blurring the displayed image frames in the region of lower resolution, and

dynamically modifying the error margin based on an assumed eye angular velocity profile; and

a display subsystem configured for sequentially displaying the plurality of image frames to the end user, wherein each of the displayed image frames has a non-uniform resolution distribution.

14. The virtual image generation system of claim 13 , wherein the display subsystem includes a projection subsystem and a partially transparent display surface, the projection subsystem configured for projecting the image frames onto the partially transparent display surface, and the partially transparent display surface is configured for being positioned in the field of view between the eyes of the end user and an ambient environment.

15. The virtual image generation system of claim 13 , wherein the control subsystem is configured for rendering each of the image frames with the non-uniform resolution distribution.

16. The virtual image generation system of claim 13 , wherein the control subsystem is configured for rendering each of the image frames with a uniform resolution distribution, and wherein the display subsystem is configured for displaying the respective image frame by incorporating the non-uniform resolution distribution into the already rendered image frame.

17. The virtual image generation system of claim 13 , wherein the region of highest resolution and a region of lower resolution are discrete.

18. The virtual image generation system of claim 17 , wherein the control subsystem is configured for selecting the region of highest resolution from a field of view template having a plurality of discrete regions.

19. The virtual image generation system of claim 13 , further comprising one or more sensors configured for detecting the focal point of the end user, wherein the control subsystem is configured for estimating the focal point from the detected focal point.

Assignments (3)
SECURITY INTEREST Recorded Oct 24, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073255/0581 →
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →