IP Library Granted Patent US 9,747,862
Granted Patent B2
US 9,747,862 · App. 15/340,641 · Granted Aug 29, 2017

Method of immersive rendering for wide field of view

Inventor: Carroll Philip Gossett (San Jose, CA)
Assignee: CastAR, Inc.
G09G5/003G06F3/012G06F3/013G06T11/60G06T19/006G09G2340/0464
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,747,862
App. No.
15/340,641
Granted
Aug 29, 2017
Kind
B2
Abstract

A method, apparatus, and system is presented by which images of virtual objects displayed in augmented reality systems, virtual reality systems, or immersive display systems for realistic rendering of wide field of view, may be corrected to provide for reduction of registration errors regarding real objects or locations.

Claims (32)

1. A method of adjustment of computer generated graphic images to reduce a registration error due to the assumption of linear perspective rendering in immersive display systems comprising:

rendering a view of a computer graphics scene at a specified pose based on a linear perspective;

reducing a radial distance of pixels in said view from the center by a sine function to generate a modified image, wherein a scaling factor, k, is used with the sine function based on a ratio of the field of view (FoV) in radians to the total number of pixels (R) spanning said FoV, such that k=FoV/R; and

providing the modified image to a display.

2. The method of claim 1 , wherein the radial distance of at least one pixel in polar coordinates (Pr, θ) is transformed to Pr′=[sin(kPr)]/k.

3. A method of adjustment of computer generated graphic images to reduce a registration error due to the assumption of linear perspective rendering in immersive display systems comprising the steps:

rendering a view of a computer graphics scene at a specified pose based on a linear perspective to generate a first array of pixels in Cartesian coordinates;

transforming the first array into polar coordinates;

reducing a radial distance of pixels in said first array by a sine function to form a second array, wherein a scaling factor, k, is used with the sine function based on a ratio of the field of view (FoV) in radians to the total number of pixels (R) spanning said FoV, such that k=FoV/R;

transforming the second array into Cartesian coordinates to generate a modified image; and

displaying the modified image.

4. The method of claim 3 , wherein reducing the radial distance comprises a transformation of the radial distance in polar coordinates (Pr, θ) to Pr′=[sin(kPr)]/k.

5. A method of adjustment of computer generated graphic images to reduce a registration error due to the assumption of linear perspective rendering in immersive display systems comprising:

rendering a view of a computer graphics scene at a specified pose assuming linear perspective associated with a pinhole camera model;

generating a modified image by reducing a radial distance of pixels in said view from a center to counteract an off center registration error generated by use of a linear perspective pinhole camera model to generate the rendered view; and

providing said modified image to a display.

6. A head mounted augmented reality display system, comprising:

a glasses frame;

at least one image projector mounted to the frame;

a graphics processing unit to render images to be projected by the at least one image projector; and

a registration correction unit to distort rendered images, prior to projection, by transforming a radial distance of pixels towards a center of the image to counteract an off center registration error generated by use of a linear perspective pinhole camera model to generate the rendered view.

7. The head mounted augmented reality display system of claim 6 , wherein said registration correction unit reduces the radial distance of pixels to be projected by a sine function, wherein a scaling factor, k, is used with the sine function based on a ratio of the field of view (FoV) in radians to the total number of pixels (R) spanning said FoV, such that k=FoV/R.

8. The head mounted augmented reality display system of claim 7 , wherein the registration correction unit:

converts rendered images from Cartesian coordinates into a first array of pixels in polar coordinates;

generates a second array of pixels, in polar coordinates by distorting the polar radius of pixels in the first array by a sine function, wherein a scaling factor, k, is used with the sine function based on a ratio of the field of view (FoV) in radians to the total number of pixels (R) spanning said FoV, such that k=FoV/R; and

converts the second array into an array of pixels in Cartesian coordinates.

9. The head mounted augmented reality display system of claim 8 , wherein the first array has polar coordinates (Pr, θ) and the second array has the radial distance of pixels transformed to Pr′=[sin(kPr)]/k.

10. A head mounted augmented reality display system, comprising:

a graphics processing unit to render images to be projected by at least one image projector; and

a registration correction unit to distort rendered images, prior to projection, by transforming a radial distance of pixels towards the center of the image to counteract an off center registration error generated by the use of a linear perspective pinhole camera model to generate the rendered view.

11. The head mounted augmented reality display system of claim 10 , wherein said registration correction unit reduces the radial distance of pixels in a view of a computer graphics scene to be projected by a scaled sine function.

12. The head mounted augmented reality display system of claim 10 , wherein the registration correction unit distorts rendered images in polar coordinates according to a sine function with a scaling factor, k, used with the sine function based on a ratio of the field of view (FoV) in radians to the total number of pixels (R) spanning said FoV, such that k=FoV/R.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Sep 18, 2020
From: LOGITECH INTERNATIONAL S.A.
To: TILT FIVE INC.
Reel/Frame 053816/0207 →
RELEASE OF SECURITY INTEREST Recorded Jun 22, 2020
From: SILICON VALLEY BANK
To: CASTAR (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
Reel/Frame 053005/0398 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2018
From: CASTAR INC.
To: TILT FIVE INC.
Reel/Frame 045663/0361 →
SECURITY INTEREST Recorded Mar 1, 2018
From: TILT FIVE, INC.
To: LOGITECH INTERNATIONAL S.A., AS COLLATERAL AGENT
Reel/Frame 045075/0154 →
SECURITY INTEREST Recorded May 11, 2017
From: CASTAR, INC.
To: SILICON VALLEY BANK
Reel/Frame 042341/0824 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2016
From: GOSSETT, CARROLL PHILIP
To: CASTAR, INC.
Reel/Frame 040542/0827 →
Continuity (2)
Provisional Application 62249790 · Nov 2, 2015
Related Publication 20170124980A1 · May 4, 2017