Granted Patent B2

US 12,499,622 · App. 18/189,171 · Granted Dec 16, 2025

Inventor: Christian Voss-Wolff (Herzberg am Harz, DE)

Assignee: Microsoft Technology Licensing, LLC.

G06T17/205G06T15/005G06T19/20G06T2219/2012

Abstract

Claims (58)

1 . A method of late stage reprojection comprising:

computing a map of subdivision factors from a depth complexity map corresponding to an image, the map of subdivision factors containing a subdivision factor for a mesh patch;

identifying, from a database comprising a plurality of pre-computed patterns, a pre-computed pattern comprising patch data defining a tessellated mesh patch, the tessellated mesh patch corresponding to the subdivision factor; and

reprojecting the image using the tessellated mesh patch.

2 . The method of claim 1 , comprising:

storing the tessellated mesh patch in memory;

at a later time, computing an updated pose prediction of a pose of a client device;

retrieving the tessellated mesh patch from memory; and

rendering the tessellated mesh patch using the updated pose prediction.

3 . The method of claim 1 , performed by a client device and wherein the database is stored at the client device.

4 . The method of claim 1 , wherein the tessellated mesh patch is indexed according to three subdivision factors.

5 . The method of claim 4 , wherein the subdivision factors are integers up to but not including a size of the tessellated mesh patch in pixels.

6 . The method of claim 5 , wherein one subdivision factor is a subdivision factor for an interior of the tessellated mesh patch, another subdivision factor is a subdivision factor for a top edge of the tessellated mesh patch, and another subdivision factor is a subdivision factor for a left edge of the tessellated mesh patch.

7 . The method of claim 5 , wherein each vertex in the mesh patch corresponds to a corresponding pixel in a depth buffer.

8 . The method of claim 1 wherein;

the tessellated mesh patch is identified by:

reading three subdivision factors, inclusive of the subdivision factor, from the map of subdivision factors;

querying the database with the three subdivision factors; and

retrieving patch data defining the tessellated mesh patch from the database; and

the method further comprises appending the tessellated mesh patch to a tessellated mesh by combining local coordinates of vertices within the tessellated mesh patch with a global position of the tessellated mesh patch and copying resulting values to an output mesh buffer.

9 . The method of claim 8 , wherein the depth complexity map is computed using a planar deviation metric computed using a depth buffer.

10 . The method of claim 1 , wherein the tessellated mesh patch is optimized.

11 . The method of claim 10 wherein the tessellated mesh patch is optimized using one or both of Laplacian smoothing and Delaunay triangulation.

12 . The method of claim 1 wherein the tessellated mesh patch is stitched to other tessellated mesh patches to form a fully connected vertex-buffer-less indexed tessellated mesh, wherein data associated with each vertex of the tessellated mesh patch is encoded into an index buffer.

13 . An apparatus comprising:

a processor;

a memory storing instructions that, when executed by the processor, perform a procedure for late stage reprojection, comprising:

computing a map of subdivision factors from a depth complexity map corresponding to an image, the map of subdivision factors containing a subdivision factor for a mesh patch;

identifying, from a database comprising a plurality of pre-computed patterns, a pre-computed pattern comprising patch data defining a tessellated mesh patch, the tessellated mesh patch corresponding to the subdivision factor; and

reprojecting the image using the tessellated mesh patch.

14 . The apparatus of claim 13 wherein the method procedure further comprises:

storing the tessellated mesh patch in memory;

at a later time, computing an updated pose prediction of a pose of a client device;

retrieving the tessellated mesh patch from memory; and

rendering the tessellated mesh patch using the updated pose prediction.

15 . The apparatus of claim 13 wherein the apparatus is a client device.

16 . The apparatus of claim 13 wherein:

each tessellated mesh patch is indexed according to three subdivision factors inclusive of the subdivision factor;

the three subdivision factors are integers up to a size of the tessellated mesh patch in pixels; and

wherein the three subdivision factors comprise a first subdivision factor for an interior of the tessellated mesh patch, a second subdivision factor for a top edge of the tessellated mesh patch, and a third subdivision factor for a left edge of the tessellated mesh patch.

17 . The apparatus of claim 13 wherein:

the tessellated mesh patch is computed by:

reading three subdivision factors inclusive of the subdivision factor;

querying the database with the three subdivision factors; and

retrieving the patch data defining the tessellated mesh patch from the database; and

the procedure further comprises appending the tessellated mesh patch to a tessellated mesh by combining local coordinates of vertices within the tessellated mesh patch with a global position of the tessellated mesh patch and copying resulting values to an output mesh buffer.

18 . The apparatus of claim 17 , wherein the depth complexity map is computed using a planar deviation metric computed using a depth buffer.

19 . A method for image reprojection, the method comprising:

computing a map of subdivision factors from a depth complexity map corresponding to an image, the map of subdivision factors containing a subdivision factor for a mesh patch, the image is based on an initial pose of a head-mounted display (HMD) device;

identifying, from a database comprising a plurality of pre-computed patterns, a pre-computed pattern comprising patch data defining a tessellated mesh patch, the tessellated mesh patch corresponding to the subdivision factor;

accessing an updated pose of the HMD device; and

producing a reprojected image based on the updated pose of the HMD device using the tessellated mesh patch.

20 . The method of claim 19 , wherein;

the tessellated mesh patch is computed by:

reading three subdivision factors, inclusive of the subdivision factor, from the map of subdivision factors;

querying the database with the three subdivision factors; and

retrieving the patch data defining the tessellated mesh patch from the database; and

the method further comprises appending the tessellated mesh patch to a tessellated mesh by combining local coordinates of vertices within the tessellated mesh patch with a global position of the tessellated mesh patch and copying resulting values to an output mesh buffer.

Assignments (1)

Continuity (1)

References Cited (72)